(CZ) Predikční validita zkoušek zakončujících středoškolské vzdělávání a přijímacích testů na vysoké školy
(EN) The Predictive Value of Final Middle-School Examinations and Entrance Tests at Universities
Autor / Author: BARTÁKOVÁ, I., CHVÁL, M., MARTINKOVÁ, P.
Klíčová slova / Key words: predikční validita, průměr známek, středoškolský prospěch, přijímací testy, prediktor, akademický úspěch, prospěch na VŠ
predictive value, secondary-school grade point average, entrance tests, predictor, academic success university grade point average
Přehledová studie mapuje vybrané výzkumy predikční validity zkoušek zakončujících středoškolské vzdělávání a přijímacích testů na vysoké školy. Predikční validita je důležitou vlastností testu a vyjadřuje jeho schopnost předpovídat budoucí úspěch. Mezi nejužívanější prediktory patří právě výsledky v přijímacích testech a hodnocení ze středních škol, přičemž porovnávání jejich vlivu je jedním z často diskutovaných témat. Ač existuje několik kritérií akademického úspěchu, nejčastěji je využíván studijní průměr během prvního ročníku studia, postup do druhého ročníku nebo úspěšné dokončení studia. Analyzované studie jsou rozděleny do kapitol podle jejich hlavního cíle, od studií zaměřujících se na středoškolské zkoušky ke studiím zjišťujícím predikční validitu přijímacích zkoušek. Dalším kritériem řazení je země původu dat. Samostatná část je věnována výzkumům v České republice. Ze studií jednoznačně vyplývá, že využití přijímacích testů i prospěchu ze střední školy je v rámci přijímacích řízení na vysoké školy opodstatněné. Oba tyto parametry dokáží předpovědět, zda student bude ve studiu úspěšný i zda studium zdárně dokončí, přičemž nejlepších výsledků bývá dosaženo při zohlednění obou těchto parametrů současně.
Annotation:
This review study gives an overview of selected studies of the predictive validity of final secondary-school examinations and university entrance tests. Predictive validity is an important property of tests, expressing their capacity to predict future success. University entrance test scores and secondary-school grade point average (GPA) are among the most frequently used predictors, and comparison of their influence is an often discussed topic. Although there exist several criteria for academic success, the most often applied outcome measures are first-year university GPA, successful progress to the second year, or successful completion of university degree. The studies analyzed in the article are divided into categories according to their main goal, from studies focused on secondary-school examinations to studies of the predictive validity of university entrance tests. Another criterion for classification is the country of origin of the data. A separate section is devoted to studies conducted in the Czech Republic. It clearly emerges from the studies that the use of both entrance test scores and secondary-school GPA as admission criteria are justified. Both these parameters predict whether the student will be successful in studies and will obtain university degree, while the best results in terms of predictive power are usually achieved by the use of both parameters together.
Článek ke stažení v češtině [PDF]:
Download the article in English [PDF]:
Literatura / References:
Adebayo, A. S., & Dorcas, A. T. (2014). Entry criteria as predictor of academic success: A case of Solusi University, Zimbabwe. European Scientific Journal, 10(13).
Atkinson, R. C., & Geiser, S. (2009). Reflections on a century of college admission tests. Research and Occasional Papers Series.
https://doi.org/10.3102/0013189X09351981
Burton, N. W., & Ramist, L. (2001). Predicting success in college: SAT studie sof classes graduating since 1980. College Board Research Report 2001-2. New York: College Board.
Burton, N. W., & Wang, M. (2005). Predicting long-term successin graduate school: A collaborative validity study. GRE Board Report No. 99-14R.
Cerutti, B., Bernheim, L., & van Gessel, L. (2013). The predictive validity of the aptitude test for the performance of students starting a medical curriculum. Swiss Medical Weekly, 143, w13872.
https://doi.org/10.4414/smw.2013.13872
PMid:24089100
Dunleavy, D. M., Kroopnick, M. H., Dowd, K. W., Searcy, C. A., & Zhao, X. (2013). The predictive validity of the MCAT exam in relation to academic performance through medical school: A national cohort study of 2001−2004 matriculants. Academic Medicine, 88(5), 666–671.
https://doi.org/10.1097/ACM.0b013e3182864299
PMid:23478635
Emery, J. L., & Bell, J. F. (2009). The predictive validity of the BioMedical Admissions Test for pre-clinical examination performance. Medical Education, 43, 557–564.
https://doi.org/10.1111/j.1365-2923.2009.03367.x
PMid:19493180
Evans, B. J. (2015). College admission testing in America. In V. Stead (Ed.), International perspectives in higher education admission policy: A reader. New York: Peter Lang.
Geiser, S., & Santelices, M. V. (2007). Validity of high-school grades in predicting student success beyond the freshman year. Research & Occasional Paper Series. Center for Studies in Higher Education. USA, University of California.
Gill, T., & Vidal Rodeiro, C. L. (2014). Predictive validity of level 3 qualifications: Extended project, Cambridge Pre-U, International Baccalauréate, BTEC Diploma. Cambridge Assessment Research Report. Cambridge, UK: Cambridge Assessment.
Halpenny, D., Vadlo, K., Halpenny, M., Burke, J., & Torreggiani, W. (2010). The health professions admission test (HPAT) score and leaving certificate results can independantly predict academic performance in medical school: Do we need both tests? Irish Medical Journal.
PMid:21560500
Hattami, A. A. D. (2012). Differential predictive validity of high school GPA and college entrance test scores for university students in Yemen. (Disertační práce).
HEFCE (2014). Differences in degree outcomes: Key findings. Dostupné z www.hefce.ac.uk/media/hefce/content/pubs/2014/201403/HEFCE2014_03.pdf
Höschl, C., & Kožený, J. (1997). Predicting academic performance of medical students: The first three years. American Journal of Psychiatry, 154(6, Suppl.), 87−92.
https://doi.org/10.1176/ajp.154.6.87
PMid:9167550
Kadmon, G., & Kadmon, M. (2016). Academic performance of students with the highest and mediocre school-leaving grades: Does the aptitude Test for Medical Studies balance their prognoses? GMS Journal for Medical Education, 33(1).
Kobrin, J. L., Patterson, B. F., Shaw, E. J., Mattern, K. D., & Barbuti, S. M. (2008). Validity of the SAT for predicting first-year college grade point average. College Board Research Report No. 2008-5. New York: College Board.
Kobrin, J. L., & Michel, R. S. (2006). The SAT as a predictor of different levels of college performance. College Board Research Report No. 2006-3. New York: College Board.
Kolářová, R., et al. (2004). Stanovování predikční validity didaktických testů používaných při přijímacích zkouškách na UK. Praha: PedF UK. Výzkumná zpráva k projektu Zavádění nových metod do učitelského vzdělávání na Univerzitě Karlově.
Kuncel, N. R., Hezlett, S. A., & Ones, D. S. (2001). A comprehensive meta-analysis of the predictive validity of the Graduate Record Examinations: Implications for graduate student selection and performance. Psychological Bulletin, 27(1), 162−181.
https://doi.org/10.1037/0033-2909.127.1.162
Liu, O. L., Kliner, D. M., Bochenek, J. L., Holtzman, S. L., & Xu, J. (2016). An investigation of the use and predictive validity of scores from the GRE revised general test in a Singaporean university. ETS Research Report Series, 1, 1−12.
https://doi.org/10.1002/ets2.12095
Lynch, B., MacKenzie, R., Dowell, J., Cleland, J., & Prescott, G. (2009). Does the UKCAT predict year 1 performance in medical school? Medical Education 43(12), 1203−1209.
https://doi.org/10.1111/j.1365-2923.2009.03535.x
PMid:19930512
Martinková, P., Drabinová, A., & Houdek, J. (2017). Shiny Item Analysis: Analýza přijímacích a jiných znalostních či psychologických testů. Testfórum, 9, 16−35.
https://doi.org/10.5817/TF2017-9-129
Mattern, K. D., & Patterson, B. F. (2009). Is performance on the SAT related to college retention? College Board Research Report No. 2009-7. New York: College Board.
Mattern, K. D., Shaw, E. J., & Xiong, X. (2009). The relationship between AP Exam performance and college outcomes. College Board Research Report No. 2009-4. New York: College Board.
McManus, I. C., Woolf, K., Dacre, J., Paice, E., & Dewberry, C. (2013a). The Academic Backbone: Longitudinal continuities in educational achievement from secondary school and medical school to MRCP (UK) and the specialist register in UK medical students and doctors. BMC Medicine, 11(242).
https://doi.org/10.1186/1741-7015-11-242
McManus, I. C., Dewberry, C., Nicholson, S., & Dowell, J. S. (2013b). The UKCAT-12 study: Educational attainment, aptitude test performance, demographic and socio-economic contextual factors as predictors of first year outcome in a cross-sectional collaborative study of 12 UK medical schools. BMC Medicine, 11(244).
https://doi.org/10.1186/1741-7015-11-244
McManus, I. C., Dewberry, C., Nicholson, S., Dowell, J. S., Wolf, K., & Potts, H. W. W. (2013c). Construct-level predictive validity of educational attainment and intellectual aptitude tests in medical student selection: Meta-regression of six UK longitudinal studies. BMC Medicine.
https://doi.org/10.1186/1741-7015-11-243
McManus, I. C., Ferguson, E., Wakeford, R., Powis, D., & James, D. (2011) Predictive validity of the Biomedical Admissions Test: an evaluation and case study. Medical Teacher, 33(1), 53−57.
https://doi.org/10.3109/0142159X.2010.525267
McManus, I. C., Smithers, E., Partridge, P., Keeling, A., & Fleming, P. R. (2003). A-levels and intelligence as predictors of medical careers in UK doctors: 20 years prospective study. BMJ, 327(139).
https://doi.org/10.1136/bmj.327.7407.139
PMid:12869457 PMCid:PMC165701
MŠMT (2017). Statistické výstupy a analýzy. Dostupné z http://www.msmt.cz/vzdelavani/skolstvi-v-cr/statistika-skolstvi/prijimaci-rizeni-ke-studiu-na-vysoke-a-vyssi-odborne-skole-1
NACAC (2016). Use of predictive validity studies to inform admission practices. NACAC Research Report. Dostupné z https://www.nacacnet.org/globalassets/documents/publications/research/testvalidity.pdf
Poole, P., Shulruf, B., Rudland, J., & Wilkinson, T. (2012). Comparison of UMAT scores and GPA in prediction of performance in medical school: a national study. Medical Education, 46(2), 163−171.
https://doi.org/10.1111/j.1365-2923.2011.04078.x
PMid:22239330
Rasmus, J. (2016). Predicting study performance for one academic year at university. (Diplomová práce). Dostupné z http://www.mensa.fi/wordpress/wp-content/uploads/2016/05/Gradu-Jonathan-Rasmus.pdf
Rubešová, J. (2009). Souvisí úspěšnost studia na vysoké škole se středoškolským prospěchem? Pedagogická orientace, 3, 89−103.
Salvatori, P. (2001). Reliability and validity of admission tools used to select students for the health professions. Advances in Health Science, 6, 159−175.
https://doi.org/10.1023/A:1011489618208
Smith, J., & Naylor, R. (2001). Determinants of degree performance in UK universities: a statistical analysis of the 1993 student cohort. Oxford Bulletin of Economics and Statistics, 63(1).
https://doi.org/10.1111/1468-0084.00208
Smith, K. M. (2014). The predictive validity of pre-admission measures on podiatric medical school performance. (Disertační práce). Dostupné z http://digitalcommons.unl.edu/cgi/
Sočan, G., Krebl, M., Špeh, A., & Kutin, A. (2016). Predictive validity of the Slovene Matura for academic achievement in humanities and social sciences. Horizont of Psychology, 25, 84−93.
https://doi.org/10.20419/2016.25.449
Synek, J., & Otřísal, V. (2008). Predikční validita testu OSP – výsledky analýzy. SCIO.
PMCid:PMC2438459
Štuka, Č., Martinková, P., Zvára, K., & Zvárová, J. (2012). The prediction and probability for successful completion in medical study based on tests and pre-admission grades. The New Educational Review, 28(2).
Tesfa, M. (2014). The validity of University Entrance Examination and high school grade pointaverage for predicting first year university students´ academic performance. University of Twente, Faculty of behavioural science.
Vidal Rodeiro, C. L., Sutch, T., & Zanini, N. (2013). Prior learning of undergraduates in UK higher education institutions. Cambridge Assessment Research Report. Cambridge, UK: Cambridge Assessment.
Viktorová, L. (2014). Reliabilita a validita SPF (Test předpokladů ke studiu na FF UP). (Diplomová práce).
Wilkinson, D., Zhang, J., & Parker, M. (2011). Predictive validity of the Undergraduate Medicine and Health Sciences Admission Test for medical students´ academic performance. The Medical Journal of Australia, 194(7).
PMid:21470083
Young, J. W., Klieger, D., Bochenek, J., Li, C., & Cline, F. (2014). The validity of scores from the GRE revised general test for forecasting performance in business schools: Phase one. ETS GRE Board Research Report No. RR-14-17.
Zanini, N., & Vidal Rodeiro, C. L. (2014). The role of the A* grade at A-level as a predictor of university performance. Cambridge Assessment Research Report. Cambridge, UK: Cambridge Assessment.
Ziv, A., Rubin, O., Moshinsky, A., Gafni, N., Kotler, M., Dagan, Y., ... Mittelman, M. (2008). MOR: a simulation-based assessment centre for evaluating the personal and interpersonal qualities of medical school candidates. Medical Education, 42, 991–998.
https://doi.org/10.1111/j.1365-2923.2008.03161.x
PMid:18823518
Zvára, K., & Anděl, J. (2001). Souvislost výsledků přijímacího řízení s úspěšností studia na MFF. Pokroky matematiky, fyziky a astronomie, 46(6), 304–312.