A Systematic Error Leading to Overoptimistic Item Analysis of a Medical Admission Test
Show more
Abstract: During the course of the admission procedure for the diploma programs Human Medicine and Dentistry at the Medical University of Graz in July 2009, a serious error occurred in the evaluation process resulting in the publication of an erroneous provisional list of successful applicants. Under considerable public interest this wrong list had to be withdrawn and corrected. The publication of the erroneous list had been encouraged by a preceding item analysis yielding falsely optimistic results due to this systematic error. The source of the error and its consequences are described in detail, and a simple recipe to avoid similar errors in the future is provided.
Keywords:
Item Analysis; Index of Difficulty; Index of Discrimination; Admission Test; Medical Studies
Cite this paper:
Reibnegger, G. , Caluba, H. , Ithaler, D. , Manhal, S. & Neges, H. (2012). A Systematic Error Leading to Overoptimistic Item Analysis of a Medical Admission Test. Creative Education, 3, 943-945. doi: 10.4236/ce.2012.326143.
References
[1] Lienert, G. A., & Raatz, U. (1988). Testaufbau und testanalyse (6th ed.). Weinheim, Baden-Württemberg: Psychologie Verlags-Union.
[2] Reibnegger, G., Caluba, H.-C., Ithaler, D., Manhal, S., Neges, H. M., & Smolle, J. (2010). Progress of medical students after open admission or admission based on knowledge tests. Medical Education, 44, 205- 214. doi:10.1111/j.1365-2923.2009.03576.x
[3] Reibnegger, G., Caluba, H.-C., Ithaler, D., Manhal, S., Neges, H. M., & Smolle, J. (2011). Dropout rates in medical students at one school before and after the installation of admission tests in Austria. Academic Medicine, 86, 1040-1048. doi:10.1097/ACM.0b013e3182223a1b