CE  Vol.6 No.6 , April 2015
Objective Structured Clinical Examination (OSCE) with Immediate Feedback in Early (Preclinical) Stages of the Dental Curriculum
ABSTRACT
The Objective Structured Clinical Examination (OSCE) is a test of skills, behaviour, attitudes and application of knowledge, which has been an integral part of medical and dental curricula since late 1970s. As a procedural exam, it has been successfully supplementing other outcome-oriented assessment methods in order to measure students’ preparedness to practice. In addition to making a judgement about competence, the aim of assessment is to guide future learning and shape values. These added benefits can be harnessed by providing feedback on the students’ performance and encouraging reflection. As a tool to reinforce or modify behaviour by focusing on actual performance (compared with the intended performance level), feedback is central to support cognitive and professional development, especially in the early stages of the clinical curriculum. OSCE with immediate feedback combines a work-based assessment method and a short, immediate feedback discussion with the examiner on the student’s performance before they move to the next station. To get the most out of this modified assessment, it should be implemented early in the clinical curriculum. Giving feedback immediately after a task is an efficient learning method and valuable tool for improving student experience. The aim of this paper is to assess the validity and reliability of the OSCE with immediate feedback as an exciting and valuable learning opportunity for students and a revolutionary new informative assessment method for teachers.

Cite this paper
Zaric, S. and Belfield, L. (2015) Objective Structured Clinical Examination (OSCE) with Immediate Feedback in Early (Preclinical) Stages of the Dental Curriculum. Creative Education, 6, 585-593. doi: 10.4236/ce.2015.66058.
References
[1]   Al-Naami, M. Y. (2008). Reliability, Validity, and Feasibility of the Objective Structured Clinical Examination in Assessing Clinical Skills of Final Year Surgical Clerkship. Saudi Medical Journal, 29, 1802-1807.

[2]   Amano, H., Sano, T., Gotoh, K., Kakuta, S., Suganuma, T., Kimura, Y., & Saeki, H. (2004). Strategies for Training Standardized Patient Instructors for a Competency Exam. Journal of Dental Education, 68, 1104-1111.

[3]   Archer, J. C. (2010). State of the Science in Health Professional Education: Effective Feedback. Medical Education, 44, 101-108.
http://dx.doi.org/10.1111/j.1365-2923.2009.03546.x

[4]   Association for Medical Education in Europe (2011). How to Measure the Quality of the OSCE: A Review of Metrics. G. Pell (Ed.). Dundee: Association for Medical Education in Europe.

[5]   Auewarakul, C., Downing, S. M., Jaturatamrong, U., & Praditsuwan, R. (2005). Sources of Validity Evidence for an Internal Medicine Student Evaluation System: An Evaluative Study of Assessment Methods. Medical Education, 39, 276-283.
http://dx.doi.org/10.1111/j.1365-2929.2005.02090.x

[6]   Brazeau, C., Boyd, L., & Crosson, J. (2002). Changing an Existing OSCE to a Teaching Tool: The Making of a Teaching OSCE. Academic Medicine: Journal of the Association of American Medical Colleges, 77, 932.
http://dx.doi.org/10.1097/00001888-200209000-00036

[7]   Brown, G., Manogue, M., & Martin, M. (1999). The Validity and Reliability of an OSCE in Dentistry. European Journal of Dental Education: Official Journal of the Association for Dental Education in Europe, 3, 117-125.
http://dx.doi.org/10.1111/j.1600-0579.1999.tb00077.x

[8]   Chandra, P. S., Chaturvedi, S. K., & Desai, G. (2009). Objective Standardized Clinical Assessment with Feedback: Adapting the Objective Structured Clinical Examination for Postgraduate Psychiatry training in India. Indian Journal of Medical Sciences, 63, 235-243.
http://dx.doi.org/10.4103/0019-5359.53391

[9]   Cronbach, L. J. (1971). Test Validation. In R. Thorndike (Ed.), Educational Measurement (2nd ed., p. 443). Washington DC: American Council on Education.

[10]   Cushing, A., Abbott, S., Lothian, D., Hall, A., & Westwood, O. M. (2011). Peer Feedback as an Aid to Learning--What Do We Want? Feedback. When Do We Want It? Now! Medical Teacher, 33, e105-e112.
http://dx.doi.org/10.3109/0142159X.2011.542522

[11]   Davis, M. H. (2003). OSCE: The Dundee Experience. Medical Teacher, 25, 255-261.
http://dx.doi.org/10.1080/0142159031000100292

[12]   Dennehy, P. C., Susarla, S. M., & Karimbux, N. Y. (2008). Relationship between Dental Students’ Performance on Standardized Multiple-Choice Examinations and OSCEs. Journal of Dental Education, 72, 585-592.

[13]   Dong, T., Saguil, A., Artino Jr., A. R., Gilliland, W. R., Waechter, D. M., Lopreaito, J., Flanagan, A., & Durning, S. J. (2012). Relationship between OSCE Scores and Other Typical Medical School Performance Indicators: A 5-Year Cohort Study. Military Medicine, 177, 44-46.
http://dx.doi.org/10.7205/MILMED-D-12-00237

[14]   Downing, S. M. (2003). Validity: On the Meaningful Interpretation of Assessment Data. Medical Education, 37, 830-837.
http://dx.doi.org/10.1046/j.1365-2923.2003.01594.x

[15]   Downing, S. M. (2004). Reliability: On the Reproducibility of Assessment Data. Medical Education, 38, 1006-1012.
http://dx.doi.org/10.1111/j.1365-2929.2004.01932.x

[16]   Downing, S. M. (2006). Face Validity of Assessments: Faith-Based Interpretations or Evidence-Based Science? Medical Education, 40, 7-8.
http://dx.doi.org/10.1111/j.1365-2929.2005.02361.x

[17]   Eberhard, L., Hassel, A., Baumer, A., Becker, F., Beck-Mubotter, J., Bomicke, W., Wege, K. C. et al. (2011). Analysis of Quality and Feasibility of an Objective Structured Clinical Examination (OSCE) in Preclinical Dental Education. European Journal of Dental Education: Official Journal of the Association for Dental Education in Europe, 15, 172-178.
http://dx.doi.org/10.1111/j.1600-0579.2010.00653.x

[18]   Epstein, R. M. (2007). Assessment in Medical Education. The New England Journal of Medicine, 356, 387-396.
http://dx.doi.org/10.1056/NEJMra054784

[19]   Firmstone, V. R., Bullock, A. D., Frame, J. W., & Wilson, M. (2007). Temporary Registration in Primary Care for Dentists Moving to the UK from Outside the EU: An Evaluation of a National Pilot Scheme. British Dental Journal, 203, 251-255.
http://dx.doi.org/10.1038/bdj.2007.789

[20]   Govaerts, M., & van der Vleuten, C. P. (2013). Validity in Work-Based Assessment: Expanding Our Horizons. Medical Education, 47, 1164-1174.
http://dx.doi.org/10.1111/medu.12289

[21]   Graham, R., Zubiaurre Bitzer, L. A., & Anderson, O. R. (2013). Reliability and Predictive Validity of a Comprehensive Preclinical OSCE in Dental Education. Journal of Dental Education, 77, 161-167.

[22]   Gupta, P., Dewan, P., & Singh, T. (2010). Objective Structured Clinical Examination (OSCE) Revisited. Indian Pediatrics, 47, 911-920.
http://dx.doi.org/10.1007/s13312-010-0155-6

[23]   Hamann, C., Volkan, K., Fishman, M. B., Silvestri, R. C., Simon, S. R., & Fletcher, S. W. (2002). How Well Do Second-Year Students Learn Physical Diagnosis? Observational Study of an Objective Structured Clinical Examination (OSCE). BMC Medical Education, 2, 1.
http://dx.doi.org/10.1186/1472-6920-2-1

[24]   Hammad, M., Oweis, Y., Taha, S., Hattar, S., Madarati, A., & Kadim, F. (2013). Students’ Opinions and Attitudes after Performing a Dental OSCE for the First Time: A Jordanian Experience. Journal of Dental Education, 77, 99-104.

[25]   Harden, R. M. (1979). Assessment of Medical Competence Using an Objective Structured Clinical Examination (OSCE). Dundee: Association for the Study of Medical Education.

[26]   Hodder, R. V., Rivington, R. N., Calcutt, L. E., & Hart, I. R. (1989). The Effectiveness of Immediate Feedback during the Objective Structured Clinical Examination. Medical Education, 23, 184-188.
http://dx.doi.org/10.1111/j.1365-2923.1989.tb00884.x

[27]   Hodges, B. (2003). Validity and the OSCE. Medical Teacher, 25, 250-254.
http://dx.doi.org/10.1080/01421590310001002836

[28]   Homer, M., & Pell, G. (2009). The Impact of the Inclusion of Simulated Patient Ratings on the Reliability of OSCE Assessments under the Borderline Regression Method. Medical Teacher, 31, 420-425.
http://dx.doi.org/10.1080/01421590802520949

[29]   Iramaneerat, C., Yudkowsky, R., Myford, C. M., & Downing, S. M. (2008). Quality Control of an OSCE Using Generalizability Theory and Many-Faceted Rasch Measurement. Advances in Health Sciences Education: Theory and Practice, 13, 479-493.
http://dx.doi.org/10.1007/s10459-007-9060-8

[30]   Kaufman, D. M., Mann, K. V., Muijtjens, A. M., & van der Vleuten, C. P. (2000). A Comparison of Standard-Setting Procedures for an OSCE in Undergraduate Medical Education. Academic Medicine: Journal of the Association of American Medical Colleges, 75, 267-271.
http://dx.doi.org/10.1097/00001888-200003000-00018

[31]   Kurz, J. M., Mahoney, K., Martin-Plank, L., & Lidicker, J. (2009). Objective Structured Clinical Examination and Advanced Practice Nursing Students. Journal of Professional Nursing: Official Journal of the American Association of Colleges of Nursing, 25, 186-191.
http://dx.doi.org/10.1016/j.profnurs.2009.01.005

[32]   Logan, H. L., Muller, P. J., Edwards, Y., & Jakobsen, J. R. (1999). Using Standardized Patients to Assess Presentation of a Dental Treatment Plan. Journal of Dental Education, 63, 729-737.

[33]   Manogue, M., McLoughlin, J., Christersson, C., Delap, E., Lindh, C., Schoonheim-Klein, M., & Plasschaert, A. (2011). Curriculum Structure, Content, Learning and Assessment in European Undergraduate Dental Education—Update 2010. European Journal of Dental Education: Official Journal of the Association for Dental Education in Europe, 15, 133-141.
http://dx.doi.org/10.1111/j.1600-0579.2011.00699.x

[34]   Martin, I. G., & Jolly, B. (2002). Predictive Validity and Estimated Cut Score of an Objective Structured Clinical Examination (OSCE) Used as an Assessment of Clinical Skills at the End of the First Clinical Year. Medical Education, 36, 418-425.
http://dx.doi.org/10.1046/j.1365-2923.2002.01207.x

[35]   Mohtadi, N. G., Harasym, P. H., Pipe, A. L., Strother, R. T., & Mah, A. F. (1995). Using an Objective Structured Clinical Examination to Evaluate Competency in Sport Medicine. Clinical Journal of Sport Medicine: Official Journal of the Canadian Academy of Sport Medicine, 5, 82-85.
http://dx.doi.org/10.1097/00042752-199504000-00002

[36]   Muller, E. S., Harik, P., Margolis, M., Clauser, B., McKinley, D., & Boulet, J. R. (2003). An Examination of the Relation-ship between Clinical Skills Examination Performance and Performance on USMLE Step 2. Academic Medicine: Journal of the Association of American Medical Colleges, 78, S27-S29.
http://dx.doi.org/10.1097/00001888-200310001-00009

[37]   Napankangas, R., Harila, V., & Lahti, S. (2012). Experiences in Adding Multiple-Choice Questions to an Objective Structural Clinical Examination (OSCE) in Undergraduate Dental Education. European Journal of Dental Education: Official Journal of the Association for Dental Education in Europe, 16, e146-e150.

[38]   Ratzmann, A., Wiesmann, U., & Kordass, B. (2012). Integration of an Objective Structured Clinical Examination (OSCE) into the Dental Preliminary Exams. GMS Zeitschrift für medizinische Ausbildung, 29, Doc09.

[39]   Schoonheim-Klein, M., Muijtjens, A., Habets, L., Manogue, M., Van der Vleuten, C., Hoogstraten, J., & Van der Velden, U. (2008). On the Reliability of a Dental OSCE, Using SEM: Effect of Different Days. European Journal of Dental Education: Official Journal of the Association for Dental Education in Europe, 12, 131-137.
http://dx.doi.org/10.1111/j.1600-0579.2008.00507.x

[40]   Schoonheim-Klein, M., Muijtjens, A., Habets, L., Manogue, M., van der Vleuten, C., & van der Velden, U. (2009). Who Will Pass the Dental OSCE? Comparison of the Angoff and the Borderline Regression Standard Setting Methods. European Journal of Dental Education: Official Journal of the Association for Dental Education in Europe, 13, 162-171.
http://dx.doi.org/10.1111/j.1600-0579.2008.00568.x

[41]   Schoonheim-Klein, M., Walmsley, A. D., Habets, L., van der Velden, U., & Manogue, M. (2005). An Implementation Strategy for Introducing an OSCE into a Dental School. European Journal of Dental Education: Official Journal of the Association for Dental Education in Europe, 9, 143-149.
http://dx.doi.org/10.1111/j.1600-0579.2005.00379.x

[42]   Silva, C. C., Lunardi, A. C., Mendes, F. A., Souza, F. F., & Carvalho, C. R. (2011). Objective Structured Clinical Evaluation as an Assessment Method for Undergraduate Chest Physical Therapy Students: A Cross-Sectional Study. Revista Brasileira De Fisioterapia (Sao Carlos (Sao Paulo, Brazil)), 15, 481-486.
http://dx.doi.org/10.1590/S1413-35552011005000033

[43]   Simon, S. R., Volkan, K., Hamann, C., Duffey, C., & Fletcher, S. W. (2002). The Relationship between Second-Year Medical Students’ OSCE Scores and USMLE Step 1 Scores. Medical Teacher, 24, 535-539.
http://dx.doi.org/10.1080/0142159021000012586

[44]   Sloan, D. A., Donnelly, M. B., Schwartz, R. W., Felts, J. L., Blue, A. V., & Strodel, W. E. (1996). The Use of the Objective Structured Clinical Examination (OSCE) for Evaluation and Instruction in Graduate Medical Education. The Journal of Surgical Research, 63, 225-230.
http://dx.doi.org/10.1006/jsre.1996.0252

[45]   Tavakol, M., & Dennick, R. (2011). Post-Examination Analysis of Objective Tests. Medical Teacher, 33, 447-458.
http://dx.doi.org/10.3109/0142159X.2011.564682

[46]   Townsend, A. H., McLlvenny, S., Miller, C. J., & Dunn, E. V. (2001). The Use of an Objective Structured Clinical Examination (OSCE) for Formative and Summative Assessment in a General Practice Clinical Attachment and Its Relationship to Final Medical School Examination Performance. Medical Education, 35, 841-846.
http://dx.doi.org/10.1046/j.1365-2923.2001.00957.x

[47]   Van Der Vleuten, C. P. (1996). The Assessment of Professional Competence: Developments, Research and Practical Implications. Advances in Health Sciences Education: Theory and Practice, 1, 41-67.
http://dx.doi.org/10.1007/BF00596229

[48]   Wilkinson, T. J., Newble, D. I., & Frampton, C. M. (2001). Standard Setting in an Objective Structured Clinical Examination: Use of Global Ratings of Borderline Performance to Determine the Passing Score. Medical Education, 35, 1043-1049.
http://dx.doi.org/10.1046/j.1365-2923.2001.01041.x

 
 
Top