TITLE

Pick-N multiple choice-exams: a comparison of scoring algorithms

AUTHOR(S)
Bauer, Daniel; Holzer, Matthias; Kopp, Veronika; Fischer, Martin R.
PUB. DATE
May 2011
SOURCE
Advances in Health Sciences Education;May2011, Vol. 16 Issue 2, p211
SOURCE TYPE
Academic Journal
DOC. TYPE
Article
ABSTRACT
To compare different scoring algorithms for Pick-N multiple correct answer multiple-choice (MC) exams regarding test reliability, student performance, total item discrimination and item difficulty. Data from six 3rd year medical students' end of term exams in internal medicine from 2005 to 2008 at Munich University were analysed (1,255 students, 180 Pick-N items in total). Scoring Algorithms: Each question scored a maximum of one point. We compared: (a) Dichotomous scoring (DS): One point if all true and no wrong answers were chosen. (b) Partial credit algorithm 1 (PS): One point for 100% true answers; 0.5 points for 50% or more true answers; zero points for less than 50% true answers. No point deduction for wrong choices. (c) Partial credit algorithm 2 (PS): A fraction of one point depending on the total number of true answers was given for each correct answer identified. No point deduction for wrong choices. Application of partial crediting resulted in psychometric results superior to dichotomous scoring (DS). Algorithms examined resulted in similar psychometric data with PS only slightly exceeding PS in higher coefficients of reliability. The Pick-N MC format and its scoring using the PS and PS algorithms are suited for undergraduate medical examinations. Partial knowledge should be awarded in Pick-N MC exams.
ACCESSION #
59672191

 

Related Articles

Share

Read the Article

Courtesy of THE LIBRARY OF VIRGINIA

Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics