DOI: http://dx.doi.org/10.18203/2320-6012.ijrms20161256

Item analysis of multiple choice questions from an assessment of medical students in Bhubaneswar, India

Surya Kumar Namdeo, Bandya Sahoo

Abstract


Background: Multiple choice questions (MCQs) are usually used to assess students in different educational streams. However, the MCQs to be used should be of quality which depends upon its difficulty index (DIF I), discrimination index (DI) and number of Non-functional distracter (NFD). Objective of the study is to evaluate the quality of MCQs, for creating a valid question bank for future use and to identify the low achievers, whose problems can be corrected by counselling or modifying learning methods. This study was done in Kalinga Institute of Medical Science (KIMS) Bhubaneswar.

Methods: A part completion test in the department of pediatrics was done. Total 25 MCQs and 75 distracters were analyzed. Item analysis was done for DIF I and DI and presence of number of NFD.

Results: Difficulty index of 14 (56%) items was in the acceptable range (p value 30-70%), 8 (32%) items were too easy (p value >70%) and 2 (8%) items were too difficult (p value <30%). Discrimination index of 12 (48%) items was excellent (d value>0.35), 3 (12%) items was good (d value 0.20-0.34) and 8(32%) items were poor (d value<0.2%). Out of 75 distracters, 40 (53.4%) NFDs were present in 22 items. 3 (12%) items had no NFDs, whereas 8 (32%), 10 (40%), and 4 (16%) items contained 1, 2, and 3 NFD respectively.

Conclusion: Item analysis is a simple and feasible method of assessing valid MCQs in order to achieve the ultimate goal of medical education.

 


Keywords


Difficulty index, Discrimination index, Item analysis, Multiple choice questions, Non-functional distracter

Full Text:

PDF

References


Chandratilake M, Davis M, Ponnamperuma G. Evaluating and designing assessments for medical education: the utility formula. Intern J Med Edu. 2009;1:1-7.

Hingorjo MR, Jaleel F. Analysis of one-best MCQs: the difficulty index, discrimination index and distracter efficiency. J Pak Med Assoc. 2012;62:142-6.

Haladyna TM, Downing SM, Rodriguez MC. A review of multiple-choice item- writing guidelines for classroom assessment. Appl Measurement Edu. 2002:15(3):309-34.

Gajjar S, Sharma R, Kumar P, Rana M. Item and test analysis to identify quality multiple choice questions (MCQs) from an assessment of medical students of Ahmedabad, Gujarat. Indian J Comm Med. 2014;39(1):17-20.

Sharif MR, Rahimi SM, Rajabi M, Sayyah M. Computer software application in item analysis of exams in a college of medicine. J Sci Tech. 2014;4(10):565-9.

Vyas R, Supe A. Multiple choice questions: a literature review on the optimal number of options. The National J India. 2008;21(3):130-3.

Kehoe J. Writing multiple-choice test items. Pract Assess, Res Evaluation. 2008;4(9).

Singh T, Gupta P, Singh D. Test and item analysis. Principles of Medical Education. 3rd ed. New Delhi, Jaypee Brothers Medical Publishers (P) Ltd; 2009: 70-77.

Tarrant M, Ware J, Mohammed AM. An assessment of functioning and non-functioning distracters in multiple-choice questions: a descriptive analysis. BMC Med Educ. 2009;9:1-8.

Manual of basic workshop in medical education technologies cuttack: regional training centre. SCB medical college cuttack. 2015;63-5.

Bloom S, Hastings T, Modays J. Handbook of formative and summative evaluation of students learning. New York, McGraw Hill; 1971:103.

Karelia BN, Pillai A, Vegada BN. The levels of difficulty and discrimination indices and relationship between them in four responses type multiple choice questions of pharmacology summative tests of year II MBBS students. IEJSME. 2013;6:41-6.

Singh JP, Kariwal P, Gupta SB, Shrotriya VP. Improving multiple choice questions through item analysis: an assessment of the assessment tool. Int J Basic Sci Appl Res. 2014;1(2):53-7.

Mehta G, Mokhasi V. Item analysis of multiple choice questions: an assessment of the assessment tool. Int J Health Sci Res. 2014;4(7):197-202.

Botti MJC, Thomas S. Design, format, validity and reliability of multiple choice questions for use in nursing research and education. Collegian. 2005;12: 19-24.