DOI: http://dx.doi.org/10.18203/2320-6012.ijrms20174114

Evaluation of quality of MBBS Biochemistry theory question papers of medical institutions in Maharashtra

Vinay Patke, Hemant Dahake, Sunil Kuyare

Abstract


Background: In medical curricula, the assessment of cognitive domain of learning is through written theory examination. At present questions are prepared casually just before the examination and are not put through any quality check to assess reliability, validity, educational impact, and acceptability.

Methods: This study was conducted to retrospectively review and evaluate question items in Biochemistry examination question paper, according to specified criteria with the intention to determine its quality and design. A total of 14 preliminary examination question papers were collected by request from medical colleges affiliated to Maharashtra University of Health Sciences, Nashik; to evaluate selection of topics, their weightage, cognitive level, difficulty level and types of MCQ, SAQ and LAQ items, as per prescribed structure and protocol of question setting. The data was compiled in Microsoft excel, and coefficient of variation was calculated for each parameter tested.

Results: There was variation in the topic wise distribution of marks in relation to lecture hours and weightage assigned to each topic. In general, there was inconsistency and nonconformity with respect to the characteristics for maintaining quality. Inadequacy of testing higher cognitive levels and lack of case based and application type of questions was observed.

Conclusions: The quality of question paper setting can be improved by introducing blue print in assessment system. The use of the blue print will ensure consistent high standard of question presentation, which will help students to understand the questions better and to answer them correctly.


Keywords


Biochemistry, Cognitive domain, MBBS, Summative evaluation

Full Text:

PDF

References


Bloom B, Englehart M, Furst E, Hill W, Krathwohl D. Taxonomy of educational objectives: The classification of educational goals. Handbook I: Cognitive domain. New York,T oronto:Longmans, Green; 1956.

Sunita YP, Nayana KH, Bhagyashri RH. Blueprinting in assessment: How much is imprinted in our practice? J Educ Res Med Teach. 2014;2:4-6.

Coderre S, Woloschuk W, McLaughlin K. Twelve tips for blueprinting. Med Teach. 2009;31:322-4.

Adkoli B. Attributes of a good question paper. In: R. Sood (Ed), assessment in medical education: trends and tools, New Delhi, KL Wig Centre for Medical Education and Technology, AIIMS; 1995.

Hamdy H. Blueprinting in medical education. New Eng J Med. 2007;356:387-95.

Hays R. Assessment in medical education: roles for clinical teachers. The Clinical Teacher. 2008;5:23-7.

Buckwalter JA, Schumacher R, Albright JP, Cooper RR. Use of an educational taxonomy for evaluation of cognitive performance. J Med Educ. 1981;56(2):115-21.

McBeath RJ. Ed. Instructing and evaluating higher education: a guidebook for planning learning outcomes. New Jersey: ETP; 1992.

Adkoli BV. Attributes of a good question paper. In: Sood R, chief editor. Assessment in medical education trends and tools. NewDelhi: KL Wig Center for Medical Education and Technology; 1995:73-6.

Palmer EJ, Devitt PG. Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple questions? Research paper. BMC Med Edu. 2007;28;7:49.

Buckwalter JA, Schumacher R, Albright JP, Cooper RR. Use of an educational taxonomy for evaluation of cognitive performance. J Med Educ. 1981;56(2):115-21.

Hamdy H. Blueprinting in medical education. N Engl J Med. 2007;356:387-95.

Adkoli B, Deepak KK, Anshu ST. Principles of assessment in medical education. New Delhi: Jaypee Publishers. Blue printing in assessment; 2012:205-13.