Comparing the borderline group and borderline regression approaches to setting Objective Structured Clinical Examination cut scores

Katharine Jane Reid, Agnes Dodds

2018, Vol: 8, Issue: 1

8/1Current Issue Online First Archive Aims and Scope Abstracting & Indexing Most Accessed Articles Most Downloaded Articles Most Cited Articles

Required files to uploaded

Author Agreement Form

« Previous Article

Original Research

J Contemp Med Edu. 2014; 2(1): 8-12

doi: 10.5455/jcme.20130921013523

Comparing the borderline group and borderline regression approaches to setting Objective Structured Clinical Examination cut scores

Katharine Jane Reid, Agnes Dodds.

Cited by (1)

Abstract
OBJECTIVE
The aim of the study was to compare the Borderline Group and Borderline Regression approaches to setting standards on nine Objective Structured Clinical Examinations (OSCEs) undertaken in the final year of medical school. For each of nine OSCEs completed by 301 students we obtained a total score (maximum 40 marks) and a global score on a 5-point rating scale which examiners completed after scoring the OSCE using a checklist. We calculated cut scores for each OSCE using the Borderline Group method by computing the mean and the median score of the group of students whose performance was rated by examiners rated as borderline. We calculated cut scores for each OSCE using the Borderline Regression method by predicting total OSCE scores from global ratings using linear regression, and calculating the cut score by substituting the score of borderline candidates (2) into the regression equation for each OSCE. Both methods established higher standards than an arbitrary 50 per cent criterion. There was also a high degree of concordance between methods. Establishing conceptual standards on OSCEs requires ongoing consideration of appropriate methods and research modelling the effects on cut scores of applying different techniques.

Key words: Objective Structured Clinical Examinations, Standard setting, Assessment, Borderline Regression, Borderline Groups

	ARTICLE TOOLS
	Abstract
	PDF Fulltext
	Print this Article
	How to cite this article
	Citation Tools
	Related Records
	Articles by Katharine Jane Reid Articles by Agnes Dodds
	on Google
	on Google Scholar
	Article Statistics
	Viewed: 3319 Downloaded: 782 Cited: 1

REFERENCES

1. Dauphinee W, Blackmore D, Smee S, Rothman A, Reznick R. Using the judgments of physician examiners in setting the standards for a national multi-center high stakes OSCE. Advances in Health Sciences Education 1997;2(3):201-11. [DOI via Crossref] [Pubmed]

2. Ben-David M. AMEE Guide No. 18: Standard setting in student assessment. Medical Teacher 2000;22(2):120-30. [DOI via Crossref]

3. Pell G, Roberts T. Setting standards for student assessment. International Journal of Research & Method in Education 2006, 29(1):91-103. [DOI via Crossref]

4. Norcini J. Setting standards on educational tests. Medical Education 2003;37(5):464-69. [DOI via Crossref] [Pubmed]

5. Talente G, Haist S, Wilson J. A model for setting performance standards for standardized patient examinations. Evaluation & the Health Professions 2003;26(4):427. [DOI via Crossref] [Pubmed]

6. Barman A. Standard setting in student assessment: Is a defensible method yet to come? AnnAcad Med Singapore. 2008;37(11):957-63. [Pubmed]

7. Dwyer C. Cut scores and testing: Statistics, judgment, truth, and error. Psychological Assessment 1996;8(4):360-62. [DOI via Crossref]

8. Humphrey-Murto S, MacFadyen J. Standard setting: a comparison of case-author and modified borderline-group methods in a small-scale OSCE. Academic Medicine 2002;77(7):729. [DOI via Crossref]

9. Smee S, Blackmore D. Setting standards for an objective structured clinical examination: the borderline group method gains ground on Angoff. Medical education 2001;35(11):1009-10. [DOI via Crossref]

10. Wilkinson T, Newble D, Frampton C. Standard setting in an objective structured clinical examination: use of global ratings of borderline performance to determine the passing score. Medical Education 2001;35(11):1043-49. [DOI via Crossref] [Pubmed]

11. Kramer A, Muijtjens A, Jansen K, DÃ¼sman H, Tan L, van der Vleuten C. Comparison of a rational and an empirical standard setting procedure for an OSCE. Medical Education 2003;37(2):132-39. [DOI via Crossref] [Pubmed]

12. Wood T, Humphrey-Murto S, Norman G. Standard setting in a small scale OSCE: a comparison of the modified borderline-group method and the borderline regression method. Advances in Health Sciences Education 2006;11(2):115-22. [DOI via Crossref] [Pubmed]

13. Boursicot K. Setting standards in a professional higher education course: Defining the concept of the minimally competent student in performance-based assessment at the level of graduation from medical school. Higher Education Quarterly 2006;60(1):74-90. [DOI via Crossref]

14. Boulet J, De Champlain A, McKinley D. Setting defensible performance standards on OSCEs and standardized patient examinations. Medical Teacher 2003;25(3):245-49. [DOI via Crossref] [Pubmed]

This Article Cited By the following articles

Evaluation of Passing Scores in Semiotics: An Objective Structured Clinical Examination for Medical Students of Mashhad University of Medical Sciences, Mashhad, Iran, 2015 Strides Dev Med Educ 2017; 14(1): .	1

How to Cite this Article

Pubmed Style

Katharine Jane Reid, Agnes Dodds. Comparing the borderline group and borderline regression approaches to setting Objective Structured Clinical Examination cut scores. J Contemp Med Edu. 2014; 2(1): 8-12. doi:10.5455/jcme.20130921013523

Web Style

Katharine Jane Reid, Agnes Dodds. Comparing the borderline group and borderline regression approaches to setting Objective Structured Clinical Examination cut scores. http://www.jcmedu.org/?mno=32523 [Access: December 16, 2018]. doi:10.5455/jcme.20130921013523

AMA (American Medical Association) Style

Katharine Jane Reid, Agnes Dodds. Comparing the borderline group and borderline regression approaches to setting Objective Structured Clinical Examination cut scores. J Contemp Med Edu. 2014; 2(1): 8-12. doi:10.5455/jcme.20130921013523

Vancouver/ICMJE Style

Katharine Jane Reid, Agnes Dodds. Comparing the borderline group and borderline regression approaches to setting Objective Structured Clinical Examination cut scores. J Contemp Med Edu. (2014), [cited December 16, 2018]; 2(1): 8-12. doi:10.5455/jcme.20130921013523

Harvard Style

Katharine Jane Reid, Agnes Dodds (2014) Comparing the borderline group and borderline regression approaches to setting Objective Structured Clinical Examination cut scores. J Contemp Med Edu, 2 (1), 8-12. doi:10.5455/jcme.20130921013523

Turabian Style

Katharine Jane Reid, Agnes Dodds. 2014. Comparing the borderline group and borderline regression approaches to setting Objective Structured Clinical Examination cut scores. Journal of Contemporary Medical Education, 2 (1), 8-12. doi:10.5455/jcme.20130921013523

Chicago Style

Katharine Jane Reid, Agnes Dodds. "Comparing the borderline group and borderline regression approaches to setting Objective Structured Clinical Examination cut scores." Journal of Contemporary Medical Education 2 (2014), 8-12. doi:10.5455/jcme.20130921013523

MLA (The Modern Language Association) Style

APA (American Psychological Association) Style

Katharine Jane Reid, Agnes Dodds (2014) Comparing the borderline group and borderline regression approaches to setting Objective Structured Clinical Examination cut scores. Journal of Contemporary Medical Education, 2 (1), 8-12. doi:10.5455/jcme.20130921013523

Most Viewed Articles

The impact of gender and English language on the academic performance of students: An experience from new Saudi medical school
Najwa Al-Mously, Raneem Salem, Nasser Al-Hamdan
J Contemp Med Edu. 2013; 1(3): 170-176
» Abstract & References » doi: 10.5455/jcme.20130226121358

Oral medicine and radiology- the Indian scenario
Shishir Ram Shetty, Mansib M Shaik, Subhas G Babu
J Contemp Med Edu. 2013; 1(1): 59-61
» Abstract & References » doi: 10.5455/jcme.20121220032624

Non scholae sed vitae discimus (Not for school but for life we learn): Thoughts on the traditional lecture in medical education
Thomas Efferth
J Contemp Med Edu. 2013; 1(2): 69-72
» Abstract & References » doi: 10.5455/jcme.20130226121738

Knowledge, attitude & practices of medical students and teachers towards clinical research in a tertiary care hospital in Mumbai – cross sectional survey
Dinesh K Dhodi, Karan B Thakkar, Gauri Billa, Akash A Khobragade, Shyamal R Sinha, Sadiq B Patel
J Contemp Med Edu. 2013; 1(4): 238-244
» Abstract & References » doi: 10.5455/jcme.20130608045519

The relationship between spirituality and burnout among medical students
Amy Wachholtz, MaiLan Rogoff
J Contemp Med Edu. 2013; 1(2): 83-91
» Abstract & References » doi: 10.5455/jcme.20130104060612

The use of mind maps as support in medical education
Virgílio Vasconcelos Vilela, Lilian Carla Pereira Barbosa, Ana Luisa Miranda-Vilela, Leopoldo Luiz Santos Neto
J Contemp Med Edu. 2013; 1(4): 199-206
» Abstract & References » doi: 10.5455/jcme.20130407082647

Five-year trend of competitiveness and knowledge-gaining attitude of university students; Evaluation based on an event of continuing health sciences education
Fujio Takayama, Yoshiko Amikura, Sudhakar John, Vidyasagar Devaprasad Dedeepiya, Rajappa Senthilkumar, Govindan Venkataramani, Kottoorathu Mammen Cherian, Hajib Naraharirao Madhavan, David W Green, Masahiko Matsumoto, Shoji Suzuki, Masaru Iwasaki, Senthilkumar Preethy , Samuel JK Abraham
J Contemp Med Edu. 2013; 1(2): 92-99
» Abstract & References » doi: 10.5455/jcme.20130115055107

Biochemistry handouts covering all lecture topics as study guide to focus during exam preparation in first year medical undergraduates in India
Mamata Vishnu Hegde, Sarita Vijay Agrawal, Parduman Singh, Samir Anil Singru
J Contemp Med Edu. 2013; 1(1): 33-39
» Abstract & References » doi: 10.5455/jcme.20121113112005

Use of non-standard abbreviations and symbols in medical prescriptions: implications for patients' health
Tamayo Rodríguez M, González Valverde FM, Pérez-Fernández P, Madrigal de Torres M, Pérez Cárceles MD, Osuna Carrillo de Albornoz E
J Contemp Med Edu. 2013; 1(1): 54-58
» Abstract & References » doi: 10.5455/jcme.20121113112507

Comparing the borderline group and borderline regression approaches to setting Objective Structured Clinical Examination cut scores
Katharine Jane Reid, Agnes Dodds
J Contemp Med Edu. 2014; 2(1): 8-12
» Abstract & References » doi: 10.5455/jcme.20130921013523

Most Downloaded

Assessment of Emotional Intelligence in Pediatric and Med-Peds Residents
Ramzan Shahid, Jerold Stirling, William Adams
J Contemp Med Edu. 2016; 4(4): 153-158
» Abstract » doi: 10.5455/jcme.20170116015415

Factors affecting performance of first year medical students in Bhopal, India
Shubho Subrata Biswas, Vaishali Jain
J Contemp Med Edu. 2013; 1(3): 192-197
» Abstract & References » doi: 10.5455/jcme.20130409044053

Most Cited Articles

Building a theoretically grounded model to support the design of effective non-technical skills training in healthcare: The SECTORS model
Morris Gordon
J Contemp Med Edu. 2013; 1(2): 77-82
» Abstract & References » doi: 10.5455/jcme.20121217125557
Cited : 6 times [Click to see citing articles]

Perceptions of Personalized Medicine in an Academic Health System: Educational Findings
Allison Vorderstrasse, Sara Huston Katsanis, Mollie A Minear, Nancy Yang, Tejinder Rakhra-Burris, Jason W Reeves, Robert Cook-Deegan, Geoffrey S Ginsburg, Leigh Ann Simmons
J Contemp Med Edu. 2015; 3(1): 14-19
» Abstract & References » doi: 10.5455/jcme.20150408050414
Cited : 5 times [Click to see citing articles]

Health literacy practices of physicians and patient care personnel in a hospital setting
Kadriye O. Lewis, Joan E Morgan, Lihshing Leigh Wang, Kathleen Calderon, Jennifer Rammel, Murat Ozer
J Contemp Med Edu. 2014; 2(4): 204-212
» Abstract & References » doi: 10.5455/jcme.20141122081418
Cited : 5 times [Click to see citing articles]

Correlation of high school exam grades with study success at a German medical school
Ozan Yüksel Tektas, Cornelia Fiessler, Andreas Mayr, Winfried Neuhuber, Friedrich Paulsen
J Contemp Med Edu. 2013; 1(3): 157-162
» Abstract & References » doi: 10.5455/jcme.20130311114703
Cited : 3 times [Click to see citing articles]

Why a teacher centered medical school curriculum may result in a poor educational environment?
Eiad Abdelmohsen AlFaris, Naghma Naeem , Sean McAleer, Riaz Qureshi, Cees van der Vleuten, Farhana Irfan , Amr Jamal
J Contemp Med Edu. 2014; 2(2): 85-90
» Abstract & References » doi: 10.5455/jcme.20140620013233
Cited : 3 times [Click to see citing articles]

Teaching behaviour change skills to undergraduate medical students
Ian Grey, Bayan Al Saihati
J Contemp Med Edu. 2013; 1(4): 231-237
» Abstract & References » doi: 10.5455/jcme.20131105073307
Cited : 3 times [Click to see citing articles]

Medical students' perception on anatomy knowledge relevance and retention during clerkship
Nihal Mohamed Nabil, Najwa Al-Mously, Shahad AlWathnani, Asrar Abduldaiem, Hadeel Al-Issa
J Contemp Med Edu. 2014; 2(3): 147-151
» Abstract & References » doi: 10.5455/jcme.20140928035119
Cited : 3 times [Click to see citing articles]

Virtual Mrs K: The learners’ expectations and attitudes towards a virtual patient system in transcultural psychiatry
Ioannis Pantziaras, Uno Fors, Solvig Ekblad
J Contemp Med Edu. 2014; 2(2): 109-115
» Abstract & References » doi: 10.5455/jcme.20140627042240
Cited : 2 times [Click to see citing articles]

Contact Information

Your comments are very important to us

How to cite this article

This is an open access journal which means that all content is freely available without charge to the user or his/her institution. Users are allowed to read, download, copy, distribute, print, search, or link to the full texts of the articles in this journal without asking prior permission from the publisher or the author. This is in accordance with the Budapest Open Access Initiative (BOAI) definition of open access. The articles in Journal of Contemporary Medical Education are open access articles licensed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc-sa/3.0/) which permits unrestricted, non-commercial use, distribution and reproduction in any medium, provided the work is properly cited.

Copyright © 2018 Journal of Contemporary Medical Education All Rights Reserved. Subject to change without notice from or liability to Journal of Contemporary Medical Education. For best results, please use Internet Explorer or Google Chrome	Contact Information Your comments are very important to us We welcome your ideas, suggestions, comments, or questions. To reach Editorial Board please use one of the methods provided below. Call us at (302) 355 0333. Our office hours are Monday - Friday, 8 AM to 5 PM EST. Or e-mail us at info@ejmanager.com We will respond within 48 to 72 hours. Change of address or personal information? Please visit your account at www.ejmanager.com to update your information.