Medical Council of Canada

Research reports

Research reports

The Medical Council of Canada’s internal researchers often publish technical reports, collaborate with external researchers on technical reports, or fund research into specific directed areas. Below is the list of technical reports arising from these types of studies.

Most recent

Roy, Marguerite PhD; Wood, Timothy J. PhD; Blouin, Danielle MD, MHPE, PhD; Eva, Kevin W. PhD. (2020). The Relationship Between Accreditation Cycle and Licensing Examination Scores. A National Look.

Read more

Bahry, L., Hambleton, R.K., Gotzmann, A., De Champlain, A. & Roy, M. (2012). National Assessment Collaboration Standard Setting Study Report.

Bartman, I., Boulet, J.R., Qin, S., Bowmer, M.I. (2020). Canadians studying medicine abroad and their journey to secure postgraduate training in Canada or the United States.

Bartman, I., Roy, M. & Smee, S. (2011). Catching the Hawks and Doves: A Method for Identifying Extreme Examiners on Objective Structured Clinical Examinations.

Bartman, I., Smee, S.M. & Roy, M. (2013). A method for identifying extreme OSCE examiners. Clinical Teacher, 10(1), 27-31.

Bartman, I., Touchie, C., Condon, K. (2018).  Testing Accommodations: Environmental Scan Report.

Breithaupt, K. (2011). Medical Licensure Testing: White Paper for the Assessment Review Task Force of the Medical Council of Canada.

Breithaupt, K. & Hare D.R. (2011). Test Assembly and Delivery Models for a National Examination of Medical Knowledge: Optimal Form Quality and Item Usage from a Modular Design.

De Champlain, A.F., Boulais, A.-P. (2011). Assessing the Underlying Structure of the Medical Council of Canada’s Qualifying Examination Part I Clinical Decision Making Cases: A Comparison of Exploratory and Confirmatory Factor Analysis Models.

De Champlain, A.F., Boulais, A.-P. & Dallas, A. (2012). Calibrating the Medical Council of Canada’s Qualifying Part I Examination Using an Integrated Item Response Theory Framework: A Comparison of Models and Calibration Designs.

De Champlain, A., Gotzmann, A., Qin, S. (2016). Assessing the Reliability of Performance Assessing Scores: Some Considerations in Selecting an Appropriate Framework.

De Champlain, A., Streefkerk, C., Tian, F., Roy, M., Qin, S., Brailovsky, C., Rainsberry, P., Allen, T., Slade, S. (2014). Predicting Family Medicine Specialty Certification Status Using Standardized Measures for a Sample of International Medical Graduates Engaged in a Practice-Ready Assessment Pathway to Provisional Licensure.

Eva, K.W., Bordage, G., Campbell, C., Galbraith, R., Ginsburg, S., Holmboe, E., Regehr, G. (2015). Towards a program of assessment for health professionals: from training into practice. Adv Health Sci Educ Theory Pract.

Gierl, M. & Lai, H. (2011). Using Statistical Measures of Differential Item Functioning to Identify Items that Elicit Group Differences on the Medical Council of Canada Qualifying Exam Part I.

Gierl, M. & Lai, H. (2012). Methods for Creating and Evaluating the Item Model Structure Used In Automatic Item Generation.

Gierl, M., Lai, H., & Li, J. (2011). Evaluating the Performance of CATSIB in a Multi-Stage Adaptive Testing Environment.

Gierl, M.J., Lai, H., Pugh, D., Touchie, C., Boulais, A.P., De Champlain, A.F. (2016). Evaluating the Psychometric Characteristics of Generated Multiple-Choice Test Items.

Gong, J. (2012). Detection of Differential Test Functioning (DTF) and Differential Item Functioning (DIF) in MCCQE Part II Using Logistic Models.

Gotzmann, A., De Champlain, A., Roy., M., Brailovsky, C., Smee, S., de Vries, I. (2014). Setting a Common Performance Standard for Two Candidate Groups across Different Medical Licensing Examination Forms: A Comparison of Methods.

Gotzmann, A., De Champlain, A., Homayra, F., Fotheringham, Al, de Vries, I., Forgie, M., Pugh, D. (2016). Cheating in OSCEs: The impact of Simulated Security Breaches on OSCE Performance.

Gotzmann, A., De Champlain, A., Touchie, C., Boulet, J. (2013) National Survey of the Physicians, Pharmacists, Nurses, and Public in Canada: 2013.

Halman, S., Dudek, N., Wood, T.J., Pugh, D., Touchie, C., McAleer, S., Humphrey-Murto, S. (2016). Direct Observation of Clinical Skills Feedback Scale: Development and Validity Evidence.

Hambleton, R.K., De Champlain, A. (2013). Recommending a Passing Score on the National Assessment Collaboration (NAC) Examination: Procedures and Results.

Lai, H. & Gierl, M. (2012). Design Principles Required for Skills-Based Calibrated Item Generation.

Lai, H., Gierl, M.J., Touchie, C., Pugh, D., Boulais, A.P., De Champlain, A.F. (2016) Using Automatic Item Generation to Improve the Quality of MCQ Distractors.

Latifi, S., Gierl, M.J., Boulais, A.P., De Champlain, A.F. (2016). Using Automated Scoring to Evaluate Written Responses in English and French on a High-Stakes Clinical Competency Examination.

Li, J., Gierl, M.J., Lai, H. & Roussos, L. A Modified CATSIB Procedure for Detecting Differential Item Function on Computer-Based Tests.

Lockyer, J., Carracio, C., Chan, M.K., Hart, D., Smee, S., Touchie, C., Holmboe, E., Frank, J.F. for the international CBME Collaborators. (2017). Core principles of assessment in competency-based medical education.

Roy, M. & Streefkerk, C. (2016). Recommendations for standardization of the MCC 360 Scale Report.

Roy, M., Wojcik, J., Bartman, Il, Smee, S. (2016). Augmenting Physician Examiner (PE) Scoring in OSCEs: A Pilot for Including the Standardized Patient.

Sandilands, D., Gotzmann, A., Roy, M., Zumbo, B. D., De Champlain, A. F. (2014). Weighting checklist items and station components on a large-scale OSCE: Is it worth the effort? Medical Teacher, 36(7): 585-590.

Sebok, S.S. (2015). Examiners and content and site: Oh My! A national organization.

Soto, A.C. Practice Analysis Studies: Literature Review of Definitions, Concepts, Features, and Methodologies.

Tamblyn, R., Abrahamowicz, M., Bartlett, G., Winslade, N., Jacques, A., Klass, D., Wenghofer, E., Smee, S., Dauphinee, D., Blackmore, D., Bartman, I., Buckeridge, D. & Hanley, J. (2009). The Quebec-Ontario Follow-up Study of the Association between Scores Achieved on the MCCQE Part II Examination and Performance in Clinical Practice.

Taylor, D.R., Park, Y.S., Egan, R., Chan, M.-K., Karpinski, J., Touchie, C., Snell, L.S., Tekian, A. (October 2017). EQual, a Novel Rubric to Reliably Evaluate Entrustable Professional Activities for Quality and Structure.

Touchie, C. (2013). Report of the Incidence and Prevalence of Diseases and Other Health Related Issues in Canada: A Study for the MCC Blueprint Project.

Touchie C., Streefkerk C. (2014). Blueprint Project – Qualifying Examinations Blueprint & Content Specifications.

Touchie, C., ten Cate O. (2016). The promise, perils, problems and progress of competency-based education. Medical Education Journal; 50 (1):93-100.

Wood, T.J., Chan, J., Humphrey-Murto, S., Pugh, D., Touchie, C. (2016). The influences of first impression ratings in an OSCE station.

Wood, T.J., Pugh, D., Touchie, C. et al. Adv in Health Sci Educ (2018). Can physician examiners overcome their first impression when examinee performance changes?

Wood, T.J., Roy, M., McConnell, M.M. & Breithaupt, K. (2011). Evidence for the Validity of a Clinical Skill Assessment.