Examination scoring
Overview
How are OSCE stations scored?
How is the therapeutics component scored?
How is the total NAC OSCE score determined?
How do I interpret my total NAC OSCE score?
Overview
The National Assessment Collaboration (NAC) Objective Structured Clinical Examination (OSCE) is scored independently of any other Medical Council of Canada (MCC) examination. The examination material on the NAC OSCE is presented and scored at the level of a graduating medical student from a Canadian medical school.
Objectivity of the NAC OSCE is achieved through the use of standardized guidelines for the administration of the examination, the training of physician examiners and of standardized patients, and the use of predetermined scoring instruments. OSCE scores are awarded to a candidate by physician examiners on the basis of the candidate’s performance at each station. Each station is worth the same as every other station.
To pass the examination, a candidate must achieve an overall score that is set at the standard of a graduating student from a Canadian medical school. In awarding the final standing on the examination, the NAC Central Coordinating Committee also considers any observations made by the physician examiner at each of the stations with regards to the candidate’s ability to demonstrate the ethical and professional behaviour appropriate for a physician entering postgraduate training.
How are OSCE stations scored?
Physician examiners observe candidate interactions with the standardized patients and complete ratings on up to seven of nine possible competencies relevant to the presenting problem and clinical task. These competencies are history taking, physical examination, organization skills, communication skills, language fluency, diagnosis, data interpretation, investigations and management. A candidate could be rated on any combination of these competencies on a given station.
A candidate’s total score for each station is the average of all his or her competency ratings. A candidate’s total score on the OSCE component is the average of the total scores from the 12 stations.
How is the therapeutics component scored?
For the therapeutics component, a minimum of two physician examiners per candidate will review the answers and make a global rating of the quality of the candidate’s answers. The candidate’s final score on the therapeutics component will be the average of the scores for each question.
How is the total NAC OSCE score determined?
The candidate’s total examination score will be determined by combining the scores on the OSCE component with the scores on the therapeutics component. The OSCE score will contribute 75 per cent of the total score and the therapeutics score will contribute 25 per cent of the total score. The pass mark for the examination is any total score equal to or higher than the mark that corresponds to someone who is at the level of a graduating student from a Canadian medical school.
How do I interpret my NAC OSCE total score?
For reporting purposes, the NAC total examination scores are reported on a scale with a distribution ranging from 0 to 100 with a fixed passing mark of 65. A candidate’s pass/fail standing is based on where his or her score falls in relation to the pass/fail mark established for the examination (a graduating student from a Canadian medical school). A candidate’s performance is judged in relation to the pass score for the examination and not judged on how well other individuals have performed on the examination.
In addition to the total score, which is reported in the Statement of Results, candidates will be provided with supplemental feedback on their examination performance. This information will consist of a graphical display of the candidate’s performance on the nine competencies and therapeutics. The report will also provide the candidate with a list of the stations for which he or she received a station score that is less than would be expected of a graduating medical student from a Canadian medical school.
The NAC provides an example of a Statement of Results and a supplemental feedback report.