DDMFR Part B - scoring system
1 Context
The DDMFR Part B Examination consists of three components: rapid reporting, long case reporting and an oral examination (this part consists of two oral sessions from which scores are combined to give one score for the purposes of results presentation). Each component must be passed in order to achieve overall success in the examination.
2 Preparation
In advance of each examination sitting, the examiners meet to agree marking schemes for the sets to be used in the reporting and rapid reporting sessions. All examiners will have prepared their images for the oral assessment in advance, with guidelines on the features and scoring.
3 Scoring
3.1 Rapid Reporting Component
Candidates report on 30 images and have the opportunity to attain two marks per image, so a maximum of 60 marks. Candidate responses are double marked for QA purposes with any adjudication required provided by the Senior Examiner.
Marks are allocated as shown below (dependent upon the type of image):
| Image type | Candidate response | Mark |
|---|---|---|
| Normal Image | Correctly classified | +2 |
| Incorrectly classified (appropriate false positive) | +2 | |
| No answer given | 0 | |
| Abnormal Image | Correctly classified and correctly identified | +2 |
| Correctly classified but incorrectly identified | 0 | |
| Incorrectly classified (false negative) | 0 | |
| No answer given | 0 |
The standard for success for the rapid reporting component is determined at each sitting based on the difficulty of the questions (using a criterion-referenced standard setting technique) and so may vary between sittings and sets of images.
3.2 Long Case Reporting Component
Candidates report on six cases and have the opportunity to attain a maximum of 8 marks for each case, so a maximum of 48 marks may be awarded. Candidate responses are double marked for QA
purposes with any adjudication required provided by the Senior Examiner.
Marks are allocated to each case as shown below:
| Candidate Response | Mark |
|---|---|
| No answer offered | 3 |
| Fail: : significant observations missed; correct diagnosis not made | 4 |
| Borderline: appropriate if there are two main diagnoses in the case but only one is mentioned; some observations missed | 5 |
| Pass: most observations made correctly; principal diagnoses correct | 6 |
| Good Pass: additional relevant material included in a "pass" grade answer | 7 |
| Excellent: a perfect answer, clear and confident | 8 |
Half marks may be awarded.
Following the marking exercise each candidate will have a score between 18 - 48. An overall mark of 36 is required to pass the long case reporting component.
3.3 Oral Component
Candidates are scored on images shown by two pairs of examiners and have the opportunity to attain a maximum 8 marks from each pair.
Marks are allocated from each pair as shown below:
| Performance description | Comments | Score |
|---|---|---|
| Very poor answer | Key findings missed even with help; Wrong or dangerous diagnosis | 4 |
| Poor answer | Slow to spot abnormality; Poor differential diagnosis; Needed help to get correct answer | 5 |
| Principal findings seen | Some abnormalities seen with help; Principal diagnosis correct; Limited differential | 6 |
| Good answer | Key findings spotted quickly; Correct deductions made and correct diagnosis; Good differential offered | 7 |
| Excellent answer – all findings seen | Correct diagnosis and deductions; No errors; Succinct/accurate report; Excellent differential | 8 |
Compensation in the oral component is permissible. Candidates are required to score an average of 6 marks across both oral examinations to pass. For example, a score of 5 from one pair of examiners and a score of 7 from the other pair would constitute an overall pass for this component of the examination.
3.4 Overall Result
Each of the three components is independently marked, with the three sets of marks considered as a whole to generate a pass or fail. In order to pass the examination, each of the three components (rapid reporting, long case reporting and oral component) must be passed. Failure in one component cannot be offset by good performance in another.