Clinical Radiology
Volume 65, Issue 4 , Pages 325-332 , April 2010

Workplace-based assessment in radiology—where to now?

  • K. Augustine

      Affiliations

    • Department of Radiology, Southmead Hospital, North Bristol NHS Trust, Bristol BS10 5NB, UK
  • ,
  • P. McCoubrie

      Affiliations

    • Department of Radiology, Southmead Hospital, North Bristol NHS Trust, Bristol BS10 5NB, UK
    • Corresponding Author InformationGuarantor and correspondent. Tel.: +44 1173236341; fax: +44 1173235122.
  • ,
  • J.R. Wilkinson

      Affiliations

    • Department of Cardiology, St Bartholomew's Hospital, London, UK
  • ,
  • L. McKnight

      Affiliations

    • Department of Radiology, Morriston Hospital, Swansea, UK

Received 4 June 2009 ,Revised 18 November 2009 ,Accepted 1 December 2009.

References 

  1. Postgraduate Medical Education and Training Board . Standards for curricula and assessment systems. London: Postgraduate Medical Education and Training Board; 2008;
  2. Davies H, Archer J, Southgate L, et al. Initial evaluation of the first year of the Foundation Assessment Programme. Med Educ. 2009;43:74–81
  3. Wilkinson JR, Crossley JGM, Wragg A, et al. Implementing workplace-based assessment across the medical specialties in the United Kingdom. Med Educ. 2008;42:364–373
  4. Jolly BC, Ayers B, Macdonald MM, et al. The reproducibility of assessing radiological reporting: studies from the development of the General Medical Council's Performance Procedures. Med Educ. 2001;35:36–44
  5. Campbell JL, Richards SH, Dickens A, et al. Assessing the professional performance of UK doctors: an evaluation of the utility of the General Medical Council patient and colleague questionnaires. Qual Saf Health Care. 2008;17:187–193
  6. Burkill GJC. Work-based assessment for trainees—more than just a few new tools. Clin Radiol. 2008;63:12–14
  7. Tweed M, Miola J. Legal vulnerability of assessment tools. Med Teach. 2001;23:312–314
  8. Norcini JJ, McKinley DW. Assessment methods in medical education. Teach Teacher Educ. 2007;23:239–250
  9. van der Vleuten CPM, Schuwirth LWT. Assessing professional competence: from methods to programmes. Med Educ. 2005;39:309–317
  10. Norcini J, Burch V. Workplace-based assessment as an educational tool: AMEE Guide No. 31. Med Teach. 2007;29:855–871
  11. Rethans JJ, Norcini JJ, Baron-Maldonado M, et al. The relationship between competence and performance: implications for assessing practice performance. Med Educ. 2002;36:901–909
  12. Miller GE. The assessment of clinical skills competence performance. Acad Med. 1990;65:S63–S67
  13. Wilkinson J, Wade W. New methods of performance assessment for trainees. RCPath Bull. 2005;132:12–15
  14. Downing SM. Reliability: on the reproducibility of assessment data. Med Educ. 2004;38:1006–1012
  15. McCoubrie P. Improving the fairness of multiple-choice questions: a literature review. Med Teach. 2004;26:709–712
  16. Wass V, Van der Vleuten C, Shatzer J, et al. Assessment of clinical competence. Lancet. 2001;357:945–949
  17. Fish D, Coles C. Medical education: developing a curriculum for practice. Maidenhead: OUP; 2005;
  18. Schuwirth LWT, Southgate L, Page GG, et al. When enough is enough: a conceptual basis for fair and defensible practice performance assessment. Med Educ. 2002;36:925–930
  19. Davies H, Howells R. How to assess your specialist registrar. Arch Dis Child. 2004;89:1089–1093
  20. Epstein RM. Medical education—assessment in medical education. New Engl J Med. 2007;356:387–396
  21. Harding J, McCoubrie P. Competency-based training versus traditional experience in radiology; how best to educate the radiologists of the future?. Clin Radiol. 2009;64:569–573
  22. Lew SR, Page GG, Schuwirth LWT, et al. Procedures for establishing defensible programmes for assessing practice performance. Med Educ. 2002;36:936–941
  23. Rowley DI. The surgeon’s job: how should we assess the trainee?. J Roy Soc Med. 2004;97:363–365
  24. Evans R, Elwyn G, Edwards A. Review of instruments for peer assessment of physicians. BMJ. 2004;328:1240–1243
  25. Ramsey PG, Wenrich MD, Carline JD, et al. Use of peer ratings to evaluate physician performance. JAMA. 1993;269:1655–1660
  26. Archer JC, Norcini J, Davies HA. Use of SPRAT for peer review of paediatricians in training. BMJ. 2005;330:1251–1253
  27. Archer J, Norcini J, Southgate L, et al. Mini-PAT (peer assessment tool): a valid component of a national assessment programme in the UK?. Adv Health Sci Educ. 2008;13:181–192
  28. Davies H, Archer J, Bateman A, et al. Specialty-specific multi-source feedback: assuring validity, informing training. Med Educ. 2008;42:1014–1020
  29. Murphy D, Bruce D, Mercer S, et al. The reliability of workplace-based assessment in postgraduate medical education and training: a national evaluation in general practice in the United Kingdom. Adv Health Sci Educ. 2009;14:219–232
  30. Crossley JGM, Howe A, Newble D, et al. Sheffield Assessment Instrument for Letters (SAIL): performance assessment using outpatient letters. Med Educ. 2001;35:1115–1124
  31. Jennett P, Affleck L. Chart audit and chart stimulated recall as methods of needs assessment in continuing professional health education. J Contin Educ Health Prof. 1998;18:163–171
  32. Norcini JJ. Current perspectives in assessment: the assessment of performance at work. Med Educ. 2005;39:880–889
  33. Wallis AG, Isaac A, McCoubrie P. The Bristol Radiology Report Assessment tool (BRAAT): developing a workplace based assessment tool for radiology reporting skills. BJR Congress Series. 2009;106
  34. Driessen E. Are learning portfolios worth the effort? Yes. BMJ. 2008;337:a513
  35. Brown N, Doshi M. Assessing professional and clinical competence: the way forward. Adv Psychiatr Treat. 2006;12:81–89
  36. Norman G. Are learning portfolios worth the effort? No. BMJ. 2008;337:a514
  37. Pitts J, Coles C, Thomas P. Educational portfolios in the assessment of general practice trainers: reliability of assessors. Med Educ. 1999;33:515–520
  38. The Royal College of Radiologists . Standards for radiology discrepancy meetings. London: The Royal College of Radiologists; 2007;
  39. Melvin C, Bodley R, Booth A, et al. Managing errors in radiology: a working model—a reply. Clin Radiol. 2005;60:275–276
  40. McKay J, Murphy DJ, Bowie P, et al. Development and testing of an assessment instrument for the formative peer review of significant event analyses. Qual Saf Health Care. 2007;16:150–153
  41. McCreadie G, Oliver TB. Eight CT lessons that we learned the hard way: an analysis of current patterns of radiological error and discrepancy with particular emphasis on CT. Clin Radiol. 2009;64:491–499
  42. Adam JE. Commentary on eight CT lessons that we learned the hard way: an analysis of current patterns of radiological error and discrepancy with particular emphasis on CT. Clin Radiol. 2009;64:500–501
  43. ten Cate O, Scheele F. Viewpoint: competency-based postgraduate training: can we bridge the gap between theory and clinical practice?. Acad Med. 2007;82:542–547
  44. Finucane PM, Barron SR, Davies HA, et al. Towards an acceptance of performance assessment. Med Educ. 2002;36:959–964
  45. Wragg A, Wade W, Fuller G, et al. Assessing the performance of specialist registrars. Clin Med. 2003;3:131–134
  46. Wood J, Collins J, Burnside ES, et al. Patient, faculty, and self-assessment of radiology resident performance: a 360-degree method of measuring professionalism and interpersonal/communication skills. Acad Radiol. 2004;11:931–939
  47. Williamson KB, Steele JL, Gunderman RB, et al. Assessing radiology resident reporting skills. Radiology. 2002;225:719–722

PII: S0009-9260(10)00019-X

doi: 10.1016/j.crad.2009.12.004

Clinical Radiology
Volume 65, Issue 4 , Pages 325-332 , April 2010