Archer, J. et al. (2008) ‘mini-PAT (Peer Assessment Tool): A Valid Component of a National Assessment Programme in the UK?’, Advances in Health Sciences Education, 13(2), pp. 181–192. Available at: https://doi.org/10.1007/s10459-006-9033-3.
Archer, J.C. (2005) ‘Use of SPRAT for peer review of paediatricians in training’, BMJ, 330(7502), pp. 1251–1253. Available at: https://doi.org/10.1136/bmj.38447.610451.8F.
Association for the Study of Medical Education (2014) Understanding medical education: evidence, theory and practice. Second edition. Edited by T. Swanwick. Chichester, West Sussex, UK: Wiley Blackwell. Available at: http://lib.myilibrary.com/ProductDetail.aspx?id=543123&entityid=https://idp.warwick.ac.uk/idp/shibboleth.
Bandaranayake, R.C. (2008) ‘Setting and maintaining standards in multiple choice examinations: AMEE Guide No. 37’, Medical Teacher, 30(9–10), pp. 836–845. Available at: https://doi.org/10.1080/01421590802402247.
Black, H. D., Devine, Marion, and Scottish Council for Research in Education (1986) Assessment purposes: a study of the relationship between diagnostic assessment and summative assessment for certification. Edinburgh: Scottish Council for Research in Education.
Bloom, Benjamin S. (1956) Taxonomy of educational objectives: the classification of educational goals, Handbook 1: Cognitive domain. London: Longman Group Ltd.
du Boulay, C. (2000) ‘From CME to CPD: getting better at getting better?’, BMJ, 320(7232), pp. 393–394. Available at: https://doi.org/10.1136/bmj.320.7232.393.
Breakwell, Glynis M., Smith, Jonathan A., and Wright, Daniel B. (2012) Research methods in psychology. 4th ed. Los Angeles: SAGE.
Brian Jolly (1999) ‘Clinical logbooks: recording clinical experiences may not be enough’, Medical Education, 33(2), pp. 86–88. Available at: https://doi.org/10.1046/j.1365-2923.1999.00386.x.
Brigden, D. (1999) ‘Constructing a learning portfolio’, BMJ, 319(7201), pp. 2a–2a. Available at: https://doi.org/10.1136/bmj.319.7201.2a.
Bullock, A.D. et al. (2009) ‘How ratings vary by staff group in multi-source feedback assessment of junior doctors’, Medical Education, 43(6), pp. 516–520. Available at: https://doi.org/10.1111/j.1365-2923.2009.03333.x.
Campbell, L.M., Howie, J.G. and Murray, T.S. (1995) ‘Use of videotaped consultations in summative assessment of trainees in general practice’, British Journal of General Practice, 45(392), pp. 137–141. Available at: http://0-bjgp.org.pugwash.lib.warwick.ac.uk/content/45/392/137.
Cangelosi, J.S. (no date) Designing tests for evaluating student achievement. New York: Longman.
Challis, M. (1999) ‘AMEE Medical Education Guide No.11 (revised): Portfolio-based learning and assessment in medical education’, Medical Teacher, 21(4), pp. 370–386. Available at: https://doi.org/10.1080/01421599979310.
Challis, M. (2001) ‘Portfolios and assessment: meeting the challenge’, Medical Teacher, 23(5), pp. 437–440. Available at: https://doi.org/10.1080/01421590120075643.
Cleland, J.A. et al. (2008) ‘Is it me or is it them? Factors that influence the passing of underperforming students’, Medical Education, 42(8), pp. 800–809. Available at: https://doi.org/10.1111/j.1365-2923.2008.03113.x.
Cohen-Schotanus, J. and van der Vleuten, C.P.M. (2010) ‘A standard setting method with the best performing students as a point of reference: Practical and affordable’, Medical Teacher, 32(2), pp. 154–160. Available at: https://doi.org/10.3109/01421590903196979.
Cox, M., Irby, D.M. and Epstein, R.M. (2007) ‘Assessment in Medical Education’, New England Journal of Medicine, 356(4), pp. 387–396. Available at: https://doi.org/10.1056/NEJMra054784.
Cronbach, L.J. and Meehl, P.E. (1955) ‘Construct validity in psychological tests.’, Psychological Bulletin, 52(4), pp. 281–302. Available at: https://doi.org/10.1037/h0040957.
Crossley, J., Eiser, C. and Davies, H.A. (2005) ‘Children and their parents assessing the doctor-patient interaction: a rating system for doctors’ communication skills’, Medical Education, 39(8), pp. 820–828. Available at: https://doi.org/10.1111/j.1365-2929.2005.02230.x.
Daelmans, H.E.M. et al. (2004) ‘Feasibility and reliability of an in-training assessment programme in an undergraduate clerkship’, Medical Education, 38(12), pp. 1270–1277. Available at: https://doi.org/10.1111/j.1365-2929.2004.02019.x.
David, M.F.B. et al. (2001) ‘AMEE Medical Education Guide No. 24: Portfolios as a method of student assessment’, Medical Teacher, 23(6), pp. 535–551. Available at: https://doi.org/10.1080/01421590120090952.
Davies, H. et al. (2008) ‘Specialty-specific multi-source feedback: assuring validity, informing training’, Medical Education, 42(10), pp. 1014–1020. Available at: https://doi.org/10.1111/j.1365-2923.2008.03162.x.
‘Developing and maintaining an assessment system’ (no date). Postgraduate Medical Education and Training Board. Available at: https://www.researchgate.net/publication/264405740_Developing_and_Maintaining_an_Assessment_System-a_PMETB_Guide_to_Good_Practice.
‘Does a student log provide a means to better structure clinical education?’ (1999) Medical Education, 33(2), pp. 89–94. Available at: https://doi.org/10.1046/j.1365-2923.1999.00285.x.
Dory, V., Gagnon, R. and Charlin, B. (2010) ‘Is case-specificity content-specificity? An analysis of data from extended-matching questions’, Advances in Health Sciences Education, 15(1), pp. 55–63. Available at: https://doi.org/10.1007/s10459-009-9169-z.
Downing, S.M. (2004) ‘Reliability: on the reproducibility of assessment data’, Medical Education, 38(9), pp. 1006–1012. Available at: https://doi.org/10.1111/j.1365-2929.2004.01932.x.
Downing, S.M. and Haladyna, T.M. (2004) ‘Validity threats: overcoming interference with proposed interpretations of assessment data’, Medical Education, 38(3), pp. 327–333. Available at: https://doi.org/10.1046/j.1365-2923.2004.01777.x.
Downing, S.M., Tekian, A. and Yudkowsky, R. (2006) ‘RESEARCH METHODOLOGY: Procedures for Establishing Defensible Absolute Passing Scores on Performance Examinations in Health Professions Education’, Teaching and Learning in Medicine, 18(1), pp. 50–57. Available at: https://doi.org/10.1207/s15328015tlm1801_11.
Driessen, E. et al. (2003) ‘Use of portfolios in early undergraduate medical training’, Medical Teacher, 25(1), pp. 18–23. Available at: https://doi.org/10.1080/0142159021000061378.
Driessen, E. et al. (2005) ‘The use of qualitative research criteria for portfolio assessment as an alternative to reliability evaluation: a case study’, Medical Education, 39(2), pp. 214–220. Available at: https://doi.org/10.1111/j.1365-2929.2004.02059.x.
Driessen, E.W. et al. (2006) ‘Validity of portfolio assessment: which qualities determine ratings?’, Medical Education, 40(9), pp. 862–866. Available at: https://doi.org/10.1111/j.1365-2929.2006.02550.x.
Driessen, E.W. et al. (2007) ‘Web- or paper-based portfolios: is there a difference?’, Medical Education, 41(11), pp. 1067–1073. Available at: https://doi.org/10.1111/j.1365-2923.2007.02859.x.
Epstein, R.M. (no date) ‘Assessment in Medical Education’, New England Journal of Medicine. Edited by M. Cox and D.M. Irby, 356(4), pp. 387–396. Available at: https://doi.org/10.1056/NEJMra054784.
Evans, R. (2004) ‘Review of instruments for peer assessment of physicians’, BMJ, 328(7450). Available at: https://doi.org/10.1136/bmj.328.7450.1240.
Farmer, Elizabeth A and Page, G. (2005) ‘A practical guide to assessing clinical decision-making skills using the key features approach’, Medical Education, 39(12), pp. 1188–1194. Available at: https://doi.org/10.1111/j.1365-2929.2005.02339.x.
Farmer, Elizabeth A. and Page, G. (2005) ‘A practical guide to assessing clinical decision-making skills using the key features approach’, Medical education, 39(12), pp. 1188–1194. Available at: https://doi.org/10.1111/j.1365-2929.2005.02339.x.
Freeman, Richard T. and Lewis, Roger (1998) Planning and implementing assessment. London: Kogan Page.
Friedman Ben-Davis, M. (2000) ‘AMEE Guide No. 18: Standard setting in student assessment’, Medical Teacher, 22(2), pp. 120–130. Available at: https://doi.org/10.1080/01421590078526.
G. Rasch (1980) Probabilistic models for some intelligence and attainment tests. Chicago: University of Chicago Press.
Gagnon, R. et al. (2006) ‘The Cognitive Validity of the Script Concordance Test: A Processing Time Study’, Teaching and Learning in Medicine, 18(1), pp. 22–27. Available at: https://doi.org/10.1207/s15328015tlm1801_6.
Govaerts, M.J.B. et al. (2007) ‘Broadening Perspectives on Clinical Performance Assessment: Rethinking the Nature of In-training Assessment’, Advances in Health Sciences Education, 12(2), pp. 239–260. Available at: https://doi.org/10.1007/s10459-006-9043-1.
Hart, I.R. (1992) ‘Trends in clinical assessment’, in Approaches to the Assessment of Clinical Competence, Part 1 and 2.
Hays, R.B. (2004) ‘Reflecting on learning portfolios’, Medical Education, 38(8), pp. 801–803. Available at: https://doi.org/10.1111/j.1365-2929.2004.01831.x.
Hill, F. et al. (2009) ‘Implementing the undergraduate mini-CEX: a tailored approach at Southampton University’, Medical Education, 43(4), pp. 326–334. Available at: https://doi.org/10.1111/j.1365-2923.2008.03275.x.
Hurley, K.F. (2011) OSCE and clinical skills handbook. Second edition. Toronto: Elsevier/Saunders.
Jolly, Brian and Grant, Janet (1997) The good assessment guide: a practical guide to assessment and appraisal for higher specialist training. London: Joint Centre for Education in Medicine.
Kogan, J.R., Holmboe, E.S. and Hauer, K.E. (2009) ‘Tools for Direct Observation and Assessment of Clinical Skills of Medical Trainees’, JAMA, 302(12). Available at: https://doi.org/10.1001/jama.2009.1365.
Liu, M. and Liu, K.-M. (2008) ‘Setting Pass Scores for Clinical Skills Assessment’, The Kaohsiung Journal of Medical Sciences, 24(12), pp. 656–663. Available at: https://doi.org/10.1016/S1607-551X(09)70032-4.
Livingston, S.A. and Zieky, M.J. (1982) ‘Passing scores’. ETS. Available at: http://www.ets.org/Media/Research/pdf/passing_scores.pdf.
Mathers, N.J. et al. (1999) ‘Portfolios in continuing medical education - effective and efficient?’, Medical Education, 33(7), pp. 521–530. Available at: https://doi.org/10.1046/j.1365-2923.1999.00407.x.
Messick, S. (no date) ‘Validity’, in Educational Measurement (The American Council on Education/Macmillan series on higher education). Macmillan USA.
Miller, G.E. (1990) ‘The assessment of clinical skills/competence/performance’, Academic Medicine, 65, pp. 63–67. Available at: http://0-ovidsp.dc2.ovid.com.pugwash.lib.warwick.ac.uk/sp-4.02.1a/ovidweb.cgi?WebLinkFrameset=1&S=LJBFFPKHHDEBEBIDIPCKNGPEPMFBAA00&returnUrl=ovidweb.cgi%3fMain%2bSearch%2bPage%3d1%26S%3dLJBFFPKHHDEBEBIDIPCKNGPEPMFBAA00&fromjumpstart=0&directlink=http%3a%2f%2fovidsp.dc2.ovid.com%2fovftpdfs%2fFPEBIPPENGIDHD00%2ffs046%2fovft%2flive%2fgv023%2f00001888%2f00001888-199009000-00045.pdf&filename=The+assessment+of+clinical+skills%2fcompetence%2fperformance.&link_from=S.sh.22.23.27.31%7c45&pdf_key=FPEBIPPENGIDHD00&pdf_index=/fs046/ovft/live/gv023/00001888/00001888-199009000-00045&D=ovft&link_set=S.sh.22.23.27.31|45|sl_10|tocsiblings|S.sh.22.23.27.31.37|0.
Moonen-van Loon, J.M.W. et al. (2013) ‘Composite reliability of a workplace-based assessment toolbox for postgraduate medical education’, Advances in Health Sciences Education, 18(5), pp. 1087–1102. Available at: https://doi.org/10.1007/s10459-013-9450-z.
Murphy, D.J. et al. (2009a) ‘The reliability of workplace-based assessment in postgraduate medical education and training: a national evaluation in general practice in the United Kingdom’, Advances in Health Sciences Education, 14(2), pp. 219–232. Available at: https://doi.org/10.1007/s10459-008-9104-8.
Murphy, D.J. et al. (2009b) ‘The reliability of workplace-based assessment in postgraduate medical education and training: a national evaluation in general practice in the United Kingdom’, Advances in Health Sciences Education, 14(2), pp. 219–232. Available at: https://doi.org/10.1007/s10459-008-9104-8.
National Board of Medical Examiners (no date) ‘Constructing Written Test Questions For the Basic and Clinical Sciences’. Available at: http://www.nbme.org/publications/item-writing-manual.html.
Norcini, J.J. (1995) ‘The Mini-CEX (Clinical Evaluation Exercise): A Preliminary Investigation’, Annals of Internal Medicine, 123(10). Available at: https://doi.org/10.7326/0003-4819-123-10-199511150-00008.
Norcini, J. J (2003) ‘ABC of learning and teaching in medicine: Work based assessment’, BMJ, 326(7392), pp. 753–755. Available at: https://doi.org/10.1136/bmj.326.7392.753.
Norcini, John J (2003) ‘Setting standards on educational tests’, Medical Education, 37(5), pp. 464–469. Available at: https://doi.org/10.1046/j.1365-2923.2003.01495.x.
Norcini, John J. (2003) ‘Setting standards on educational tests’, Medical Education, 37, pp. 464–469. Available at: https://doi.org/10.1046/j.1365-2923.2003.01495.x.
Nunnally, Jum C. and Bernstein, Ira H. (1994) Psychometric theory. 3rd ed. New York: McGraw-Hill.
O’sullivan, P.S. et al. (2004) ‘Demonstration of Portfolios to Assess Competency of Residents’, Advances In Health Sciences Education, 9(4), pp. 309–323. Available at: https://doi.org/10.1007/s10459-004-0885-0.
Ozuah, P.O. and Reznik, M. (2008) ‘Using unannounced standardised patients to assess residents’ professionalism’, Medical Education, 42(5), pp. 532–533. Available at: https://doi.org/10.1111/j.1365-2923.2008.03083.x.
Pearson, D.J. and Heywood, P. (2004) ‘Portfolio use in general practice vocational training: a survey of GP registrars’, Medical Education, 38(1), pp. 87–95. Available at: https://doi.org/10.1111/j.1365-2923.2004.01737.x.
Peile, E. (2006) ‘Knowing and knowing about’, BMJ, 332(7542), pp. 645–645. Available at: https://doi.org/10.1136/bmj.332.7542.645.
Pitts, J., Coles, C. and Thomas, P. (1999) ‘Educational portfolios in the assessment of general practice trainers: reliability of assessors’, Medical Education, 33(7), pp. 515–520. Available at: https://doi.org/10.1046/j.1365-2923.1999.00445.x.
Pitts, J., Coles, C. and Thomas, P. (2001) ‘Enhancing reliability in portfolio assessment: “shaping” the portfolio’, Medical Teacher, 23(4), pp. 351–356. Available at: https://doi.org/10.1080/01421590120057021.
Pitts, John and Association for the Study of Medical Education (2007) Portfolios, personal development and reflective practice. Edinburgh: ASME.
Postgraduate Medical Education and Training Board (2007a) ‘Developing and maintaining an assessment system - a PMETB guide to good practice’. Postgraduate Medical Education and Training Board. Available at: https://www.researchgate.net/profile/Christopher_Oliver/publication/264405740_Developing_and_Maintaining_an_Assessment_System-a_PMETB_Guide_to_Good_Practice/links/53dba0b50cf2cfac9928f468/Developing-and-Maintaining-an-Assessment-System-a-PMETB-Guide-to-Good-Practice.pdf.
Postgraduate Medical Education and Training Board (2007b) ‘Developing and maintaining an assessment system - a PMETB guide to good practice.’ PMETB. Available at: http://www.gmc-uk.org/Assessment_good_practice_v0207.pdf_31385949.pdf.
Postgraduate Medical Education and Training Board (2009) ‘Workplace Based Assessment: A Guide for Implementation’. PMETB. Available at: http://train-com.de/mediadb/9468/20532/eng41_workplace.pdf.
Ramsey, P.G. (1993) ‘Use of Peer Ratings to Evaluate Physician Performance’, JAMA: The Journal of the American Medical Association, 269(13). Available at: https://doi.org/10.1001/jama.1993.03500130069034.
Rees, C. (2005) ‘The use (and abuse) of the term “portfolio”’, Medical Education, 39(4), pp. 436–436. Available at: https://doi.org/10.1111/j.1365-2929.2005.02119.x.
Research Methods - Validity and Reliability in AllPsych Online (no date). Available at: https://allpsych.com/research-methods/variablesvalidityreliability/validityreliability/.
Research Methods Knowledge Base (no date). Available at: http://www.socialresearchmethods.net/kb/.
Rethans, J.-J., Norcini, J J, et al. (2002) ‘The relationship between competence and performance: implications for assessing practice performance’, Medical Education, 36(10), pp. 901–909. Available at: https://doi.org/10.1046/j.1365-2923.2002.01316.x.
Rethans, J.-J., Norcini, J. J., et al. (2002) ‘The relationship between competence and performance: implications for assessing practice performance’, Medical Education, 36, pp. 901–909. Available at: https://doi.org/10.1046/j.1365-2923.2002.01316.x.
Richards, S.H. et al. (2009) ‘A multi-method analysis of free-text comments from the UK General Medical Council Colleague Questionnaires’, Medical Education, 43(8), pp. 757–766. Available at: https://go.exlibris.link/dqJBlzww.
Ricketts, C. (2009) ‘A plea for the proper use of criterion-referenced tests in medical assessment’, Medical Education, 43(12), pp. 1141–1146. Available at: https://doi.org/10.1111/j.1365-2923.2009.03541.x.
Ringsted, C. et al. (2004) ‘Educational impact of in-training assessment (ITA) in postgraduate medical education: a qualitative study of an ITA programme in actual practice’, Medical Education, 38(7), pp. 767–777. Available at: https://doi.org/10.1111/j.1365-2929.2004.01841.x.
Roberts, C., Newble, D.I. and O’Rourke, A.J. (2002) ‘Portfolio-based assessments in medical education: are they valid and reliable for summative purposes?’, Medical Education, 36(10), pp. 899–900. Available at: https://doi.org/10.1046/j.1365-2923.2002.01288.x.
Rowntree, Derek (1987) Assessing students: how shall we know them? Rev. ed. London: Kogan Page.
Samuel Messick (no date) ‘The Psychology of Educational Measurement’, Journal of Educational Measurement, 21(3), pp. 215–237. Available at: http://0-www.jstor.org.pugwash.lib.warwick.ac.uk/stable/1434780.
Schuwirth, Lambert W. T., Vleuten, C. van der, and Association for the Study of Medical Education (2006a) How to design a useful test: the principles of assessment. Edinburgh: ASME.
Schuwirth, Lambert W. T., Vleuten, C. van der, and Association for the Study of Medical Education (2006b) How to design a useful test: the principles of assessment. Edinburgh: ASME.
Schuwirth, L.W. (2004a) ‘Assessing medical competence: finding the right answers’, The Clinical Teacher, 1(1), pp. 14–18. Available at: https://doi.org/10.1111/j.1743-498X.2004.00012.x.
Schuwirth, L.W. (2004b) ‘Assessing medical competence: finding the right answers’, The Clinical Teacher, 1(1), pp. 14–18. Available at: https://doi.org/10.1111/j.1743-498X.2004.00012.x.
Schuwirth, L.W.T. (2003) ‘ABC of learning and teaching in medicine: Written assessment’, BMJ, 326(7390), pp. 643–645. Available at: https://doi.org/10.1136/bmj.326.7390.643.
Schuwirth, L.W.T. and Vleuten, C.P.M. (2006) ‘A plea for new psychometric models in educational assessment’, Medical Education, 40(4), pp. 296–300. Available at: https://doi.org/10.1111/j.1365-2929.2006.02405.x.
Schuwirth, L.W.T. and van der Vleuten, C.P.M. (2003) ‘ABC Of Learning And Teaching In Medicine: Written Assessment’, BMJ: British medical journal, 326(7390), pp. 643–645. Available at: http://0-www.jstor.org.pugwash.lib.warwick.ac.uk/stable/25453994.
Schuwirth, L.W.T. and van der Vleuten, C.P.M. (2011) ‘General overview of the theories used in assessment: AMEE Guide No. 57’, Medical Teacher, 33(10), pp. 783–797. Available at: https://doi.org/10.3109/0142159X.2011.611022.
Schuwirth, L.W.T. and van der Vleuten, C.P.M. (2012) ‘Programmatic assessment and Kane’s validity perspective’, Medical Education, 46(1), pp. 38–48. Available at: https://doi.org/10.1111/j.1365-2923.2011.04098.x.
Snadden, D. (1999) ‘Portfolios - attempting to measure the unmeasurable?’, Medical Education, 33(7), pp. 478–479. Available at: https://doi.org/10.1046/j.1365-2923.1999.00446.x.
Snadden, D. and Thomas, M.L. (1998) ‘Portfolio learning in general practice vocational training - does it work?’, MEDICAL EDUCATION, 32(4), pp. 401–406. Available at: https://doi.org/10.1046/j.1365-2923.1998.00245.x.
Tighe, J. et al. (2010) ‘The standard error of measurement is a more appropriate measure of quality for postgraduate medical assessments than is reliability: an analysis of MRCP(UK) examinations’, BMC Medical Education, 10(1). Available at: https://doi.org/10.1186/1472-6920-10-40.
Tweed, M. and Wilkinson, T. (2009) ‘A randomized controlled trial comparing instructions regarding unsafe response options in a MCQ examination’, Medical Teacher, 31(1), pp. 51–54. Available at: https://doi.org/10.1080/01421590802146018.
Vleuten, C.P.M. (1996) ‘The assessment of professional competence: Developments, research and practical implications’, Advances in Health Sciences Education, 1(1), pp. 41–67. Available at: https://doi.org/10.1007/BF00596229.
Webb, C. et al. (2002) ‘Models of portfolios’, Medical Education, 36(10), pp. 897–898. Available at: https://doi.org/10.1046/j.1365-2923.2002.01318.x.
Webb, C. et al. (2003) ‘Evaluating portfolio assessment systems: what are the appropriate criteria?’, Nurse Education Today, 23(8), pp. 600–609. Available at: https://doi.org/10.1016/S0260-6917(03)00098-4.
Whitehouse, A. et al. (2007) ‘360 degree assessment (multisource feedback) of UK trainee doctors: Field testing of team assessment of behaviours (TAB)’, Medical Teacher, 29(2–3), pp. 171–176. Available at: https://doi.org/10.1080/01421590701302951.
Wilkinson, T.J. et al. (2002) ‘The use of portfolios for assessment of the competence and performance of doctors in practice’, Medical Education, 36(10), pp. 918–924. Available at: https://doi.org/10.1046/j.1365-2923.2002.01312.x.
Wood, T.J., Humphrey-Murto, S.M. and Norman, G.R. (2006) ‘Standard Setting in a Small Scale OSCE: A Comparison of the Modified Borderline-Group Method and the Borderline Regression Method’, Advances in Health Sciences Education, 11(2), pp. 115–122. Available at: https://doi.org/10.1007/s10459-005-7853-1.