Archer, J. C. (2005). Use of SPRAT for peer review of paediatricians in training. BMJ, 330(7502), 1251–1253. https://doi.org/10.1136/bmj.38447.610451.8F
Archer, J., Norcini, J., Southgate, L., Heard, S., & Davies, H. (2008). mini-PAT (Peer Assessment Tool): A Valid Component of a National Assessment Programme in the UK? Advances in Health Sciences Education, 13(2), 181–192. https://doi.org/10.1007/s10459-006-9033-3
Association for the Study of Medical Education. (2014). Understanding medical education: evidence, theory and practice (T. Swanwick, Ed.; Second edition). Wiley Blackwell. http://lib.myilibrary.com/ProductDetail.aspx?id=543123&entityid=https://idp.warwick.ac.uk/idp/shibboleth
Bandaranayake, R. C. (2008). Setting and maintaining standards in multiple choice examinations: AMEE Guide No. 37. Medical Teacher, 30(9–10), 836–845. https://doi.org/10.1080/01421590802402247
Black, H. D., Devine, Marion, & Scottish Council for Research in Education. (1986). Assessment purposes: a study of the relationship between diagnostic  assessment and summative assessment for certification: Vol. SCRE publication. Scottish Council for Research in Education.
Bloom, Benjamin S. (1956). Taxonomy of educational objectives: the classification of  educational goals, Handbook 1: Cognitive domain. Longman Group Ltd.
Breakwell, Glynis M., Smith, Jonathan A., & Wright, Daniel B. (2012). Research methods in psychology (4th ed). SAGE.
Brian Jolly. (1999). Clinical logbooks: recording clinical experiences may not be enough. Medical Education, 33(2), 86–88. https://doi.org/10.1046/j.1365-2923.1999.00386.x
Brigden, D. (1999). Constructing a learning portfolio. BMJ, 319(7201), 2a–2a. https://doi.org/10.1136/bmj.319.7201.2a
Bullock, A. D., Hassell, A., Markham, W. A., Wall, D. W., & Whitehouse, A. B. (2009). How ratings vary by staff group in multi-source feedback assessment of junior doctors. Medical Education, 43(6), 516–520. https://doi.org/10.1111/j.1365-2923.2009.03333.x
Campbell, L. M., Howie, J. G., & Murray, T. S. (1995). Use of videotaped consultations in summative assessment of trainees in general practice. British Journal of General Practice, 45(392), 137–141. http://0-bjgp.org.pugwash.lib.warwick.ac.uk/content/45/392/137
Cangelosi, J. S. (n.d.). Designing tests for evaluating student achievement. Longman.
Challis, M. (1999). AMEE Medical Education Guide No.11 (revised): Portfolio-based learning and assessment in medical education. Medical Teacher, 21(4), 370–386. https://doi.org/10.1080/01421599979310
Challis, M. (2001). Portfolios and assessment: meeting the challenge. Medical Teacher, 23(5), 437–440. https://doi.org/10.1080/01421590120075643
Cleland, J. A., Knight, L. V., Rees, C. E., Tracey, S., & Bond, C. M. (2008). Is it me or is it them? Factors that influence the passing of underperforming students. Medical Education, 42(8), 800–809. https://doi.org/10.1111/j.1365-2923.2008.03113.x
Cohen-Schotanus, J., & van der Vleuten, C. P. M. (2010). A standard setting method with the best performing students as a point of reference: Practical and affordable. Medical Teacher, 32(2), 154–160. https://doi.org/10.3109/01421590903196979
Cox, M., Irby, D. M., & Epstein, R. M. (2007). Assessment in Medical Education. New England Journal of Medicine, 356(4), 387–396. https://doi.org/10.1056/NEJMra054784
Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. https://doi.org/10.1037/h0040957
Crossley, J., Eiser, C., & Davies, H. A. (2005). Children and their parents assessing the doctor-patient interaction: a rating system for doctors’ communication skills. Medical Education, 39(8), 820–828. https://doi.org/10.1111/j.1365-2929.2005.02230.x
Daelmans, H. E. M., van der Hem-Stokroos, H. H., Hoogenboom, R. J. I., Scherpbier, A. J. J. A., Stehouwer, C. D. A., & van der Vleuten, C. P. M. (2004). Feasibility and reliability of an in-training assessment programme in an undergraduate clerkship. Medical Education, 38(12), 1270–1277. https://doi.org/10.1111/j.1365-2929.2004.02019.x
David, M. F. B., Davis, M. H., Harden, R. M., Howie, P. W., Ker, J., & Pippard, M. J. (2001). AMEE Medical Education Guide No. 24: Portfolios as a method of student assessment. Medical Teacher, 23(6), 535–551. https://doi.org/10.1080/01421590120090952
Davies, H., Archer, J., Bateman, A., Dewar, S., Crossley, J., Grant, J., & Southgate, L. (2008). Specialty-specific multi-source feedback: assuring validity, informing training. Medical Education, 42(10), 1014–1020. https://doi.org/10.1111/j.1365-2923.2008.03162.x
Developing and maintaining an assessment system. (n.d.). Postgraduate Medical Education and Training Board. https://www.researchgate.net/publication/264405740_Developing_and_Maintaining_an_Assessment_System-a_PMETB_Guide_to_Good_Practice
Does a student log provide a means to better structure clinical education? (1999). Medical Education, 33(2), 89–94. https://doi.org/10.1046/j.1365-2923.1999.00285.x
Dory, V., Gagnon, R., & Charlin, B. (2010). Is case-specificity content-specificity? An analysis of data from extended-matching questions. Advances in Health Sciences Education, 15(1), 55–63. https://doi.org/10.1007/s10459-009-9169-z
Downing, S. M. (2004). Reliability: on the reproducibility of assessment data. Medical Education, 38(9), 1006–1012. https://doi.org/10.1111/j.1365-2929.2004.01932.x
Downing, S. M., & Haladyna, T. M. (2004). Validity threats: overcoming interference with proposed interpretations of assessment data. Medical Education, 38(3), 327–333. https://doi.org/10.1046/j.1365-2923.2004.01777.x
Downing, S. M., Tekian, A., & Yudkowsky, R. (2006). RESEARCH METHODOLOGY: Procedures for Establishing Defensible Absolute Passing Scores on Performance Examinations in Health Professions Education. Teaching and Learning in Medicine, 18(1), 50–57. https://doi.org/10.1207/s15328015tlm1801_11
Driessen, E., van der Vleuten, C., Schuwirth, L., van Tartwijk, J., & Vermunt, J. (2005). The use of qualitative research criteria for portfolio assessment as an alternative to reliability evaluation: a case study. Medical Education, 39(2), 214–220. https://doi.org/10.1111/j.1365-2929.2004.02059.x
Driessen, E., van Tartwijk, J., Vermunt, J., & van der Vleuten, C. (2003). Use of portfolios in early undergraduate medical training. Medical Teacher, 25(1), 18–23. https://doi.org/10.1080/0142159021000061378
Driessen, E. W., Muijtjens, A. M. M., van Tartwijk, J., & van der Vleuten, C. P. M. (2007). Web- or paper-based portfolios: is there a difference? Medical Education, 41(11), 1067–1073. https://doi.org/10.1111/j.1365-2923.2007.02859.x
Driessen, E. W., Overeem, K., van Tartwijk, J., van der Vleuten, C. P. M., & Muijtjens, A. M. M. (2006). Validity of portfolio assessment: which qualities determine ratings? Medical Education, 40(9), 862–866. https://doi.org/10.1111/j.1365-2929.2006.02550.x
du Boulay, C. (2000). From CME to CPD: getting better at getting better? BMJ, 320(7232), 393–394. https://doi.org/10.1136/bmj.320.7232.393
Epstein, R. M. (n.d.). Assessment in Medical Education. New England Journal of Medicine, 356(4), 387–396. https://doi.org/10.1056/NEJMra054784
Evans, R. (2004). Review of instruments for peer assessment of physicians. BMJ, 328(7450). https://doi.org/10.1136/bmj.328.7450.1240
Farmer, E. A., & Page, G. (2005a). A practical guide to assessing clinical decision-making skills using the key features approach. Medical Education, 39(12), 1188–1194. https://doi.org/10.1111/j.1365-2929.2005.02339.x
Farmer, E. A., & Page, G. (2005b). A practical guide to assessing clinical decision-making skills using the key features approach. Medical Education, 39(12), 1188–1194. https://doi.org/10.1111/j.1365-2929.2005.02339.x
Freeman, Richard T. & Lewis, Roger. (1998). Planning and implementing assessment. Kogan Page.
Friedman Ben-Davis, M. (2000). AMEE Guide No. 18: Standard setting in student assessment. Medical Teacher, 22(2), 120–130. https://doi.org/10.1080/01421590078526
G. Rasch. (1980). Probabilistic models for some intelligence and attainment tests. University of Chicago Press.
Gagnon, R., Charlin, B., Roy, L., St-Martin, M., Sauve, E., Boshuizen, H. P. A., & van der Vleuten, C. (2006). The Cognitive Validity of the Script Concordance Test: A Processing Time Study. Teaching and Learning in Medicine, 18(1), 22–27. https://doi.org/10.1207/s15328015tlm1801_6
Govaerts, M. J. B., Vleuten, C. P. M., Schuwirth, L. W. T., & Muijtjens, A. M. M. (2007). Broadening Perspectives on Clinical Performance Assessment: Rethinking the Nature of In-training Assessment. Advances in Health Sciences Education, 12(2), 239–260. https://doi.org/10.1007/s10459-006-9043-1
Hart, I. R. (1992). Trends in clinical assessment. In Approaches to the Assessment of Clinical Competence, Part 1 and 2.
Hays, R. B. (2004). Reflecting on learning portfolios. Medical Education, 38(8), 801–803. https://doi.org/10.1111/j.1365-2929.2004.01831.x
Hill, F., Kendall, K., Galbraith, K., & Crossley, J. (2009). Implementing the undergraduate mini-CEX: a tailored approach at Southampton University. Medical Education, 43(4), 326–334. https://doi.org/10.1111/j.1365-2923.2008.03275.x
Hurley, K. F. (2011). OSCE and clinical skills handbook (Second edition). Elsevier/Saunders.
Jolly, Brian & Grant, Janet. (1997). The good assessment guide: a practical guide to assessment and appraisal for higher specialist training. Joint Centre for Education in Medicine.
Kogan, J. R., Holmboe, E. S., & Hauer, K. E. (2009). Tools for Direct Observation and Assessment of Clinical Skills of Medical Trainees. JAMA, 302(12). https://doi.org/10.1001/jama.2009.1365
Liu, M., & Liu, K.-M. (2008). Setting Pass Scores for Clinical Skills Assessment. The Kaohsiung Journal of Medical Sciences, 24(12), 656–663. https://doi.org/10.1016/S1607-551X(09)70032-4
Livingston, S. A., & Zieky, M. J. (1982). Passing scores. ETS. http://www.ets.org/Media/Research/pdf/passing_scores.pdf
Mathers, N. J., Challis, M. C., Howe, A. C., & Field, N. J. (1999). Portfolios in continuing medical education - effective and efficient? Medical Education, 33(7), 521–530. https://doi.org/10.1046/j.1365-2923.1999.00407.x
Messick, S. (n.d.). Validity [Hardcover]. In Educational Measurement (The American Council on Education/Macmillan series on higher education). Macmillan USA.
Miller, G. E. (1990). The assessment of clinical skills/competence/performance. Academic Medicine, 65, 63–67. http://0-ovidsp.dc2.ovid.com.pugwash.lib.warwick.ac.uk/sp-4.02.1a/ovidweb.cgi?WebLinkFrameset=1&S=LJBFFPKHHDEBEBIDIPCKNGPEPMFBAA00&returnUrl=ovidweb.cgi%3fMain%2bSearch%2bPage%3d1%26S%3dLJBFFPKHHDEBEBIDIPCKNGPEPMFBAA00&fromjumpstart=0&directlink=http%3a%2f%2fovidsp.dc2.ovid.com%2fovftpdfs%2fFPEBIPPENGIDHD00%2ffs046%2fovft%2flive%2fgv023%2f00001888%2f00001888-199009000-00045.pdf&filename=The+assessment+of+clinical+skills%2fcompetence%2fperformance.&link_from=S.sh.22.23.27.31%7c45&pdf_key=FPEBIPPENGIDHD00&pdf_index=/fs046/ovft/live/gv023/00001888/00001888-199009000-00045&D=ovft&link_set=S.sh.22.23.27.31|45|sl_10|tocsiblings|S.sh.22.23.27.31.37|0
Moonen-van Loon, J. M. W., Overeem, K., Donkers, H. H. L. M., Vleuten, C. P. M., & Driessen, E. W. (2013). Composite reliability of a workplace-based assessment toolbox for postgraduate medical education. Advances in Health Sciences Education, 18(5), 1087–1102. https://doi.org/10.1007/s10459-013-9450-z
Murphy, D. J., Bruce, D. A., Mercer, S. W., & Eva, K. W. (2009a). The reliability of workplace-based assessment in postgraduate medical education and training: a national evaluation in general practice in the United Kingdom. Advances in Health Sciences Education, 14(2), 219–232. https://doi.org/10.1007/s10459-008-9104-8
Murphy, D. J., Bruce, D. A., Mercer, S. W., & Eva, K. W. (2009b). The reliability of workplace-based assessment in postgraduate medical education and training: a national evaluation in general practice in the United Kingdom. Advances in Health Sciences Education, 14(2), 219–232. https://doi.org/10.1007/s10459-008-9104-8
National Board of Medical Examiners. (n.d.). Constructing Written Test Questions For the Basic and Clinical Sciences. http://www.nbme.org/publications/item-writing-manual.html
Norcini, J. J. (1995). The Mini-CEX (Clinical Evaluation Exercise): A Preliminary Investigation. Annals of Internal Medicine, 123(10). https://doi.org/10.7326/0003-4819-123-10-199511150-00008
Norcini, J. J. (2003a). Setting standards on educational tests. Medical Education, 37, 464–469. https://doi.org/10.1046/j.1365-2923.2003.01495.x
Norcini, J. J. (2003b). ABC of learning and teaching in medicine: Work based assessment. BMJ, 326(7392), 753–755. https://doi.org/10.1136/bmj.326.7392.753
Norcini, J. J. (2003c). Setting standards on educational tests. Medical Education, 37(5), 464–469. https://doi.org/10.1046/j.1365-2923.2003.01495.x
Nunnally, Jum C. & Bernstein, Ira H. (1994). Psychometric theory: Vol. McGraw-Hill series in psychology (3rd ed). McGraw-Hill.
O’sullivan, P. S., Reckase, M. D., McClain, T., Savidge, M. A., & Clardy, J. A. (2004). Demonstration of Portfolios to Assess Competency of Residents. Advances In Health Sciences Education, 9(4), 309–323. https://doi.org/10.1007/s10459-004-0885-0
Ozuah, P. O., & Reznik, M. (2008). Using unannounced standardised patients to assess residents’ professionalism. Medical Education, 42(5), 532–533. https://doi.org/10.1111/j.1365-2923.2008.03083.x
Pearson, D. J., & Heywood, P. (2004). Portfolio use in general practice vocational training: a survey of GP registrars. Medical Education, 38(1), 87–95. https://doi.org/10.1111/j.1365-2923.2004.01737.x
Peile, E. (2006). Knowing and knowing about. BMJ, 332(7542), 645–645. https://doi.org/10.1136/bmj.332.7542.645
Pitts, J., Coles, C., & Thomas, P. (1999). Educational portfolios in the assessment of general practice trainers: reliability of assessors. Medical Education, 33(7), 515–520. https://doi.org/10.1046/j.1365-2923.1999.00445.x
Pitts, J., Coles, C., & Thomas, P. (2001). Enhancing reliability in portfolio assessment: ‘shaping’ the portfolio. Medical Teacher, 23(4), 351–356. https://doi.org/10.1080/01421590120057021
Pitts, John & Association for the Study of Medical Education. (2007). Portfolios, personal development and reflective practice: Vol. Understanding medical education. ASME.
Postgraduate Medical Education and Training Board. (2007a). Developing and maintaining an assessment system - a PMETB guide to good practice. Postgraduate Medical Education and Training Board. https://www.researchgate.net/profile/Christopher_Oliver/publication/264405740_Developing_and_Maintaining_an_Assessment_System-a_PMETB_Guide_to_Good_Practice/links/53dba0b50cf2cfac9928f468/Developing-and-Maintaining-an-Assessment-System-a-PMETB-Guide-to-Good-Practice.pdf
Postgraduate Medical Education and Training Board. (2007b). Developing and maintaining an assessment system - a PMETB guide to good practice. PMETB. http://www.gmc-uk.org/Assessment_good_practice_v0207.pdf_31385949.pdf
Postgraduate Medical Education and Training Board. (2009). Workplace Based Assessment: A Guide for Implementation. PMETB. http://train-com.de/mediadb/9468/20532/eng41_workplace.pdf
Ramsey, P. G. (1993). Use of Peer Ratings to Evaluate Physician Performance. JAMA: The Journal of the American Medical Association, 269(13). https://doi.org/10.1001/jama.1993.03500130069034
Rees, C. (2005). The use (and abuse) of the term ‘portfolio’. Medical Education, 39(4), 436–436. https://doi.org/10.1111/j.1365-2929.2005.02119.x
Research Methods - Validity and Reliability in AllPsych Online. (n.d.). https://allpsych.com/research-methods/variablesvalidityreliability/validityreliability/
Research Methods Knowledge Base. (n.d.). http://www.socialresearchmethods.net/kb/
Rethans, J.-J., Norcini, J. J., Barón-Maldonado, M., Blackmore, D., Jolly, B. C., LaDuca, T., Lew, S., Page, G. G., & Southgate, L. H. (2002). The relationship between competence and performance: implications for assessing practice performance. Medical Education, 36, 901–909. https://doi.org/10.1046/j.1365-2923.2002.01316.x
Rethans, J.-J., Norcini, J. J., Baron-Maldonado, M., Blackmore, D., Jolly, B. C., LaDuca, T., Lew, S., Page, G. G., & Southgate, L. H. (2002). The relationship between competence and performance: implications for assessing practice performance. Medical Education, 36(10), 901–909. https://doi.org/10.1046/j.1365-2923.2002.01316.x
Richards, S. H., Campbell, J. L., Walshaw, E., Dickens, A., & Greco, M. (2009). A multi-method analysis of free-text comments from the UK General Medical Council Colleague Questionnaires. Medical Education, 43(8), 757–766. https://go.exlibris.link/dqJBlzww
Ricketts, C. (2009). A plea for the proper use of criterion-referenced tests in medical assessment. Medical Education, 43(12), 1141–1146. https://doi.org/10.1111/j.1365-2923.2009.03541.x
Ringsted, C., Henriksen, A. H., Skaarup, A. M., & Van der Vleuten, C. P. M. (2004). Educational impact of in-training assessment (ITA) in postgraduate medical education: a qualitative study of an ITA programme in actual practice. Medical Education, 38(7), 767–777. https://doi.org/10.1111/j.1365-2929.2004.01841.x
Roberts, C., Newble, D. I., & O’Rourke, A. J. (2002). Portfolio-based assessments in medical education: are they valid and reliable for summative purposes? Medical Education, 36(10), 899–900. https://doi.org/10.1046/j.1365-2923.2002.01288.x
Rowntree, Derek. (1987). Assessing students: how shall we know them? (Rev. ed). Kogan Page.
Samuel Messick. (n.d.). The Psychology of Educational Measurement. Journal of Educational Measurement, 21(3), 215–237. http://0-www.jstor.org.pugwash.lib.warwick.ac.uk/stable/1434780
Schuwirth, L. W. (2004a). Assessing medical competence: finding the right answers. The Clinical Teacher, 1(1), 14–18. https://doi.org/10.1111/j.1743-498X.2004.00012.x
Schuwirth, L. W. (2004b). Assessing medical competence: finding the right answers. The Clinical Teacher, 1(1), 14–18. https://doi.org/10.1111/j.1743-498X.2004.00012.x
Schuwirth, L. W. T. (2003). ABC of learning and teaching in medicine: Written assessment. BMJ, 326(7390), 643–645. https://doi.org/10.1136/bmj.326.7390.643
Schuwirth, L. W. T., & van der Vleuten, C. P. M. (2003). ABC Of Learning And Teaching In Medicine: Written Assessment. BMJ: British Medical Journal, 326(7390), 643–645. http://0-www.jstor.org.pugwash.lib.warwick.ac.uk/stable/25453994
Schuwirth, L. W. T., & van der Vleuten, C. P. M. (2011). General overview of the theories used in assessment: AMEE Guide No. 57. Medical Teacher, 33(10), 783–797. https://doi.org/10.3109/0142159X.2011.611022
Schuwirth, L. W. T., & van der Vleuten, C. P. M. (2012). Programmatic assessment and Kane’s validity perspective. Medical Education, 46(1), 38–48. https://doi.org/10.1111/j.1365-2923.2011.04098.x
Schuwirth, L. W. T., & Vleuten, C. P. M. (2006). A plea for new psychometric models in educational assessment. Medical Education, 40(4), 296–300. https://doi.org/10.1111/j.1365-2929.2006.02405.x
Schuwirth, Lambert W. T., Vleuten, C. van der, & Association for the Study of Medical Education. (2006a). How to design a useful test: the principles of assessment: Vol. Understanding medical education. ASME.
Schuwirth, Lambert W. T., Vleuten, C. van der, & Association for the Study of Medical Education. (2006b). How to design a useful test: the principles of assessment: Vol. Understanding medical education. ASME.
Snadden, D. (1999). Portfolios - attempting to measure the unmeasurable? Medical Education, 33(7), 478–479. https://doi.org/10.1046/j.1365-2923.1999.00446.x
Snadden, D., & Thomas, M. L. (1998). Portfolio learning in general practice vocational training - does it work? MEDICAL EDUCATION, 32(4), 401–406. https://doi.org/10.1046/j.1365-2923.1998.00245.x
Tighe, J., McManus, I., Dewhurst, N. G., Chis, L., & Mucklow, J. (2010). The standard error of measurement is a more appropriate measure of quality for postgraduate medical assessments than is reliability: an analysis of MRCP(UK) examinations. BMC Medical Education, 10(1). https://doi.org/10.1186/1472-6920-10-40
Tweed, M., & Wilkinson, T. (2009). A randomized controlled trial comparing instructions regarding unsafe response options in a MCQ examination. Medical Teacher, 31(1), 51–54. https://doi.org/10.1080/01421590802146018
Vleuten, C. P. M. (1996). The assessment of professional competence: Developments, research and practical implications. Advances in Health Sciences Education, 1(1), 41–67. https://doi.org/10.1007/BF00596229
Webb, C., Endacott, R., A Gray, M., Jasper, M. A., McMullan, M., & Scholes, J. (2003). Evaluating portfolio assessment systems: what are the appropriate criteria? Nurse Education Today, 23(8), 600–609. https://doi.org/10.1016/S0260-6917(03)00098-4
Webb, C., Endacott, R., Gray, M., Jasper, M., Miller, C., McMullan, M., & Scholes, J. (2002). Models of portfolios. Medical Education, 36(10), 897–898. https://doi.org/10.1046/j.1365-2923.2002.01318.x
Whitehouse, A., Hassell, A., Bullock, A., Wood, L., & Wall, D. (2007). 360 degree assessment (multisource feedback) of UK trainee doctors: Field testing of team assessment of behaviours (TAB). Medical Teacher, 29(2–3), 171–176. https://doi.org/10.1080/01421590701302951
Wilkinson, T. J., Challis, M., Hobma, S. O., Newble, D. I., Parboosingh, J. T., Sibbald, R. G., & Wakeford, R. (2002). The use of portfolios for assessment of the competence and performance of doctors in practice. Medical Education, 36(10), 918–924. https://doi.org/10.1046/j.1365-2923.2002.01312.x
Wood, T. J., Humphrey-Murto, S. M., & Norman, G. R. (2006). Standard Setting in a Small Scale OSCE: A Comparison of the Modified Borderline-Group Method and the Borderline Regression Method. Advances in Health Sciences Education, 11(2), 115–122. https://doi.org/10.1007/s10459-005-7853-1