Ottawa Symposium 4 : Emerging Concepts and Practical Applications of Validity

10:15 – 11:45 , 13th MARCH 2018
David Cook (Mayo Clinic College of Medicine and Science, USA), Meredith Young (McGill University, Canada), Claire Touchie (Medical Council of Canada, Canada), Susan Humphrey-Murto (University of Ottawa, Canada), Rodrigo Cavalcanti (University of Toronto, Canada)
Abu Dhabi National Exhibition Centre (ADNEC), Abu Dhabi


Validity is a fundamental element in judging the quality and trustworthiness of assessments. Conceptions of validity have evolved from a “classical” model (content, criterion, construct), to a unified model supported by five evidence sources (Messick), to an argument-based approach focused on key inferences (Kane). While these distinctions can seem esoteric, understanding validity can help improve all aspects of assessment across the continuum from admissions to maintenance of competence. This symposium will highlight the importance of validity in evaluating assessment quality, and demonstrate the practical benefits of validation in the work of educators and researchers. We will contrast several validity frameworks, and describe strengths and weaknesses of each. We will then explore validity in four specific contexts:

1. Assessment of clinical reasoning

2. Assessment for high-stakes decisions

3. Consensus methods in assessment and research

4. Measurement of non-learning constructs such as cognitive load.