Applying the CEFR to Rating and Standard Setting: Practical Calibration and Judgement Exercises

When working with the CEFR, it can be challenging to adapt or work with the descriptors in contexts where human judgement is involved. The core focus of this workshop is on using the CEFR (including the Companion Volume) as a framework for rating productive skills, standard‑setting judgments, and ensuring consistency across raters and tasks.

What knowledge and/or skills will I gain from this workshop?

By the end of this workshop, participants will be able to:

• Understand how CEFR descriptors can guide rating decisions
• Identify key factors for borderline and cut‑score judgements
• Use the CEFR to inform standard‑setting decisions and justify cut scores
• Develop templates for calibration and rating practice for use in their own context

Who is this workshop suitable for?

This is a practical and interactive workshop suitable for CEFR‑literate assessment professionals, who work as raters, train raters, who are involved in standard setting, or would like to learn more about it. No previous standard setting experience is required. Participants are expected to have a working knowledge of the CEFR and to be able to work with CEFR descriptors provided in English and with sample tasks designed for learners of English as a foreign language. Exemplar tasks targeting a range of CEFR levels will be provided.

How is this workshop delivered?

This practical workshop is delivered in person, and will include interactive discussions with the tutor, bite-size introductory input, individual study tasks, and group and pair discussions. A pre-course questionnaire will be used to gauge the level and experience of those attending. Coffee breaks and lunch are included.

Does this workshop require and specific software?

This course does not require any specific software, but it is a paper-free ‘green’ workshop, and all material will be delivered/shared online. You will need your own laptop.

Who is the tutor?

The course will be presented by Jane Lloyd (Cambridge University Press and Assessment). Jane is a Senior Research Manager at Cambridge English. Her main responsibilities are researching integrated learning and assessment practices in the classroom, working on large-scale educational reform projects with ministries and NGOs, and working for ALTE. Her work for ALTE is to support other national language test providers. This includes advising and training in standard setting, statistical analysis of items, analysis of rater performance, delivering pre-conference and online courses and training in assessment, and supporting exam boards with bespoke training and mentoring. She has a degree in Linguistics, a DELTA, MAs in Linguistics and TESOL, and in Language Testing, and is completing her PhD in Language Testing from CRELLA. 

When is the workshop?

This workshop will be on Wednesday 11th November in Lisbon, Portugal.

Can several people from the same organisation join this workshop?

For group bookings, ALTE advises to book a maximum of three places per organisation.

How can I pay?

Full payment is required on registration. Payment can be made online using a Visa, MasterCard or American Express. If it is not possible to pay with a credit/debit card when registering, please contact the ALTE Services Unit (servicesunit@alte.org) to request an invoice for a bank transfer payment to be made.