Introducing the 2024 Evaluation Lab (AKA: Turning Design Back Onto Evaluation)

The Design and Evaluation Special Interest Group (SIG) was established in 2017. Since that time, and particularly since 2020, we have explored the interface of evaluation and design through 'Learning Sprints'. These rapid learning events provided a chance to 'talk' about this interface. However, in 2024, we want to change it up - we want to 'do' more.
Introducing the Evaluation Lab:
Inspired by other ‘real world’ Lab models (i.e., living labs), the Evaluation Lab will bring together those interested in evaluation to undertake a design process to address specific evaluation challenges. Small teams (2-5) will self-organise and tackle a particular evaluation challenge. Teams will be supported through a design process involving definition, ideation, and prototyping stages. The Lab will culminate in a 'pitch' event, where teams will present their solutions.
The Lab is an intentional space for the evaluation sector to 'wear a different hat' and try out the design process - but applied to things we grapple with in our work. Challenges cover a range of themes from across evaluation - with scope to tailor their direction to particular interests.
This introductory event is an open invitation to those in the evaluation sector - regardless of role or experience - to join learn more about and register for the Evaluation Lab. Over the course of 90-minutes, you will:
• Learn about the scope and intent of the Evaluation Lab, including the evaluation challenges that have been identified
• Be introduced to the design process that will be undertaken
• Learn how to register for and participate in the Evaluation Lab.
The requirements for participating in the Evaluation Lab are:
• Attendance by at least one team member at each of the three 1-hour 'check-points' workshops for the Lab (Mid-May, Mid-June, and Mid-August)
• Ability to commit to activities at each of the three stages, and preparation of a short (e.g., 5-minute) pitch
• A beginner's mindset, a willingness to 'give it a go', and to engage in the process.
This is a free initiative organised by the Design and Evaluation SIG. This event is open to all - with the check-point workshops only open to participating teams. The time commitment to the Lab will vary - but we estimate to gain something out of the process it will be a total of 12 hours total (minimum). Those that sign-up to and participate in the Evaluation Lab will receive a digital workbook to support their learning journey.
Presenter details
On behalf of the Design and Evaluation SIG
Matt Healey is one of the co-Convenors of the Design and Evaluation SIG. Matt has been interested in design as a field of practice as applied to a range of concepts - from evaluation to systems. He has been an active member of the AES since 2015, and his passion is seeking to incorporate ideas and techniques from other areas into evaluation, and vice versa.
Matt will be coordinating the Evaluation Lab, and as such will be leading the session on behalf of the SIG group. He will outline the focus of the Lab, the evaluation challenges, and the structure of the Lab over the next several months.