FestEVAL24: AI & Machine Learning (day one)

Рет қаралды 14,342

Ай бұрын

AI 101 for evaluators
The session will provide attendees with a foundational orientation to the current state of play in AI. Attendees will be guided through common language in the field, as well as Australian and global policy settings regarding this technology. Following this overview, Kristy will discuss the key opportunities and risks for evaluators in engaging with AI, both as part of their own service delivery and as part of their work to evaluate AI-enabled programs. The session will be interactive, involving audience polls and a democratic approach to ensuring the audience’s burning questions are addressed live in session.
Attendees will gain from this session
• familiarisation with key AI concepts and terminology
• a high level summary of global legislative and regulatory contexts
• a snapshot of critical opportunities and risks to be aware of, in their role evaluating AI-enabled programs, or when using AI technology directly.
Kristy Hornby is an Associate Director at Grosvenor who established and still runs its Victorian program evaluation practice. She has completed over 310+ evaluation, review and strategy projects to date across more than a decade of practice. Experienced across mixed methods approaches she delivers evaluation services across the spectrum of program design advice, developing monitoring systems, conducting evaluations, building evaluation capability and mentoring new evaluators. She is always keen to experiment with new technology and methods to explore the ‘what if’ and ‘how come’. She has evaluated around 10 AI-enabled programs over her time and sees the advent of AI technology as a new frontier in evaluation practice which we all must grapple with, to remain contemporary in providing meaningful evaluations. Qualified with a BA, MBA and an MEvaluation (ongoing) she loves to make sense of complex contexts, connect with new people and have fun in her work. Kristy is also the Chair of IPAA Victoria’s Risk Community of Practice and has held multiple for-purpose director roles.
Working smarter rather than harder with AI
During this practical session, we will explore the practical applications of AI in the field of evaluation. David will showcase one of his innovative AI inventions, demonstrating its utility and the underlying motivations that led to its creation. Laurie will share their personal learning journey, offering insights into the principles that evaluators should consider in this new age of AI-driven evaluation methodologies. Together, we will delve into the intersection of AI and evaluation, gaining a deeper understanding of the potential of AI in this field.
Attendees will gain from this session:
A few practical uses of AI in evaluation, including AI alphabet soup, precision prompts, logic models, theories of change, the intricacies of analysis, and reporting. All that and more (like image creation) in less than 15 minutes.
David Fetterman is the author of 18 books and is the founder of Fetterman & Associates, David renowned for developing the Empowerment Evaluation Approach. David brings 25 years of experience from Stanford University, where he held various roles, including faculty member at the School of Education, director of evaluation at the School of Medicine, and senior member of the administration. He also serves as a faculty member at Pacifica Graduate Institute and Adjunct Professor at Claremont Graduate University. Prior to his time at Stanford, he was a professor and research director at the California Institute of Integral Studies, Principal Research Scientist at the American Institutes for Research, and a senior associate at RMC Research Corporation. David has worked in diverse contexts, including Japan, Brazil, Ethiopia, and Aotearoa. A former president of the American Evaluation Association, David has earned several prestigious awards and he was named the top anthropologist of the decade in 2020, which was celebrated in Times Square.
Laurie Crawford is a queer, non-binary pākehā. They grew up in the Manawatū and have since found a home Laurie in Whanganui-a-Tara. Before discovering evaluation, Laurie’s first loves were philosophy and psychology. They have a research-focussed MA in psychology from Massey University and have worked in several mental health roles. Laurie has now been evaluating in the public sector for seven years, across multiple subject areas and methodologies. The position of evaluation at the intersection of knowledge generation and real-world impacts is a constant source of fascination for Laurie. They value mixed methods and are equally comfortable in qualitative and quantitative methodologies. Recently Laurie started a learning deep dive into AI tools and their potential for use in Evaluation, to which they bring a personal interest in Sci-Fi as well as their knowledge of philosophy, psychology, and evaluation.