Full Schedule

8:00 AM – 5:00 PM ET

Job Fair

8:00 AM – 5:00 PM ET

Registration Open

8:30 AM – 10:00 AM ET

Plenary - AEA Awards Ceremony

10:00 AM – 4:00 PM ET

Exhibit Hall Open

10:15 AM – 11:15 AM ET

Approaches to Evaluating Systems Change: A Discussion with Two Postsecondary Funders

Systems in Evaluation

10:15 AM – 11:15 AM ET

Creating and Telling the Story of System Change: Oxfam’s Experiences

Presenter: Irene Guijt, PhD – Oxfam Great Britain

Presenter: Kimberly Pfeifer, PhD – Oxfam US

Presenter: Jorge Romero Leon, PhD – Oxfam Netherlands

Chair: Velina Petrova, PhD – Oxfam International

Location: Grand Ballroom 9

International and Cross Cultural Evaluation

10:15 AM – 11:15 AM ET

A story of shifting power and changing systems: the new learning and accountability framework for Oxfam Great Britain

Presenter: Irene Guijt, PhD – Oxfam Great Britain

10:15 AM – 11:15 AM ET

Knowledge for Systems Change at Oxfam America

Presenter: Kimberly Pfeifer, PhD – Oxfam US

10:15 AM – 11:15 AM ET

Knowledges for Transformative System Changes: Where From and Where To?

Presenter: Velina Petrova, PhD – Oxfam International

10:15 AM – 11:15 AM ET

Making the Case: Storytelling in Strategies for System Transformation

Presenter: Jorge Romero Leon, PhD – Oxfam Netherlands

10:15 AM – 11:15 AM ET

Democratizing the Development of Theories of Change: Leveraging New and Older Technology to Give Voice to Individuals & Sectors, to Tell the Story of Programs and the Communities They Serve

Presenter: Charles Gasper, M.A. – TCC Group

Presenter: Stephanie Coker, MPA; BA in Political Science and Government – CVS Health

Presenter: Rose N. Konecky, n/a – TCC Group

Location: Grand Ballroom 10

Program Theory and Theory-Driven Evaluation

10:15 AM – 11:15 AM ET

Emerging AI in Evaluation: Implications and Opportunities for Practice & Business

Chair: Bianca Montrosse-Moorhead, PhD – University of Connecticut

Disscussant: Sarah Mason, PhD – The University of Mississippi

Presenter: Nina Sabarre, PhD (she/her/hers) – Intention 2 Impact

Presenter: Kathleen Doll, PhD (she/her/hers) – Intention 2 Impact

Presenter: Sahiti Bhaskara, MPH, BDS – Intention 2 Impact

Presenter: Linda Raftree, BA in Anthropology – MERL Tech

Author: Aileen M. Reid, PhD – UNC Greensboro

Presenter: Zach Tilton, n/a – Western Michigan University

Location: Room 103

Integrating Technology into Evaluation

10:15 AM – 11:15 AM ET

Centering Equity: The Role of Evaluation and Evaluators in an AI World

Presenter: Aileen M. Reid, PhD – UNC Greensboro

10:15 AM – 11:15 AM ET

Developing Critical AI Literacy in Evaluation Education and Capacity Building

Presenter: Zach Tilton, n/a – Western Michigan University

10:15 AM – 11:15 AM ET

Session Chair

Presenter: Bianca Montrosse-Moorhead, PhD – University of Connecticut

10:15 AM – 11:15 AM ET

Session Discussant

Presenter: Sarah Mason, PhD – The University of Mississippi

10:15 AM – 11:15 AM ET

Using AI to Disrupt Business As Usual In Evaluation Firms

Presenter: Nina Sabarre, PhD (she/her/hers) – Intention 2 Impact

Presenter: Kathleen Doll, PhD (she/her/hers) – Intention 2 Impact

Presenter: Sahiti Bhaskara, MPH, BDS – Intention 2 Impact

10:15 AM – 11:15 AM ET

Watch out! Risks of using Natural Language Processing AI for Evaluation

Presenter: Linda Raftree, BA in Anthropology – MERL Tech

10:15 AM – 11:15 AM ET

Evaluating power-building with survivors of violence

Presenter: Tierney Ducharme, n/a – International Justice Mission

Chair: Eileen Campbell, MDiv (she/her/hers) – International Justice Mission

Presenter: Vanessa Bautista, n/a – Global Survivor Network

Location: Room 202

Advocacy and Policy Change

10:15 AM – 11:15 AM ET

Generative Artificial Intelligence: Opportunities and Challenges for Evaluators

Presenter: Syed Latifi, PhD, MS, MEd. – Weill Cornell Medicine - Qatar

Author: Syed Latifi, PhD, MS, MEd. – Weill Cornell Medicine - Qatar

Facilitator: Syed Latifi, PhD, MS, MEd. – Weill Cornell Medicine - Qatar

Chair: Syed Latifi, PhD, MS, MEd. – Weill Cornell Medicine - Qatar

Author: Mark Healy, MSc. – Weill Cornell Medicine - Qatar

Facilitator: Mark Healy, MSc. – Weill Cornell Medicine - Qatar

Location: Grand Ballroom 8

Research, Technology & Development Evaluation

10:15 AM – 11:15 AM ET

Hidden stories: How can one-on-one client interactions be measured as organization-wide impacts?

Presenter: Brenna Butler, PhD (she/her/hers) – Penn State Extension

Presenter: Michael Hamel, PhD – Penn State Extension

Presenter: Matthew Spindler, PhD – Penn State Extension

Presenter: Malinda Suprise, MA – Penn State Extension

Location: Room 203

Extension Education Evaluation

10:15 AM – 11:15 AM ET

How Evaluation Commissioners shape, tell and receive the “evaluation story?”

Presenter: Tessie Catsambas, MPP – EnCompass LLC

Facilitator: Tessie Catsambas, MPP – EnCompass LLC

Chair: Tessie Catsambas, MPP – EnCompass LLC

Disscussant: Veronica Olazabal, Masters – BHP

Presenter: Huilan Krenn, Ph.D. – W.K. KELLOGG FOUNDATION

Presenter: Daniel Kidder, PhD – CDC

Disscussant: E. Jane Davidson, Ph.D. – Real Evaluation

Presenter: Marco Segone, MA – United Nations Population Fund (UNFPA)

Location: Room 102

Evaluation Managers and Supervisors

10:15 AM – 11:15 AM ET

Commissioning evaluation in a federal agency

Presenter: Daniel Kidder, PhD – CDC

10:15 AM – 11:15 AM ET

Commissioning evaluation in the foundation context

Presenter: Huilan Krenn, Ph.D. – W.K. KELLOGG FOUNDATION

10:15 AM – 11:15 AM ET

Commissioning evaluations in United Nations' agencies

Presenter: Marco Segone, MA – United Nations Population Fund (UNFPA)

10:15 AM – 11:15 AM ET

Evaluation manager's role in commissioning evaluations that matter

Presenter: Tessie Catsambas, MPP – EnCompass LLC

10:15 AM – 11:15 AM ET

Good practices and cautions for evaluation commissioners

Presenter: E. Jane Davidson, Ph.D. – Real Evaluation

10:15 AM – 11:15 AM ET

Implications for evaluation capacity building for evaluation commissioners

Presenter: Veronica Olazabal, Masters – BHP

10:15 AM – 11:15 AM ET

Pathways to Leadership: Stories about Relationships and Opportunities

Presenter: Mónica Ruiz-Casares, PhD – Toronto Metropolitan University

Presenter: Leslie J. Cooksy, PhD – Independent Consultant

Presenter: Maurice Samuels, PhD – Sierra Health Foundation

Presenter: Leslie Goodyear, PhD – Education Development Centre

Facilitator: Corrie Whitmore, PhD (she/her/hers) – University of Alaska Anchorage

Qualitative Methods

10:15 AM – 11:15 AM ET

Proving Promise and Support: Evaluation of Indiana Family Preservation Services

Presenter: Brian Goodwin, MA – Indiana Department of Child Services

Presenter: Allyson Dir, Ph.D., HSPP – Indiana University

Presenter: Ciana R. Sorrentino Wallace, MPA (she/her/hers) – Indiana Department of Child Services

Social Work

10:15 AM – 11:15 AM ET

Retelling the Stories of Regional and Community Foundations: Journeys in Centering Racial Equity

Facilitator: Leon Andrews, n/a – Equal Measure

Author: Seth Klukoff, n/a (he/him/his) – Equal Measure

Location: Grand Ballroom 7

Nonprofit and Foundations

10:15 AM – 11:15 AM ET

Revealing and Transmitting Prevention-Related Stories through the Georgia Prevention Data Hub

Chair: Jenna Gabrio, MPH – RTI International

Disscussant: Darigg Brown, PhD, MPH – RTI International

Presenter: Kirsty Weitzel, MS – RTI International

Presenter: Evan Bunnage, BS – RTI International

Presenter: Anna Godwin, MS – RTI International

Presenter: Rebecca Watkins, BS – RTI International

Author: Ian Thomas, BA – RTI International

Author: Chris Coxen, MS, BS – RTI International

Author: Malinda Gowin, MPH – Georgia Dept of Behavioral Health and Developmental Disabilities, Office of Behavioral Health Prevention and Federal Grants

Author: Donna Dent, MS, MISM, ICPS – Georgia Dept of Behavioral Health and Developmental Disabilities, Office of Behavioral Health Prevention and Federal Grants

Author: Jill Mays, LPC – Georgia Dept of Behavioral Health and Developmental Disabilities, Office of Behavioral Health Prevention and Federal Grants

Location: Grand Ballroom 3

Data Visualization and Reporting

Jenna Gabrio, MPH – RTI International ### 2044052###Chair###Research Public Health Analyst###RTI International###
Chair: Jenna Gabrio, MPH – RTI International
### @@@ Darigg Brown, PhD, MPH – RTI International ### 2044053###Disscussant###Behavioral Scientist and Program Manager###RTI International###
Disscussant: Darigg Brown, PhD, MPH – RTI International
### @@@ Kirsty Weitzel, MS – RTI International ### 2044054###Presenter###Research Data Scientist###RTI International###
Presenter: Kirsty Weitzel, MS – RTI International
### @@@ Evan Bunnage, BS – RTI International ### 2044055###Presenter###Software Applications Programmer/Analyst###RTI International###
Presenter: Evan Bunnage, BS – RTI International
### @@@ Anna Godwin, MS – RTI International ### 2044056###Presenter###Research Data Scientist###RTI International###
Presenter: Anna Godwin, MS – RTI International
### @@@ Rebecca Watkins, BS – RTI International ### 2044323###Presenter###Research Systems Programmer###RTI International###
Presenter: Rebecca Watkins, BS – RTI International
### @@@ Ian Thomas, BA – RTI International ### 2044324###Author###Research Data Scientist and Program Manager###RTI International###
Author: Ian Thomas, BA – RTI International
### @@@ Chris Coxen, MS, BS – RTI International ### 2044325###Author###Data Scientist###RTI International###
Author: Chris Coxen, MS, BS – RTI International
### @@@ Malinda Gowin, MPH – Georgia Dept of Behavioral Health and Developmental Disabilities, Office of Behavioral Health Prevention and Federal Grants ### 2044326###Author###Data Analyst###Georgia Dept of Behavioral Health and Developmental Disabilities, Office of Behavioral Health Prevention and Federal Grants###
Author: Malinda Gowin, MPH – Georgia Dept of Behavioral Health and Developmental Disabilities, Office of Behavioral Health Prevention and Federal Grants
### @@@ Donna Dent, MS, MISM, ICPS – Georgia Dept of Behavioral Health and Developmental Disabilities, Office of Behavioral Health Prevention and Federal Grants ### 2044327###Author###Assistant Director###Georgia Dept of Behavioral Health and Developmental Disabilities, Office of Behavioral Health Prevention and Federal Grants###
Author: Donna Dent, MS, MISM, ICPS – Georgia Dept of Behavioral Health and Developmental Disabilities, Office of Behavioral Health Prevention and Federal Grants
### @@@ Jill Mays, LPC – Georgia Dept of Behavioral Health and Developmental Disabilities, Office of Behavioral Health Prevention and Federal Grants ### 2044330###Author###Director###Georgia Dept of Behavioral Health and Developmental Disabilities, Office of Behavioral Health Prevention and Federal Grants###
Author: Jill Mays, LPC – Georgia Dept of Behavioral Health and Developmental Disabilities, Office of Behavioral Health Prevention and Federal Grants
###

10:15 AM – 11:15 AM ET

Co-author for all panel presentations

Presenter: Ian Thomas, BA – RTI International

Presenter: Chris Coxen, MS, BS – RTI International

Presenter: Malinda Gowin, MPH – Georgia Dept of Behavioral Health and Developmental Disabilities, Office of Behavioral Health Prevention and Federal Grants

Presenter: Donna Dent, MS, MISM, ICPS – Georgia Dept of Behavioral Health and Developmental Disabilities, Office of Behavioral Health Prevention and Federal Grants

Presenter: Jill Mays, LPC – Georgia Dept of Behavioral Health and Developmental Disabilities, Office of Behavioral Health Prevention and Federal Grants

10:15 AM – 11:15 AM ET

Designing and Constructing Data Visualization Tool to Reveal Stories

Presenter: Kirsty Weitzel, MS – RTI International

Presenter: Evan Bunnage, BS – RTI International

10:15 AM – 11:15 AM ET

Gathering and Synthesizing Data to Discover Stories

Presenter: Jenna Gabrio, MPH – RTI International

10:15 AM – 11:15 AM ET

Moderator

Presenter: Darigg Brown, PhD, MPH – RTI International

10:15 AM – 11:15 AM ET

Utilizing the Data Visualization Tool to Transmit Stories

Presenter: Anna Godwin, MS – RTI International

Presenter: Rebecca Watkins, BS – RTI International

10:15 AM – 11:15 AM ET

Rigorous stories: How Outcome Harvesting can be a tool for understanding when, where, why and how change happens

Chair: Abdoul Karim Coulibaly, n/a – Freelance

Presenter: Yulianto Dewata, n/a – Freelance

Presenter: Steve Powell, n/a – Causal Map Ltd

Location: White River Ballroom A

Collaborative, Participatory & Empowerment Evaluation

10:15 AM – 11:15 AM ET

Abdoul Karim is the chair, he would not have a presentation.

Presenter: Abdoul Karim Coulibaly, n/a – Freelance

10:15 AM – 11:15 AM ET

Using Outcome Harvesting Approach to Identify Project's Contributions to Regulatory Change in Education Sector (Indonesia case study)

Presenter: Yulianto Dewata, n/a – Freelance

10:15 AM – 11:15 AM ET

Stories within stories: Using participatory narrative inquiry to create community-engaged and relational evaluations

Presenter: Satlaj Dighe, Ph.D. – University of North Carolina Wilmington

Presenter: Trupti Sarode, MDP – University of Pittsburgh

Presenter: Katie Boone, MS (she/her/hers) – University of Minnesota

Location: Grand Ballroom 2

Collaborative, Participatory & Empowerment Evaluation

10:15 AM – 11:15 AM ET

The evaluation of the Community Leaders in Health Equity program: The power of participants’ voices.

Presenter: Mariana Enriquez, Ph.D. – Independent Consultant

Author: Mariana Enriquez, Ph.D. – Independent Consultant

Presenter: Clea Vannet, MPH – American Institutes for Research

Author: Clea Vannet, MPH – American Institutes for Research

Presenter: Raquel Sanchez, Ph.D. – American Institutes for Research

Author: Raquel Sanchez, Ph.D. – American Institutes for Research

Presenter: Miriam Estrada, M.A. – Independent Consultant

Author: Miriam Estrada, M.A. – Independent Consultant

Location: Room 201

Mixed Methods Evaluation

10:15 AM – 11:15 AM ET

The evaluation of the Community Leaders in Health Equity: Communities of practice.

Presenter: Raquel Sanchez, Ph.D. – American Institutes for Research

10:15 AM – 11:15 AM ET

The evaluation of the Community Leaders in Health Equity: Evolution of methodology

Presenter: Mariana Enriquez, Ph.D. – Independent Consultant

10:15 AM – 11:15 AM ET

The evaluation of the Community Leaders in Health Equity: Participant choice in qualitative data

Presenter: Clea Vannet, MPH – American Institutes for Research

10:15 AM – 11:15 AM ET

The evaluation of the Community Leaders in Health Equity: Participants' voices

Presenter: Miriam Estrada, M.A. – Independent Consultant

10:15 AM – 11:15 AM ET

The Evaluator’s Role in Transforming SEL in Service of Equity

Presenter: Katlin Brown, M.Ed. – L&G Research and Evaluation Consulting

Author: Christina Lopez, PhD – L&G Research & Evaluation Consulting

Location: White River Ballroom B

PreK-12 Educational Evaluation

10:15 AM – 11:15 AM ET

The Future(s) of LGBTQ+ Evaluation: A Call to All Evaluators

Presenter: Esrea Perez-Bill, n/a – Northwestern University

Presenter: Erik Elías Glenn, MSW – Northwestern University Feinberg School of Medicine, Department of Medical Social Sciences

Presenter: Gregory Phillips, II, PhD, MS (he/him/his) – Northwestern University

Author: Dylan Felt, MPH – Northwestern University Feinberg School of Medicine, Department of Medical Social Sciences

Location: Room 206

Lesbian, Gay Bisexual and Transgender Issues

10:15 AM – 11:15 AM ET

The Power of Evaluator Collaboration in Assessing Readiness for Change in Educational Capacity Building Efforts

Presenter: Cori Groth, Ph.D. – Utah Education Policy Center, University of Utah

Author: Cori Groth, Ph.D. – Utah Education Policy Center, University of Utah

Presenter: Sharon Herpin, PhD – WestEd

Author: Sharon Herpin, PhD – WestEd

Presenter: Steven Malick, M.P.A.P. (he/him/his) – Mathematica

Author: Steven Malick, M.P.A.P. (he/him/his) – Mathematica

Presenter: Grady Deacon

Location: Room 301

Cluster, Multi-site and Multi-level Evaluation

10:15 AM – 11:15 AM ET

The Power of Story in Organizations

Presenter: Darlene F. Russ Eft, PhD (she/her/hers) – Purdue Polytechnic, Purdue University

Author: Darlene F. Russ Eft, PhD (she/her/hers) – Purdue Polytechnic, Purdue University

Author: JB Jordan, n/a – Davenport University

Presenter: Brandon Grant, PhD (he/him/his) – Purdue Polytechnic, Purdue University

Author: Brandon Grant, PhD (he/him/his) – Purdue Polytechnic, Purdue University

Presenter: Valerie Ehrlich, n/a – Center for Creative Leadership

Author: Valerie Ehrlich, n/a – Center for Creative Leadership

Author: Judanne Lennox-Morrison, Master of Urban Planning (MUP) (she/her/hers) – Center for Creative Leadership

Author: Patti Phillips, PhD – ROI Institute

Disscussant: Patti Phillips, PhD – ROI Institute

Author: Michelle Schneider, n/a – Center for Creative Leadership

Presenter: Patti Phillips, PhD – ROI Institute

Location: Room 205

Leadership and Organizational Performance

Darlene F. Russ Eft, PhD (she/her/hers) – Purdue Polytechnic, Purdue University ### 2044363###Presenter###Clinical Faculty###Purdue Polytechnic, Purdue University###
Presenter: Darlene F. Russ Eft, PhD (she/her/hers) – Purdue Polytechnic, Purdue University
### she/her/hers @@@ Darlene F. Russ Eft, PhD (she/her/hers) – Purdue Polytechnic, Purdue University ### 2044363###Author###Clinical Faculty###Purdue Polytechnic, Purdue University###
Author: Darlene F. Russ Eft, PhD (she/her/hers) – Purdue Polytechnic, Purdue University
### she/her/hers @@@ JB Jordan, n/a – Davenport University ### 2044364###Author###Faculty###Davenport University###
Author: JB Jordan, n/a – Davenport University
### @@@ Brandon Grant, PhD (he/him/his) – Purdue Polytechnic, Purdue University ### 2044365###Presenter###Assistant Professor###Purdue Polytechnic, Purdue University###
Presenter: Brandon Grant, PhD (he/him/his) – Purdue Polytechnic, Purdue University
### he/him/his @@@ Brandon Grant, PhD (he/him/his) – Purdue Polytechnic, Purdue University ### 2044365###Author###Assistant Professor###Purdue Polytechnic, Purdue University###
Author: Brandon Grant, PhD (he/him/his) – Purdue Polytechnic, Purdue University
### he/him/his @@@ Valerie Ehrlich, n/a – Center for Creative Leadership ### 2044366###Presenter###Director, SI Insights###Center for Creative Leadership###
Presenter: Valerie Ehrlich, n/a – Center for Creative Leadership
### @@@ Valerie Ehrlich, n/a – Center for Creative Leadership ### 2044366###Author###Director, SI Insights###Center for Creative Leadership###
Author: Valerie Ehrlich, n/a – Center for Creative Leadership
### @@@ Judanne Lennox-Morrison, Master of Urban Planning (MUP) (she/her/hers) – Center for Creative Leadership ### 2044367###Author###Researcher###Center for Creative Leadership###
Author: Judanne Lennox-Morrison, Master of Urban Planning (MUP) (she/her/hers) – Center for Creative Leadership
### she/her/hers @@@ Patti Phillips, PhD – ROI Institute ### 2044368###Author###Chief Executive Officer###ROI Institute###
Author: Patti Phillips, PhD – ROI Institute
### @@@ Patti Phillips, PhD – ROI Institute ### 2044368###Disscussant###Chief Executive Officer###ROI Institute###
Disscussant: Patti Phillips, PhD – ROI Institute
### @@@ Michelle Schneider, n/a – Center for Creative Leadership ### 2044369###Author###Senior Evaluation Associate###Center for Creative Leadership###
Author: Michelle Schneider, n/a – Center for Creative Leadership
### @@@ Patti Phillips, PhD – ROI Institute ### 2044368###Presenter###Chief Executive Officer###ROI Institute###
Presenter: Patti Phillips, PhD – ROI Institute
###

10:15 AM – 11:15 AM ET

Co-author

Presenter: JB Jordan, n/a – Davenport University

10:15 AM – 11:15 AM ET

Co-author with V Ehrlich

Presenter: Michelle Schneider, n/a – Center for Creative Leadership

10:15 AM – 11:15 AM ET

Co-Author with V. Ehrlich

Presenter: Judanne Lennox-Morrison, Master of Urban Planning (MUP) (she/her/hers) – Center for Creative Leadership

10:15 AM – 11:15 AM ET

Evaluation in work-from-home settings

Presenter: Brandon Grant, n/a – Purdue Polytechnic, Purdue University

10:15 AM – 11:15 AM ET

Gathering stories in data collection, analysis, and presentation: Power of critical incidents

Presenter: Darlene F. Russ Eft, PhD (she/her/hers) – Purdue Polytechnic, Purdue University

10:15 AM – 11:15 AM ET

Stories and ROI

Presenter: Patti Phillips, PhD – ROI Institute

10:15 AM – 11:15 AM ET

Storytelling in equity, diversity, and inclusion (EDI) programs

Presenter: Valerie Ehrlich, n/a – Center for Creative Leadership

Presenter: Judanne Lennox-Morrison, Master of Urban Planning (MUP) (she/her/hers) – Center for Creative Leadership

10:15 AM – 11:15 AM ET

To adapt or not to adapt? Retaining quality when tailoring Outcome Harvesting

Presenter: Lauren Serpe – Pact

Facilitator: Lauren Serpe – Pact

Presenter: Karen Biesbrouck, n/a – Oxfam Novib

Presenter: Kyaw Thura Thun

Presenter: Tripti Pande, MScPH (she/her/hers) – Pact

Location: White River Ballroom C

Qualitative Methods

10:15 AM – 11:15 AM ET

Flexibility in Outcome Harvesting approaches: when do you draw the line?

Presenter: Chhork Boeurng, MDM – Pact

10:15 AM – 11:15 AM ET

Gain or Pain: Outcome Harvesting methodological flexibilities and its pitfalls in field implementation to draw a complete story of the project

Presenter: Thomas Mugala, n/a – Pact, ACHIEVE

10:15 AM – 11:15 AM ET

How far is too far when tailoring Outcome Harvesting? Reflections from an INGO's case study review

Presenter: Lauren Serpe – Pact

10:15 AM – 11:15 AM ET

Tailoring Outcome Harvesting to manage the risk of bias in risk mitigation procedures used in complex policy advocacy programs

Presenter: Karen Biesbrouck, n/a – Oxfam Novib

10:15 AM – 11:15 AM ET

Transforming Food Service Operations with the Model for Collaborative Evaluations: A Step-by-Step Guide for Enhancing Customer Loyalty

Presenter: Julie Chappell, M.A. – University of South Florida

Author: Julie Chappell, M.A. – University of South Florida

Presenter: Angad Dang, Ph.D. – University of South Florida

Author: Angad Dang, Ph.D. – University of South Florida

Author: Liliana Rodríguez -Campos, Ph.D. – University of South Florida

Location: White River Ballroom H

Collaborative, Participatory & Empowerment Evaluation

10:15 AM – 11:15 AM ET

Using a cognitive complexity framework as a tool for understanding and integrating AEA Evaluator Competencies

Facilitator: Susan Tucker, PhD – Evaluation & Development Associates LLC

Disscussant: Susan Tucker, PhD – Evaluation & Development Associates LLC

Presenter: Jennifer P. Villalobos, MA – Claremont Graduate University

Presenter: Minji Cho, n/a – Claremont Graduate University

Location: Room 204

Teaching of Evaluation

10:15 AM – 11:15 AM ET

Using Storytelling to Ground and Make Sense of Organizational Strategies and Frameworks: Experiences from Three Organizations

Presenter: Natalie Trisilla – International Republican Institute

Chair: Natalie Trisilla – International Republican Institute

Presenter: Anna Chukhno, n/a – IRI

Presenter: Adrienne Lemon, n/a – SFCG

Presenter: David Connolly, n/a – USIP

Location: Room 309/310

Democracy and Governance

10:15 AM – 11:15 AM ET

Finding the Right Narrative: Dilemmas in Strategy Evaluation

Presenter: David Connolly, n/a – USIP

10:15 AM – 11:15 AM ET

Putting Stories into Action: Using Storytelling to Develop and Implement IRI's Organization-wide Results

Presenter: Natalie Trisilla – International Republican Institute

Presenter: Anna Chukhno, n/a – IRI

10:15 AM – 11:15 AM ET

What's in a Framework? Shifting Stories About Peace and Who Gets to Tell Them

Presenter: Adrienne Lemon, n/a – SFCG

10:15 AM – 11:15 AM ET

What is impact? A discussion about how impact is defined and measured based on a federal agency’s mission.

Presenter: Amia Downes, DrPH (she/her/hers) – Centers for Disease Control and Prevention

Location: White River Ballroom I

Government Evaluation

10:15 AM – 11:15 AM ET

When Two are Better than One: Stories and Strategies to Build Your Business and Evaluation Capacity Through Partnership

Presenter: Amy E. Myrbo, Ph.D. – Amiable Consulting

Presenter: Jenna K. Sethi, PhD (she/her/hers) – Informed Change

Presenter: Clare L. Eisenberg, M.Ed. (she/her/hers) – Informed Change/Clare Eisenberg Consulting

Location: White River Ballroom D

Independent Consulting

10:15 AM – 11:15 AM ET

Why & How to Be a Journal Reviewer: Plus Announcement of the AJE Excellence in Reviewing Awards!

Presenter: Laura Peck, PhD – Abt Associates

Facilitator: Laura Peck, PhD – Abt Associates

Graduate Student and New Evaluators

10:15 AM – 11:15 AM ET

Words create Worlds: Using Appreciative Inquiry and the Power of Stories for Strategic Thinking

Presenter: Kathleen Dean, PhD – The Rucks Group

Presenter: Lyssa W. Becho, PhD – Western Michigan University

Location: Room 209

Program Design

10:15 AM – 11:15 AM ET

Tools and considerations of advocacy and policy evaluation for managing barriers and creating a path forward

Chair: Dawn Valentine

Location: White River Ballroom F

Advocacy and Policy Change

10:15 AM – 11:15 AM ET

Evaluating the Evolving and Complex Advocacy and Social Movement Stories of the Caregiver and Constituent-Led Efforts to Foster Child and Family Well-Being Initiative

Presenter: Jeanette Au, MDP – Creative Research Solutions

Author: Jeanette Au, MDP – Creative Research Solutions

Presenter: Keyondra Brooks, PhD – Creative Research Solutions

Author: Keyondra Brooks, PhD – Creative Research Solutions

Author: Miranda Yates, PhD – Robert Wood Johnson Foundation

Author: Zachariah Rabah, MS – Creative Research Solutions

Author: Nivedita Ranade, PhD – Creative Research Solutions

Author: Molly Matthews-Ewald, PhD (she/her/hers) – Creative Research Solutions

Author: Seth Borgos, n/a – Community Change

Advocacy and Policy Change

10:15 AM – 11:15 AM ET

USING SMALL-WINS FRAMEWORK AND CONTRIBUTION ANALYSIS FOR IMPACT STORY TELLING OF A POLICY ADVOCACY EVALUATION

Presenter: Dharmendra Chandurkar, MPA (he/him/his) – Sambodhi Research and Communications Pvt. Ltd.

Author: Dharmendra Chandurkar, MPA (he/him/his) – Sambodhi Research and Communications Pvt. Ltd.

Advocacy and Policy Change

10:15 AM – 11:15 AM ET

'WHOSE AGENDA IS IT?': REFRAMING EQUITY AND JUSTICE IN EVALUATION IN AFRICA

Presenter: Samukelisiwe Mkhize, SN – Centre for Learning on Evaluations and Results Anglophone Africa (CLEAR-AA)

Author: Samukelisiwe Mkhize, SN – Centre for Learning on Evaluations and Results Anglophone Africa (CLEAR-AA)

Advocacy and Policy Change

10:15 AM – 11:15 AM ET

Stories to Challenge the Evaluation Practice

Chair: Christine Liboon

Location: Grand Ballroom 1

Graduate Student and New Evaluators

10:15 AM – 11:15 AM ET

A Day in the Life of an Agricultural Professional: Telling Stories From the Images Drawn by Middle and High School-Aged Youth

Presenter: Sarah Dodoo, MS (she/her/hers) – University of Illinois at Urbana-Champaign

Author: Amy M. Leman, MPA, DPA (she/her/hers) – University of Illinois at Urbana-Champaign

Author: Ruth Kaggwa, n/a – Donald Danforth Plant Science Center

Author: Kristine Callis-Duehl, PhD (she/her/hers) – Donald Danforth Plant Science Center

Author: Lisa Walsh, PhD (she/her/hers) – Donald Danforth Plant Science Center

Graduate Student and New Evaluators

10:15 AM – 11:15 AM ET

A Story that Contextualizes and Debunks the “Malicious Compliance” Culture in Africa’s Evaluation Practice

Presenter: Dickson Otieno (he/him/his) – Virginia Tech

Author: Thomas Archibald, PhD (he/him/his) – Virginia Tech

Graduate Student and New Evaluators

10:15 AM – 11:15 AM ET

Application of Weight and Sum Methodology to Product Evaluations: Key Lessons Learned

Presenter: Laura Carroll, Masters in Educational Psychology (she/her/hers) – Andrew University

Presenter: Adedayo Adeyeye, n/a – Western Michigan University

Presenter: Marie Djeni, MA, MBA (she/her/hers) – Western Michigan University

Presenter: Tongriang Daspan, n/a – Western Michigan University

Presenter: Ernest Amoateng, n/a – Western Michigan University

Graduate Student and New Evaluators

10:15 AM – 11:15 AM ET

Using Participatory evaluation as a framework for evaluation planning and implementation to improve data communication

Presenter: Xi Wang, n/a – The University of Iowa

Author: Xi Wang, n/a – The University of Iowa

Author: Reuben Vyn, n/a – The University of Iowa

Author: Asih Asikin-Garmager, Ph.D. – University of Iowa Center for Evaluation and Assessment

Graduate Student and New Evaluators

10:15 AM – 11:15 AM ET

Collaborative Evaluation: Succeses, Challenges, and Lessons Learned

Chair: Connie Walker

Location: Grand Ballroom 4

Collaborative, Participatory & Empowerment Evaluation

10:15 AM – 11:15 AM ET

Social Determinants of Health: Applying Leading, National Frameworks to Construct a Story of Place

Presenter: Cheryl Arndt, PhD – Leonard Parker Pool Institute for Health

Author: Samantha Shaak, PhD – Leonard Parker Pool Institute for Health

Author: Cheryl Arndt, PhD – Leonard Parker Pool Institute for Health

Collaborative, Participatory & Empowerment Evaluation

10:15 AM – 11:15 AM ET

Straight from the Community: Stories about Building Collective Impact in Colorado

Presenter: Kaitlynn Walton, MPH – Colorado School of Public Health

Author: Kaitlynn Walton, MPH – Colorado School of Public Health

Author: Kaitlyn Jones, MPH, MSW – University of Colorado

Author: Sophie Dila, MA – Colorado School of Public Health

Author: Erin Kelly, DrPH, MA (she/her/hers) – Injury and Violence Prevention Center, Colorado School of Public Health

Author: Marc Morgan, BA – Colorado Department of Public Health and Environment

Collaborative, Participatory & Empowerment Evaluation

10:15 AM – 11:15 AM ET

The Value of Collaborative Partnerships to Develop a System and Continuum of Care for At Risk Families

Presenter: Connie Walker-Egea, PhD – University of South Florida

Author: Connie Walker-Egea, PhD – University of South Florida

Author: Linda Callejas, PhD – University of South Florida

Presenter: Svetlana Yampolskaya, PhD – University of South Florida

Author: Svetlana Yampolskaya, PhD – University of South Florida

Collaborative, Participatory & Empowerment Evaluation

11:30 AM – 12:30 PM ET

A story of MSC implementation and capturing marginalized voices–-learnings based on various phases of MSC

Facilitator: Sarya Sok, n/a – State Department, Bureau of Democracy, Human Rights, and Labor; Office of Global Programs

Presenter: Theophilus Odaudu, n/a – Disability Rights Fund

Presenter: Nikki Junker, PhD – State Department

Disscussant: Giovanni Dazzo, PhD – University of Georgia

Location: Room 202

Disabilities and Underrepresented Populations

11:30 AM – 12:30 PM ET

A story of MSC implementation and capturing marginalized voices–discussant

Presenter: Giovanni Dazzo, PhD – University of Georgia

11:30 AM – 12:30 PM ET

A story of MSC implementation and capturing marginalized voices–facilitator

Presenter: Sarya Sok, n/a – State Department, Bureau of Democracy, Human Rights, and Labor; Office of Global Programs

11:30 AM – 12:30 PM ET

Clues to Marginalized Population Impact: A Case of MSC in Nigeria

Presenter: Nikki Junker, PhD – State Department

11:30 AM – 12:30 PM ET

Marginalized Voices and Most Significant Change: Early Lessons Learned from Intentional Design

Presenter: Theophilus Odaudu, n/a – Disability Rights Fund

Presenter: Melanie Kawano-Chiu, MA (she/her/hers) – Disability Rights Fund/Disability Rights Advocacy Fund

11:30 AM – 12:30 PM ET

Beyond Traditional Exams: Alternative Evaluation Methods of Student Learning in Statistics Courses

Presenter: Li-Ting Chen, PhD – University of Nevada Reno

Author: Li-Ting Chen, PhD – University of Nevada Reno

Location: Room 301

Assessment in Higher Education

11:30 AM – 12:30 PM ET

Building Evaluation Capacity to Tell a Foundation’s Story of Systems Change

Presenter: Margaret B. Hargreaves, M.P.P. – NORC at the University of Chicago

Presenter: Freya Bradford, n/a – Rotary Charities of Traverse City

Disscussant: Brandon Coffee-Borden, MPP – NORC at the University of Chicago

Location: Room 104

Organizational Learning & Evaluation Capacity Building

11:30 AM – 12:30 PM ET

Reflection and Discussion on Building Evaluation Capacity to Tell a Foundation's Story of Systems Change

Presenter: Brandon Coffee-Borden, MPP – NORC at the University of Chicago

11:30 AM – 12:30 PM ET

Telling the Story of Systems Change – the Evaluator's Perspective

Presenter: Margaret B. Hargreaves, M.P.P. – NORC at the University of Chicago

11:30 AM – 12:30 PM ET

Telling the Story of Systems Change – the Foundation's Perspective

Presenter: Freya Bradford, n/a – Rotary Charities of Traverse City

11:30 AM – 12:30 PM ET

Can evaluation go beyond storytelling? How Developmental Evaluations are working to become part of the story.

Presenter: Heather Esper, MPH – William Davidson Institute at the University of Michigan

Presenter: Dani de Garcia (she/her/hers) – Social Impact

Presenter: Chris Thompson, MPA – Social Impact

Location: Room 102

Use and Influence of Evaluation

11:30 AM – 12:30 PM ET

Conceptualizing Agents, Actions, and Environments in Complex Systems Change: A Storied Approach

Presenter: Kirsten Kainz, PHD (she/her/hers) – self-employed

Author: Kirsten Kainz, PHD (she/her/hers) – self-employed

Facilitator: Kirsten Kainz, PHD (she/her/hers) – self-employed

Presenter: Kathleen (Kate) C. Gallagher, PHD – Buffett Early Childhood Institute

Author: Kathleen (Kate) C. Gallagher, PHD – Buffett Early Childhood Institute

Facilitator: Kathleen (Kate) C. Gallagher, PHD – Buffett Early Childhood Institute

Location: Room 103

Systems in Evaluation

11:30 AM – 12:30 PM ET

Creative Ways to Solicit Feedback - Equitably and Inclusively

Facilitator: Taylor B. Anderson, MS (she/her/hers) – Public Profit

Presenter: Sylvia Kwon, PhD (she/her/hers) – Public Profit

Location: Room 203

Mixed Methods Evaluation

11:30 AM – 12:20 PM ET

Culturally Responsive Evaluation: Translating Theory into Practice

Graduate Student and New Evaluators

11:30 AM – 12:30 PM ET

Down the Rabbit Hole, But Gently: How to Make Better Decisions about Responding to a Request for Proposals

Presenter: Kathleen Sullivan, JD – Fine Gauge Strategy LLC

Location: Room 201

Independent Consulting

11:30 AM – 12:30 PM ET

Evaluation of Ohio Healthcare Professionals’ Pandemic-Related Stressors, Change in Burnout Symptoms, and Help-Seeking Behaviors and Concerns

Presenter: Gretchen Clark Hammond, PhD, MSW, LSW, LCDCIII, TTS – Mighty Crow Media, LLC

Presenter: Rebecca McCloskey, PhD, MSW, LISW-S – Mighty Crow Media, LLC

Presenter: Brieanne Beaujolais, PhD, MSW, MA, LSW – Mighty Crow Media, LLC

Location: Room 205

Behavioral Health

11:30 AM – 12:30 PM ET

Evaluation of Ohio healthcare professionals' pandemic-related help-seeking behaviors and concerns

Presenter: Brieanne Beaujolais, PhD, MSW, MA, LSW – Mighty Crow Media, LLC

11:30 AM – 12:30 PM ET

Ohio healthcare professionals' survey: Work and home stressors during the COVID-19 pandemic

Presenter: Gretchen Clark Hammond, PhD, MSW, LSW, LCDCIII, TTS – Mighty Crow Media, LLC

11:30 AM – 12:30 PM ET

Ohio physicians' retrospective pre-post COVID-19 pandemic reports of burnout and well-being

Presenter: Rebecca McCloskey, PhD, MSW, LISW-S – Mighty Crow Media, LLC

11:30 AM – 12:30 PM ET

Evaluation’s Story in Fable and Song: Greatest Hits Over Five Decades

Presenter: Michael Q. Patton, PhD (he/him/his) – Utilization-Focused Evaluation

Location: Grand Ballroom 5/6

Teaching of Evaluation

11:30 AM – 12:30 PM ET

Exploring the Promise & Pitfalls of PowerBI to Generate Data Dashboards for Evaluation Storytelling

Presenter: Sara T. Stacy, PhD (she/her/hers) – University of Cincinnati Evaluation Services Center

Presenter: Keren Mabisi, MGS – University of Cincinnati Evaluation Services Center

Location: Grand Ballroom 10

Data Visualization and Reporting

11:30 AM – 12:30 PM ET

Final Presentations from a Year of GEDI Learning and Light II

11:30 AM – 12:30 PM ET

How Policy Supports Storytelling: Developing Data Governance Policies to Support and Strengthen Data Collection Activities

Presenter: Mary Ann Aabye (she/her/hers) – U.S. Department of State

Facilitator: Mary Ann Aabye (she/her/hers) – U.S. Department of State

Presenter: Marie-Ellen Ehounou, n/a (she/her/hers) – U.S. Department of State

Facilitator: Marie-Ellen Ehounou, n/a (she/her/hers) – U.S. Department of State

Presenter: Nicole Germano (she/her/hers) – U.S. Department of State

Facilitator: Nicole Germano (she/her/hers) – U.S. Department of State

Location: Room 105

Evaluation Policy

11:30 AM – 12:30 PM ET

Making Meaning with and about Youth’s Stories: Participatory Activities to Integrate Youth Voice & Choice to Design, Evaluate, and Plan more Equitable College and Career Readiness Programs

Presenter: Julie Poncelet, n/a – @ the Corner of Learning & Action

Presenter: Dee Chambliss, n/a – NAF

Location: Room 206

College Access Programs

11:30 AM – 12:30 PM ET

Navigating Research and Evaluation in STEM Projects by Shifting Focus in the Framing, Forming, and Telling of Stories

Presenter: Christopher Cox, PhD – The Rucks Group, LLC

Location: Room 208

STEM Education and Training

11:30 AM – 12:30 PM ET

Reframing rigor: evaluation practitioner perspectives on tradeoffs and transformations

Presenter: Alysson Akiko A. Oakley, PhD (she/her/hers) – Pact

Presenter: Kate Krueger, n/a – Pact

Presenter: Giovanni Dazzo, PhD – University of Georgia

Presenter: Bret Barrowman, PhD – IRI

Location: Room 204

Research on Evaluation

11:30 AM – 12:30 PM ET

Conceptualizing rigor across paradigms and into the practical

Presenter: Alysson Akiko A. Oakley, PhD (she/her/hers) – Pact

11:30 AM – 12:30 PM ET

Debating rigor through a framework of shared objectives and tradeoffs

Presenter: Kate Krueger, n/a – Pact

Presenter: Giovanni Dazzo, PhD – University of Georgia

Presenter: Bret Barrowman, PhD – IRI

11:30 AM – 12:30 PM ET

Stories are more than 'just anecdotes': decolonizing learning in feminist funds

Author: Clara Desalvo, Master in Public Policy (she/her/hers) – FRIDA The Young Feminist Fund

Author: Shama Dossa, Doctor of Philosophy – Fenomenal Funds

Author: Boikanyo Modungwa, Master of Philosophy – Purposeful

Location: Room 309/310

Nonprofit and Foundations

11:30 AM – 12:30 PM ET

Stories from the People: Facilitating Community Engagement through Innovative Participatory Approaches

Chair: Rajib Nandi, Development Scholar and Evaluator – Community of Evaluators - South Asia

Presenter: Madri S. Jansen van Rensburg, PhD Consulting Psychology (she/her/hers) – Resilience Analysis Consulting

Presenter: Vikas Choudhry, Public Health Specialist – Sambodhi Research and communications

Presenter: Neeta Goel, Evaluation Expert (she/her/hers) – Bill and Melinda Gates Foundation

Location: Grand Ballroom 4

Collaborative, Participatory & Empowerment Evaluation

11:30 AM – 12:30 PM ET

Applying a participatory approach for improving Respectful Maternity Care at public health facilities in India

Presenter: Vikas Choudhry, Public Health Specialist – Sambodhi Research and communications

11:30 AM – 12:30 PM ET

Facilitating community engagement and democratizing evaluation through innovative participatory approaches

Presenter: Rajib Nandi, Development Scholar and Evaluator – Community of Evaluators - South Asia

11:30 AM – 12:30 PM ET

Participation in Evaluation processes: unpacking the role of the Evaluation professional

Presenter: Rituu B Nanda, Evaluator – Global Fund for Children

11:30 AM – 12:30 PM ET

Using visual stories to enable hearing

Presenter: Madri S. Jansen van Rensburg, PhD Consulting Psychology (she/her/hers) – Resilience Analysis Consulting

11:30 AM – 12:30 PM ET

Stories of Change: Using Most Significant Change in Final Program Evaluation of Girls Education in Mali, West Africa

Facilitator: Ashley Bishop, M.S. in Measurement & Evaluation – Winrock International

Presenter: Drew Schmenner, M.A. International/Global Studies – School-to-School International

Presenter: Brenda Sinclair, PhD in Education – Winrock International

Presenter: Safal Khatri, M.A. Applied Developmental Psychology, M.Ed. Educational Assessment, Testing and Measurement – Winrock International

Location: White River Ballroom G

International and Cross Cultural Evaluation

11:30 AM – 12:30 PM ET

How Winrock International Learned from Girls' Stories: Education Department

Presenter: Brenda Sinclair, PhD in Education – Winrock International

11:30 AM – 12:30 PM ET

How Winrock International Learned from Girls' Stories: Evaluation Department

Presenter: Safal Khatri, M.A. Applied Developmental Psychology, M.Ed. Educational Assessment, Testing and Measurement – Winrock International

11:30 AM – 12:30 PM ET

Overall Evaluation Findings and Stories

Presenter: Abou Coulibaly, n/a – Winrock International

11:30 AM – 12:30 PM ET

Overview of the Evaluation Process

Presenter: Ashley Bishop, M.S. in Measurement & Evaluation – Winrock International

11:30 AM – 12:30 PM ET

Use of Most Significant Change in Final Evaluation

Presenter: Drew Schmenner, M.A. International/Global Studies – School-to-School International

11:30 AM – 12:20 PM ET

Stories of Collaboration: A Conversation among a Funded Partner, Evaluator, and Funder about using Participatory Methods in Evaluation

Collaborative, Participatory & Empowerment Evaluation

11:30 AM – 12:30 PM ET

Guided discussion

Presenter: Maurice Samuels, PhD – Sierra Health Foundation

11:30 AM – 12:30 PM ET

Supporting our partners to tell their story

Presenter: Madeline Sabatoni, MPA (she/her/hers) – Sierra Health Foundation/The Center

11:30 AM – 12:30 PM ET

The power of story through participatory evaluation and culturally responsive practices

Presenter: Noemi Avalos, MPH – Sierra Health Foundation/The Center

Presenter: Maurice Samuels, PhD – Sierra Health Foundation

11:30 AM – 12:30 PM ET

Using Photovoice and engaging in participatory evaluation to uplift the stories from the community.

Presenter: Romala Ramkissoon, MBA – Dignity Health

11:30 AM – 12:30 PM ET

Stories of Decolonizing Evaluation Practice

Presenter: Minji Cho, n/a – Claremont Graduate University

Location: Room 209

Indigenous Peoples in Evaluation

11:30 AM – 12:30 PM ET

Stories of Possibilities

Presenter: Norma Kok, Masters Degree in Public Health – Citizen Leader Lab

Author: Diemo Masuko, n/a – Citizen Leader Lab

Author: Thandokazi Dlongwana, n/a – Citizen Leader Lab

Location: White River Ballroom B

Internal Evaluation

11:30 AM – 12:30 PM ET

Telling a tale of tech and health system partnerships: lessons learned and opportunities for the future

Presenter: Maggie Jones, MPH – Center for Community Health and Evaluation, Kaiser Permanente Washington Health Research Institute

Presenter: Elena Kuo, PhD (she/her/hers) – Center for Community Health and Evaluation, Kaiser Permanente Washington Health Research Institute

Location: White River Ballroom H

Health Evaluation

11:30 AM – 12:30 PM ET

Addressing social needs: lessons from an evaluation of the implementation of a large-scale social health referral platform

Presenter: Maggie Jones, MPH – Center for Community Health and Evaluation, Kaiser Permanente Washington Health Research Institute

11:30 AM – 12:30 PM ET

Navigation to improve health equity in birth outcomes: lessons from an evaluation of the implementation of a text-based navigation program at a large health system

Presenter: Elena Kuo, PhD (she/her/hers) – Center for Community Health and Evaluation, Kaiser Permanente Washington Health Research Institute

11:30 AM – 12:30 PM ET

Turning the Page on Impact Evaluations: The Story of What Went Wrong and an Untapped Potential

Presenter: Adam Trowbridge, MIDP – U.S. Department of State & USAID

Presenter: Keith B. Ives, MIDP (he/him/his) – Causal Design

Location: White River Ballroom A

Use and Influence of Evaluation

11:30 AM – 12:30 PM ET

Joint presentation

Presenter: Adam Trowbridge, MIDP – U.S. Department of State & USAID

Presenter: Keith B. Ives, MIDP (he/him/his) – Causal Design

11:30 AM – 12:30 PM ET

Utility of Photovoice and HIV Behavioral Surveillance Data to Inform a Health Education Intervention for Black Churches in the U.S. South

Presenter: Latrice C. Pichon, PhD, MPH, CHES – The University of Memphis School of Public Health

Author: Reighan E. Diehl, MPH – The University of Memphis School of Public Health

Author: Andrea Stubbs, MPA – The University of Memphis School of Public Health

Author: Headliners Memphis, BA – Grassroots Organization

Author: Meredith Brantley, PhD – formerly TDH

Author: Michelle Teti, DrPH, MPH – Department of Public Health, University of Missouri

Location: White River Ballroom C

Collaborative, Participatory & Empowerment Evaluation

11:30 AM – 12:30 PM ET

Nurturing cultural practices of Black & African Evaluation Consultants

Chair: Mindelyn Anderson

Location: Grand Ballroom 1

Independent Consulting

11:30 AM – 12:30 PM ET

Healing The Measures of Black Folks: Embracing a Duboisian Approach of Care for Black Evaluators

Presenter: monique inez liston, PhD – UBUNTU Research and Evaluation

Author: monique inez liston, PhD – UBUNTU Research and Evaluation

Independent Consulting

11:30 AM – 12:30 PM ET

The Evaluation Marketplace and Entrepreneurship in Africa: A Literature Review

Presenter: Nicolas Uwitonze, n/a – Department of Agriculture Leadership and Community Education, Virginia Tech

Author: Nicolas Uwitonze, n/a – Department of Agriculture Leadership and Community Education, Virginia Tech

Chair: Nicolas Uwitonze, n/a – Department of Agriculture Leadership and Community Education, Virginia Tech

Author: Bolanle Adebayo, n/a – Department of Agriculture Leadership and Community Education, Virginia Tech

Presenter: Thomas Archibald, PhD (he/him/his) – Virginia Tech

Author: Thomas Archibald, PhD (he/him/his) – Virginia Tech

Independent Consulting

11:30 AM – 12:30 PM ET

Integrating Stories in the Evaluation of Global Health Programs

Chair: Karen Kun

Location: White River Ballroom F

Health Evaluation

11:30 AM – 12:30 PM ET

Programa Saúde na Escola: modeling a national health and education intervention in Brazil

Presenter: Gisela Cordeiro Pereira Cardoso, Professor – ENSP/FIOCRUZ

Author: Gisela Cordeiro Pereira Cardoso, Professor – ENSP/FIOCRUZ

Author: Egléubia A. Oliveira, n/a – ENSP/Fiocruz

Author: Beatriz C. Soares, n/a – ENSP/Fiocruz

Author: Luciana S. Koptcke, n/a – Fiocruz-DF

Author: Alexandro R. Pinto, n/a – Fiocruz-DF

Health Evaluation

11:30 AM – 12:30 PM ET

Title: Building a youth focused conceptualisation of “empowerment” with adolescent girls within the context of sexual and reproductive health: a qualitative study in Nigeria and Tanzania

Presenter: Isabel Quilter, n/a – Itad

Author: Isabel Quilter, n/a – Itad

Presenter: Morenike Ukpong, n/a – Obafemi Awolowo University

Author: Morenike Ukpong, n/a – Obafemi Awolowo University

Health Evaluation

11:30 AM – 12:30 PM ET

Translating Well-Being Data to Elucidate Workers’ Stories in Global Supply Chain Decision-Making: Evidence from Six Years, Eight Countries, and 15,000+ Respondents

Presenter: Eileen McNeely, PhD, MS, RNC – Harvard University

Presenter: Bryn Philibert, Masters in International Affairs – Manaus, LLC

Presenter: Nidhi Ghildayal, PhD, MPH – Harvard University

Presenter: Joanna Valle Luna, Masters in International Affairs – Manaus, LLC

Health Evaluation

11:30 AM – 12:30 PM ET

USAID Multi Sectoral Nutrition Strategy 2nd Periodic Assessment

Presenter: Caitlin Showalter, MSGH (she/her/hers) – Palladium

Author: Rae Galloway, MS – Self

Author: Lauren Morris, PhD – Palladium

Health Evaluation

11:30 AM – 12:30 PM ET

The Power of Youth Stories: Shaping Healing and Empowerment Journeys in US and Globally

Chair: Julie Poncelet, n/a – @ the Corner of Learning & Action

Location: Grand Ballroom 8

Youth Focused Evaluation

11:30 AM – 12:30 PM ET

BREAKAWAY: The generative power of story for deep learning and youth empowerment

Presenter: Hua Wang, PhD – University at Buffalo, the State University of New York

Youth Focused Evaluation

11:30 AM – 12:30 PM ET

Equipping Youth to share their Stories: Building Evaluation Capacity in Minnesota 4-H'ers

Presenter: John N. Murray, MA, HSDP (he/him/his) – University of Minnesota Extension

Youth Focused Evaluation

11:30 AM – 12:30 PM ET

Restor(y)ing Well-Being: An Evaluation of Culturally Relevant Healing Practices for Youth of Color

Presenter: Oscar Cerna, M.Ed – Flourish Agenda

Author: Oscar Cerna, M.Ed – Flourish Agenda

Youth Focused Evaluation

11:30 AM – 12:30 PM ET

Evaluation Amid Emergency, Disaster, and Conflict

Chair: Catherine M. Denial, MS – Dartmouth Center for Program Design and Evaluation

Location: Grand Ballroom 3

Disaster & Emergency Management Evaluation

11:30 AM – 12:30 PM ET

Evaluating in conflict and fragile settings: A West African Case study

Presenter: OUSSENI KINDA, OK – Norwegian Refugee Council

Disaster & Emergency Management Evaluation

11:30 AM – 12:30 PM ET

Evaluations in crisis and conflict settings: Operational, Ethical, and Methodological Implications

Chair: Ghazia Aslam, PhD – EnCompass LLC

Facilitator: Gayatri Malhotra, MPH – EnCompass LLC

Facilitator: Lauren Else, n/a – EnCompass LLC

Disaster & Emergency Management Evaluation

11:30 AM – 12:30 PM ET

Integrating System Thinking Models and Data Analytics for Disaster and Emergency Management Evaluation

Presenter: Arshee Rizvi, n/a – WinLighter

Author: Arshee Rizvi, n/a – WinLighter

Author: Farheen Rizvi, n/a – WinLighter

Author: Yatin Diwakar (he/him/his) – Indian Institute of Technology Bombay

Disaster & Emergency Management Evaluation

11:30 AM – 12:30 PM ET

Lessons Learnt from Applying the Centers for Disease Control and Prevention (CDC) Evaluation Framework to the Measles Incident Management System Response

Presenter: Sara Blough, MPH (she/her/hers) – Centers for Disease Control and Prevention (CDC)

Disaster & Emergency Management Evaluation

11:30 AM – 12:30 PM ET

The Power of Story to Uncover Power Dynamics and Marginalization: Evaluators Efforts to Diversity STEM Education

Chair: Angelicque Tucker Blackmon, Ph.D

Location: Grand Ballroom 9

STEM Education and Training

11:30 AM – 12:30 PM ET

A Story of Victory and Challenge in Strides Toward Equitable Success: What We Learned from Our National Evaluation of an Initiative Supporting Black, Indigenous, and Latina/o/e STEM Doctoral Students

Presenter: Tashera Gale, PhD – Higher Ed Insight

Presenter: Donté McGuire, MEd – Higher Ed Insight

STEM Education and Training

11:30 AM – 12:30 PM ET

Diversifying the STEM Workforce in Philadelphia: The Use and Value of Stories as an Ecologically valid approach to program evaluation

Author: Destiny Samuel, n/a – AnLar

Presenter: Kristin Gagnier, Ph.D – AnLar

Author: Kristin Gagnier, Ph.D – AnLar

Author: Melissa Kurman, MS (she/her/hers) – University City Science Center

Presenter: Ashli-Ann Douglas, Ph.D – Vanderbilt University

Author: Ashli-Ann Douglas, Ph.D – Vanderbilt University

Author: Phil Brooks, n/a – University City Science Center

Author: Felica D. Jones (she/her/hers) – University City Science Center

Presenter: Felica D. Jones (she/her/hers) – University City Science Center

Presenter: Tiffany Copeland

STEM Education and Training

11:30 AM – 12:30 PM ET

Postcolonial Analysis of the Role of MSIs in a Large-Scale STEM Collaboration

Presenter: Courtney Stone, MEd – Arizona State University

Presenter: Caitlin Albrechtsen, MA, MEd – Arizona State University

STEM Education and Training

11:30 AM – 12:30 PM ET

The Challenging Story of Assessing Mathematics Teachers' Growth: Evaluating the North Carolina Master Mathematics Teacher Fellows Program

Presenter: Jamie Gillespie, PhD in Educational Research and Policy Analysis (she/her/hers) – The Friday Institute for Educational Innovation, NC State

Author: Jamie Gillespie, PhD in Educational Research and Policy Analysis (she/her/hers) – The Friday Institute for Educational Innovation, NC State

STEM Education and Training

11:30 AM – 12:30 PM ET

Measuring Factors: Compex Analytical Approaches as Building Bricks of the Story

Chair: Karen H. Larwin, PHD – Youngstown State University

Location: Grand Ballroom 2

Quantitative Methods: Theory and Design

11:30 AM – 12:30 PM ET

Latent Class Analysis (LCA): Caregivers’ Stories, Perceptions, and Concerns

Presenter: Svetlana Yampolskaya, PhD – University of South Florida

Author: Connie Walker-Egea, PhD – University of South Florida

Author: Linda Callejas, PhD – University of South Florida

Quantitative Methods: Theory and Design

11:30 AM – 12:30 PM ET

Structural After Measurement Estimation of higher order and (non)linear in n-level Structural Equation Models

Presenter: Ben Kelcey, Quantitative Methods – University of Cinicnnati

Author: Ben Kelcey, Quantitative Methods – University of Cinicnnati

Author: Fangxing Bai, n/a – University of Cinicinnati

Author: Amota Ataneka, M.A. – University of Cincinnati

Quantitative Methods: Theory and Design

1:00 PM – 2:00 PM ET

1 - Brainstorm Ways to Present Student Risky Behavior Survey Results to Stakeholders as Well as Discouraging Parental Opt-Outs of Child's Participation

Presenter: Susan Saka, MEd (she/her/hers) – University of Hawai‘i at Mānoa

Location: White River Ballroom E

PreK-12 Educational Evaluation

1:00 PM – 2:00 PM ET

2 - CTSA Evaluators Unique Role in Advancing Translational Science through the Research Unit Network (RUN)

Presenter: Maran Subramain, Ph.D. – University of Iowa

Presenter: Alejandro Comellas, MD – University of Iowa

Presenter: Patrick Barlow, Ph.D. – University of Iowa

Location: White River Ballroom E

Translational Research Evaluation

1:00 PM – 2:00 PM ET

3 - Cultivating Capacity for Evaluation

Presenter: Tanha Patel, MPH (she/her/hers) – CDC Foundation

Facilitator: Tanha Patel, MPH (she/her/hers) – CDC Foundation

Presenter: Sarah Myer, MPH, MCHES – Cultivate Capacity LLC

Facilitator: Sarah Myer, MPH, MCHES – Cultivate Capacity LLC

Location: White River Ballroom E

Organizational Learning & Evaluation Capacity Building

1:00 PM – 2:00 PM ET

4 - Evaluation and personal story: Why incorporating individuals’ experiences is key to improving modern evaluation methodology

Presenter: Dianna Cazarez, MS (she/her/hers) – WestEd

Author: Dianna Cazarez, MS (she/her/hers) – WestEd

Author: Kimberly Nguyen, n/a – WestEd

Location: White River Ballroom E

Disabilities and Underrepresented Populations

1:00 PM – 2:00 PM ET

5 - Evaluation Anthropology Networking Session

Presenter: Eve C. Pinsker, PhD – University of Illinois at Chicago School of Public Health

Facilitator: Eve C. Pinsker, PhD – University of Illinois at Chicago School of Public Health

Facilitator: Kim Falk, n/a – Allegheny County Dept of Human Services

Location: White River Ballroom E

Collaborative, Participatory & Empowerment Evaluation

1:00 PM – 2:00 PM ET

6 - Evaluation of Disparate Initiatives with Common Funding Streams

Presenter: Natalie B. Wilson, MPA (she/her/hers) – West Virginia University Health Affairs Institute

Presenter: Edis Osmanovic, MHA (he/him/his) – West Virginia University Health Affairs Institute

Author: Jayne Harris Esposito, MPH – West Virginia University Health Affairs Institute

Author: Thomas Bias, PhD, MA – West Virginia University Health Affairs Institute

Location: White River Ballroom E

Cluster, Multi-site and Multi-level Evaluation

1:00 PM – 2:00 PM ET

7 - Feeding Two Birds with One Crumb: Sharing your story with what you got

Facilitator: Andi Sutter, MPH, MS – John Snow Inc R&T

Presenter: Raju Tamang, MBA, MHM (he/him/his) – John Snow India Pvt Ltd

Facilitator: Raju Tamang, MBA, MHM (he/him/his) – John Snow India Pvt Ltd

Presenter: Elan Ebeling, MPA (she/her/hers) – PATH

Facilitator: Elan Ebeling, MPA (she/her/hers) – PATH

Location: White River Ballroom E

Collaborative, Participatory & Empowerment Evaluation

1:00 PM – 2:00 PM ET

8 - I Fudged Up: Spacemaking for Stories of Failure in Evaluation

Presenter: monique inez liston, PhD – UBUNTU Research and Evaluation

Presenter: Sojourner White, MSW (she/her/hers) – UBUNTU Research & Evaluation, LLC

Location: White River Ballroom E

Independent Consulting

1:00 PM – 2:00 PM ET

9 - Leading Learning Agendas: Effective Practices to Maximize Impact

Presenter: Joaquina Kankam, PhD (she/her/hers) – Joaquina Scott Kankam, Ph.D

Location: White River Ballroom E

Organizational Learning & Evaluation Capacity Building

1:00 PM – 2:00 PM ET

10 - Mentoring for early career evaluators and graduate students

Facilitator: Jennifer L. Mursaloglu, PhD, PMP (she/her/hers) – REL Strategies, LLC

Facilitator: Rakiah Anderson, MPH – Department of Maternal and Child Health, University of North Carolina at Chapel Hill

Location: White River Ballroom E

Graduate Student and New Evaluators

1:00 PM – 2:00 PM ET

11 - Monitoring, evaluation, research and learning (MERL) in international higher education and research capacity strengthening projects: A place to share our stories

Presenter: Loran Parker, PhD – Evaluation and Learning Research Center, Purdue University

Presenter: David Schlinkert, PhD, MPA – Arizona State University’s Center for Applied Research and Innovation in Supply Chain Africa

Presenter: Artie S. Maharaj, Ph.D (she/her/hers) – TSNE

Presenter: Wilella Burgess, MS – Evaluation and Learning Research Center, Purdue University

Presenter: Romita Mitra, Ph.D – MIT Local Innovation Group

Presenter: Javier Ñaupari, PhD – PERU-Hub at Universidad Nacional Agraria La Molina

Location: White River Ballroom E

International and Cross Cultural Evaluation

1:00 PM – 2:00 PM ET

12 - Novel Strategies for Assessing an Organization’s Diversity, Equity, Inclusion, and Accessibility (DEIA) Culture and Progress towards Goals

Presenter: Jamelle E. Banks, M.P.H. (she/her/hers) – National Institutes of Health

Presenter: Rosanna K. Ng, M.A. (she/her/hers) – National Institutes of Health

Presenter: Robin M. Wagner, PhD, M.S. – National Center for Advancing Translational Sciences, National Institutes of Health

Location: White River Ballroom E

Research, Technology & Development Evaluation

1:00 PM – 2:00 PM ET

13 - Rewriting the Narrative - Sharing Stories Behind the Statistics

Presenter: Lexi Jones, MS – South Carolina First Steps

Location: White River Ballroom E

Internal Evaluation

1:00 PM – 2:00 PM ET

14 - Sharing power in the evaluation process

Facilitator: Charles Guedenet, n/a – IREX

Facilitator: Tanisha Washington, MA – IREX

Location: White River Ballroom E

Collaborative, Participatory & Empowerment Evaluation

1:00 PM – 2:00 PM ET

15 - Strengthening MEL capacity at your organization: Sharing examples and best practices

Presenter: Artie S. Maharaj, Ph.D (she/her/hers) – TSNE

Presenter: Romita Mitra, Ph.D – MIT Local Innovation Group

Location: White River Ballroom E

Organizational Learning & Evaluation Capacity Building

1:00 PM – 2:00 PM ET

16 - The growing challenge to keep evaluation going in the face of disruption

Presenter: Samuel Dunklin, MPH (he/him/his) – National Asthma Control Program, CDC

Presenter: Evan Mallen, MUP, PhD – Climate and Health Program, CDC

Presenter: Kathryn Sisler, MPH, MPAff (she/her/hers) – Climate and Health Program, CDC

Presenter: Claire Rowan, MPH – Green Health Analytics

Presenter: Jenifer M. Ballouk, MPH (she/her/hers) – National Asthma Control Program / CDC

Presenter: Ana Paula Pohl Duarte

Location: White River Ballroom E

Organizational Learning & Evaluation Capacity Building

1:00 PM – 2:00 PM ET

17 - Using integrated lenses to tell the stories of participants and facilitators of TAMAR, a trauma-informed psychoeducational program

Author: Chizoba L. Chukwura, MPH, CPH (she/her/hers) – W2 Consulting Corporation

Presenter: Chizoba L. Chukwura, MPH, CPH (she/her/hers) – W2 Consulting Corporation

Presenter: Arjee Restar, PhD, MPH – W2 Consulting Corporation

Presenter: Joan Gillece, PhD – NASMHPD

Presenter: Raul Almazar, RN, MA (he/him/his) – NASMHPD

Author: Anthony McRae, n/a – NASMHPD

Location: White River Ballroom E

Collaborative, Participatory & Empowerment Evaluation

1:00 PM – 2:00 PM ET

18 - Who are you and what do you stand for? Telling our own story to establish our values and reciprocate.

Facilitator: Becky Stewart, MPP – The Improve Group

Location: White River Ballroom E

Collaborative, Participatory & Empowerment Evaluation

2:30 PM – 3:30 PM ET

“Barrier Removal + Trust = Impact – The Winning Formula for Baltimore’s Youth”

Presenter: Kayla Jones, MHS (she/her/hers) – Family League of Baltimore

Presenter: Tracey Estep, MPA (she/her/hers) – Mayor's Office of African American Male Engagement

Presenter: Andrew Knox, n/a – Baltimore Brothers, Inc.

Presenter: Bilal Rahman

Location: Room 202

Youth Focused Evaluation

2:30 PM – 3:30 PM ET

Amplifying Program Beneficiaries' Stories of Sustainability Through Select USAID Ex-Post Evaluations

Presenter: Fiona Watta, n/a – USAID/Uganda

Presenter: Alphonse Bigirimana, n/a – USAID/Africa Bureau

Location: Room 102

International and Cross Cultural Evaluation

2:30 PM – 3:30 PM ET

Stories on from Uganda: Ex-post evaluation to examines the sustainability of outcomes from USAID's Sustainable, Comprehensive Responses for Vulnerable Children and their Families (SCORE) Project

Presenter: Fiona Watta, n/a – USAID/Uganda

2:30 PM – 3:30 PM ET

Sustainability Stories from USAID/Zimbabwe Orphans and Vulnerable (OVC) Support Project

Presenter: Blessing Mutsaka, n/a – USAID/Zimbabwe

2:30 PM – 3:30 PM ET

When Powerful Stories of Sustainability and Resilience Emerge from Data and Other Real-World Challenges: The Case USAID/Mali Out-of-School Project Ex-Post Post Evaluation

Presenter: Alphonse Bigirimana, n/a – USAID/Africa Bureau

2:30 PM – 3:30 PM ET

Building Client Capacity and Confidence to Tell Their Story

Presenter: Sara Greller, MS – Education Development Center (EDC)

Presenter: Erin Stafford, MA – Education Development Center (EDC)

Location: White River Ballroom I

Organizational Learning & Evaluation Capacity Building

2:30 PM – 3:30 PM ET

Colorful Insights: Using Color in Data Storytelling for Accessibility

PD Workshop Presenter: Janice Dsouza, MPH – Institute of International Education

PD Workshop Presenter: Evgenia Valuy – Institute of International Education

Location: White River Ballroom H

Data Visualization and Reporting

2:30 PM – 3:30 PM ET

Crafting Your Blue Marble Evaluation Story: How to Apply Blue Marble Principles to Your Everyday Evaluation Practice

Presenter: Hannah McMillan, MPH (she/her/hers) – Centers for Disease Control

Author: Charmagne Campbell-Patton, MA – Utilization-Focused Evaluation

Disscussant: Charmagne Campbell-Patton, MA – Utilization-Focused Evaluation

Chair: Michael Q. Patton, PhD (he/him/his) – Utilization-Focused Evaluation

Presenter: Rees Warne, ABD (she/her/hers) – Bezos Earth Fund

Facilitator: Michael (Mike) Moore, MS (he/him/his) – Community Refugee & Immigration Services (CRIS)

Location: White River Ballroom C

Systems in Evaluation

2:30 PM – 3:30 PM ET

Designing, implementing, and evaluating an academic-public health partnership program during a public health emergency: The story of the Rollins COVID-19 Epidemiology Fellowship

Presenter: Jennifer M. Ballentine, MPH – Highland Nonprofit Consulting

Presenter: Allison Chamberlain, PhD – Rollins School of Public Health at Emory University

Presenter: Shelby Rentmeester, MPH – Emory COVID-19 Response Collaborative

Location: Room 208

Program Design

2:30 PM – 3:30 PM ET

Integrating Evaluation in Program Design for Sustainable Academic-Public Health Partnerships: the Rollins Epidemiology Fellowship Program

Presenter: Shelby Rentmeester, MPH – Emory COVID-19 Response Collaborative

2:30 PM – 3:30 PM ET

Lessons learned from an evaluation of the Rollins Epidemiology Fellowship: Incorporating stakeholder stories into program design and adaptation

Presenter: Jennifer M. Ballentine, MPH – Highland Nonprofit Consulting

2:30 PM – 3:30 PM ET

Leveraging Academic-Public Health Partnerships to Establish and Support the Rollins Epidemiology Fellowship Program

Presenter: Allison Chamberlain, PhD – Rollins School of Public Health at Emory University

2:30 PM – 3:30 PM ET

Evaluation Policy in the U.S. – The Story of AEA’s Evaluation Policy Task Force - Past, Present, and Future

Presenter: Leslie Fierro, PhD, MPH – McGill University

Presenter: Gregory Phillips II

Presenter: Lisa Aponte-Soto, MHA, PhD – Tanoma Consulting LLC

2:30 PM – 3:30 PM ET

Fostering Critical Hope Through Evaluation

Presenter: Angie Edwards, n/a – Independent Consultant

Location: White River Ballroom D

Collaborative, Participatory & Empowerment Evaluation

2:30 PM – 3:30 PM ET

Fulfilling the Multi-Faceted Commitments of University-Based Evaluation Centers

Presenter: Lori Wingate, PhD – The Evaluation Center

Disscussant: Brad Watts, PhD (he/him/his) – The Evaluation Center

Presenter: Jessica Osborne, PhD – The Center for Research Evaluation, University of Mississippi

Presenter: Erica Echols-Miller, PhD – National Institute for STEM Evaluation & Research

Location: Room 205

University-Based Center

2:30 PM – 3:30 PM ET

Advancing Evaluation Through Outreach and Capacity Building

Presenter: Lori Wingate, PhD – The Evaluation Center

2:30 PM – 3:30 PM ET

Discussion of Broad Issues Facing University-Based Centers

Presenter: Brad Watts, PhD (he/him/his) – The Evaluation Center

2:30 PM – 3:30 PM ET

Follow the Money

Presenter: Erica Echols-Miller, PhD – National Institute for STEM Evaluation & Research

2:30 PM – 3:30 PM ET

The UBC's role in providing hands-on student learning

Presenter: Jessica Osborne, PhD – The Center for Research Evaluation, University of Mississippi

2:30 PM – 3:30 PM ET

Grassroots to Grasstops: Strengthening Evaluation Capacity at a Large Scale

Facilitator: Jennifer Nulty- Marsack, MSW – Pivot Data Design

Facilitator: Martena Reed, MSW – Reflective Evaluation

Presenter: Brita Blesi

Presenter: Brittany Fitz

Location: Room 204

Organizational Learning & Evaluation Capacity Building

2:30 PM – 3:30 PM ET

How We Model Matters: Visualizing Program Theories

Presenter: Stewart I. Donaldson, Ph.D. – Claremont Graduate University

Disscussant: Stewart I. Donaldson, Ph.D. – Claremont Graduate University

Presenter: Allan Porowski, n/a – Abt Associates

Presenter: Kaity Mumma, PhD – Abt Associates

Presenter: Sebastian Lemire, PhD – Abt Associates

Chair: Sebastian Lemire, PhD – Abt Associates

Program Theory and Theory-Driven Evaluation

2:30 PM – 3:30 PM ET

Capturing Complexity in Program Theories

Presenter: Allan Porowski, n/a – Abt Associates

2:30 PM – 3:30 PM ET

Mapping Minds and Relations in Program Theories

Presenter: Kaity Mumma, PhD – Abt Associates

2:30 PM – 3:30 PM ET

Stacking, Nesting, and Integrating Program Theories

Presenter: Sebastian Lemire, PhD – Abt Associates

2:30 PM – 3:30 PM ET

The Evolution of the Use of Program Theory in Practice: A Powerful Story and Bright Future

Presenter: Stewart I. Donaldson, Ph.D. – Claremont Graduate University

2:30 PM – 3:30 PM ET

Identifying Effective Storytelling Methods and Appropriate Audiences

Presenter: Kathleen O'Connor, PhD (she/her/hers) – TCC Group

Presenter: Lisa Frantzen, MBA – TCC Group

Location: Room 206

Cluster, Multi-site and Multi-level Evaluation

2:30 PM – 3:30 PM ET

Improving Communication with Populations Experiencing Limited Health Literacy: Applying CLAS and NIH Clear Standards in Text Messaging

Presenter: Natalia Rodríguez-Gonzalez, PhD (they/them/theirs) – Arizona State University -SIRC

Presenter: Wendy Wolfersteig, PhD (she/her/hers) – Arizona State University -SIRC

Presenter: Maria Aguilar-Amaya, DM, MAOM – Arizona State University -SIRC

Presenter: Mara de Luca Funke, MPH (she/her/hers) – Arizona State University-SIRC

Location: Room 104

Health Evaluation

2:30 PM – 3:30 PM ET

Improving Communication with Populations Experiencing Limited Health Literacy: Applying CLAS and NIH Clear Standards in Text Messaging

Presenter: Natalia Rodríguez-Gonzalez, PhD (they/them/theirs) – Arizona State University -SIRC

Presenter: Wendy Wolfersteig, PhD (she/her/hers) – Arizona State University -SIRC

Presenter: Maria Aguilar-Amaya, DM, MAOM – Arizona State University -SIRC

Presenter: Mara de Luca Funke, MPH (she/her/hers) – Arizona State University-SIRC

2:30 PM – 3:30 PM ET

Increasing the Power of Story through Transformative Culturally Responsive Mixed Methods Evaluation.

Presenter: Ayesha Boyce, PhD (she/her/hers) – Arizona State University

Presenter: Jori Hall, PhD – Georgia State University

Presenter: DONNA M. MERTENS, PhD (she/her/hers) – Gallaudet University

Chair: DONNA M. MERTENS, PhD (she/her/hers) – Gallaudet University

Location: Grand Ballroom 7

Mixed Methods Evaluation

2:30 PM – 3:30 PM ET

Focus groups: A culturally responsive tool for storytelling

Presenter: Jori Hall, PhD – Georgia State University

2:30 PM – 3:30 PM ET

Mixed methods culturally responsive evaluation as a facilitator of stories for minoritized populations

Presenter: Ayesha Boyce, PhD (she/her/hers) – Arizona State University

2:30 PM – 3:30 PM ET

Transformative culturally responsive mixed methods evaluation: The power of story

Presenter: DONNA M. MERTENS, PhD (she/her/hers) – Gallaudet University

2:30 PM – 3:30 PM ET

Put it in the Baby Book! Using an Implementation Log to Chronicle a Coalition’s First Five Years

Presenter: Erin Malcolm, MA – IMPACT, Inc.

Location: Room 209

Collaborative, Participatory & Empowerment Evaluation

2:30 PM – 3:30 PM ET

Reframing a story - from Societal Impact to the UN Sustainable Development Goals

Presenter: Katrine Iversen, MSc – Novo Nordisk Foundation

Location: Room 209

Research, Technology & Development Evaluation

2:30 PM – 3:30 PM ET

Revolutionizing Program Evaluation: Harnessing the Power of Artificial Intelligence tools like ChatGPT

Presenter: Nishank Varshney, n/a – University of Minnesota, Humphrey School

Author: Nishank Varshney, n/a – University of Minnesota, Humphrey School

Location: Room 209

Integrating Technology into Evaluation

2:30 PM – 3:30 PM ET

Roadmap for conducting a meta-evaluation: approach and insights.

Presenter: Laura Kunert, n/a – German Institute for Development Evaluation

Author: Laura Kunert, n/a – German Institute for Development Evaluation

Author: Kerstin Guffler, n/a – German Institute for Development Evaluation

Author: Marian Wittenberg, n/a – German Institute for Development Evaluation

Location: Room 209

Research on Evaluation

2:30 PM – 3:30 PM ET

Seeing the Story Through the Data: Considerations for Navigating Imperfect Data Sets

Presenter: Shannon Stagman, M.A. – Arabella Advisors

Presenter: Julie Slay, Ph.D. – Prism Partners Group

Location: Room 309/310

Mixed Methods Evaluation

2:30 PM – 3:30 PM ET

SHIFTING IDENTITIES IN DIFFERENT CONTEXTS

Author: Natalie De Sole, MSW, ACUE teaching certificate – Rooted-Growth LLC

Location: Room 209

Independent Consulting

2:30 PM – 3:30 PM ET

Stories that opened the mystery box in development evaluations- the cases from evaluation in Africa.

PD Workshop Presenter: Girma Earo -. Kumbi, N/A, Master degree – African Development Bank

Presenter: Girma Earo -. Kumbi, N/A, Master degree – African Development Bank

Author: Girma Earo -. Kumbi, N/A, Master degree – African Development Bank

Facilitator: Girma Earo -. Kumbi, N/A, Master degree – African Development Bank

Chair: Girma Earo -. Kumbi, N/A, Master degree – African Development Bank

Disscussant: Girma Earo -. Kumbi, N/A, Master degree – African Development Bank

Location: Room 209

Theories of Evaluation

2:30 PM – 3:30 PM ET

Storytelling and systems change: How creative use of data can drive change in education and youth systems

Presenter: Audrey S. Moore, n/a – Mathematica

Chair: Audrey S. Moore, n/a – Mathematica

Presenter: Ivonne Padilla, n/a – Mathematica

Presenter: Laura Meyer, n/a – Mathematica

Presenter: Rachel Blum (she/her/hers) – Education Development Center, Inc. (EDC)

Disscussant: Erin McCarthy, n/a – Hilton Foundation

Location: Grand Ballroom 3

Systems in Evaluation

2:30 PM – 3:30 PM ET

How the use of data and narratives support systems change.

Presenter: Erin McCarthy, n/a – Hilton Foundation

2:30 PM – 3:30 PM ET

Improving access and equity to middle school education

Presenter: Audrey S. Moore, n/a – Mathematica

2:30 PM – 3:30 PM ET

Improving the quality and relevance of vocational education and training

Presenter: Ivonne Padilla, n/a – Mathematica

2:30 PM – 3:30 PM ET

Locally sourced early childhood development (ECD) systems measurement frameworks for change

Presenter: Laura Meyer, n/a – Mathematica

2:30 PM – 3:30 PM ET

Using analytic frameworks to capture unanticipated systems-level changes

Presenter: Rachel Blum (she/her/hers) – Education Development Center, Inc. (EDC)

2:30 PM – 3:30 PM ET

Storytelling from within: Parallel initiatives to build evaluation capacity

Presenter: Linda J. Lee, PhD (she/her/hers) – Reach Out

Presenter: Desiree Greenhouse, n/a – Reach Out

Presenter: Marc Salazar, n/a – Reach Out

Location: Grand Ballroom 9

Internal Evaluation

2:30 PM – 3:30 PM ET

Storytelling to Influence Evidence-Based Policymaking: Bar ama Baro Somalia's Accelerated Quality Learning Program

Presenter: Luke T Ingersoll, n/a – Evaluation and Learning Research Center - Purdue University

Author: Luke T Ingersoll, n/a – Evaluation and Learning Research Center - Purdue University

Author: Ann Bessenbacher, BS (she/her/hers) – Evaluation and Learning Research Center, Purdue University

Author: Wilella Burgess, MS – Evaluation and Learning Research Center, Purdue University

Location: Room 209

Advocacy and Policy Change

2:30 PM – 3:30 PM ET

Storytelling With Survey Data: How to Develop Quality Surveys to Turn Data into Actionable Insights

PD Workshop Presenter: Sudaba Parnian Ahmadi, MBA, MA – Association of Public Health Laboratories

Facilitator: Sudaba Parnian Ahmadi, MBA, MA – Association of Public Health Laboratories

PD Workshop Presenter: Laila Natiq, MSPH – Association of Public Health Laboratories

Facilitator: Laila Natiq, MSPH – Association of Public Health Laboratories

PD Workshop Presenter: Micheal Mugerwa, MScAE – Association of Public Health Laboratories

Facilitator: Micheal Mugerwa, MScAE – Association of Public Health Laboratories

Presenter: Sara A. Leigh, MS Statistics – Association of Public Health Laboratories

Facilitator: Sara A. Leigh, MS Statistics – Association of Public Health Laboratories

Design and Analysis of Experiments

Sudaba Parnian Ahmadi, MBA, MA – Association of Public Health Laboratories ### 2125402###PD Workshop Presenter###Manager, Monitoring and Evaluation###Association of Public Health Laboratories###
PD Workshop Presenter: Sudaba Parnian Ahmadi, MBA, MA – Association of Public Health Laboratories
### @@@ Sudaba Parnian Ahmadi, MBA, MA – Association of Public Health Laboratories ### 2125402###Facilitator###Manager, Monitoring and Evaluation###Association of Public Health Laboratories###
Facilitator: Sudaba Parnian Ahmadi, MBA, MA – Association of Public Health Laboratories
### @@@ Laila Natiq, MSPH – Association of Public Health Laboratories ### 2125410###PD Workshop Presenter###Senior Specialist, Monitoring and Evaluation###Association of Public Health Laboratories###
PD Workshop Presenter: Laila Natiq, MSPH – Association of Public Health Laboratories
### @@@ Laila Natiq, MSPH – Association of Public Health Laboratories ### 2125410###Facilitator###Senior Specialist, Monitoring and Evaluation###Association of Public Health Laboratories###
Facilitator: Laila Natiq, MSPH – Association of Public Health Laboratories
### @@@ Micheal Mugerwa, MScAE – Association of Public Health Laboratories ### 2125411###PD Workshop Presenter###Senior Specialist, Monitoring and Evaluation###Association of Public Health Laboratories###
PD Workshop Presenter: Micheal Mugerwa, MScAE – Association of Public Health Laboratories
### @@@ Micheal Mugerwa, MScAE – Association of Public Health Laboratories ### 2125411###Facilitator###Senior Specialist, Monitoring and Evaluation###Association of Public Health Laboratories###
Facilitator: Micheal Mugerwa, MScAE – Association of Public Health Laboratories
### @@@ Sara A. Leigh, MS Statistics – Association of Public Health Laboratories ### 2125405###Presenter###Senior Specialist, Monitoring & Evaluation###Association of Public Health Laboratories###
Presenter: Sara A. Leigh, MS Statistics – Association of Public Health Laboratories
### @@@ Sara A. Leigh, MS Statistics – Association of Public Health Laboratories ### 2125405###Facilitator###Senior Specialist, Monitoring & Evaluation###Association of Public Health Laboratories###
Facilitator: Sara A. Leigh, MS Statistics – Association of Public Health Laboratories
###

2:30 PM – 3:30 PM ET

Successful Collaboration Across National Nonprofit Organizations

Presenter: Rhonda Williams, Ph.D – Girl Scouts of Northeast Texas

Presenter: Rocki Basel, Ph.D – Girl Scouts of North East Ohio

Location: White River Ballroom A

Nonprofit and Foundations

2:30 PM – 3:30 PM ET

Telling New Stories: Methodologies for Communicating Visionary Change

Presenter: Patrick Greene, ORCAS co-LEAD with experience communicating impact to donors and partners through storytelling – Oxfam America

Disscussant: Molly Kellogg, MEAL advisor with experience using story to communicate local and global impact – Oxfam America

Location: Grand Ballroom 10

Use and Influence of Evaluation

2:30 PM – 3:30 PM ET

Telling stories and building unicorns: lessons learned from the first Most Significant Change evaluation in Iraq

Presenter: Niki Wood, MA (she/her/hers) – Chemonics UK

Presenter: Robert Lord-Biggers, n/a – Chemonics

Location: Grand Ballroom 8

Collaborative, Participatory & Empowerment Evaluation

2:30 PM – 3:30 PM ET

Telling the Story of Global Democratic Trends Across the Academic-Practitioner Divide

Presenter: Marcia D. Mundt, PhD (she/her/hers) – Consortium for Elections and Political Process Strengthening

Presenter: Brigitte Seim, PhD (she/her/hers) – University of North Carolina at Chapel Hill

Presenter: Natalie Trisilla – International Republican Institute

Presenter: Daniel Pemstein, PhD – North Dakota State University

Disscussant: Linda Stern, n/a – National Democratic Institute

Location: Room 103

Democracy and Governance

2:30 PM – 3:30 PM ET

Academic Perspectives: The Varieties of Democracy (V-Dem) Project Dataset

Presenter: Brigitte Seim, PhD (she/her/hers) – University of North Carolina at Chapel Hill

Presenter: Daniel Pemstein, PhD – North Dakota State University

2:30 PM – 3:30 PM ET

Global Democratic Trends Across the Academic-Practitioner Divide

Presenter: Linda Stern, n/a – National Democratic Institute

2:30 PM – 3:30 PM ET

Practitioner Perspectives: CEPPS Global Democratic Trends Dataset

Presenter: Marcia D. Mundt, PhD (she/her/hers) – Consortium for Elections and Political Process Strengthening

Presenter: Natalie Trisilla – International Republican Institute

2:30 PM – 3:30 PM ET

Telling the story: Overcoming challenges in translational research evaluation

Author: John Stevenson, PhD (he/him/his) – University of Rhode Island

Chair: John Stevenson, PhD (he/him/his) – University of Rhode Island

Disscussant: Clara Pelfrey, PhD (she/her/hers) – Case Western Reserve University

Presenter: Sue Giancola, PhD (she/her/hers) – University of Delaware

Author: Ingrid Philibert, PhD – University of Nebraska Medical Center

Presenter: Reagan Curtis, PhD (he/him/his) – West Virginia University

Author: Nikki Lewis, MS – West Virginia Clinical Translational Research Institute

Author: Evana Nusrat Dooty, MS – West Virginia University

Author: Mohammad Muntashir Raquib, MA – West Virginia University

Presenter: Sarah Mason, PhD – The University of Mississippi

Author: S. Hope Gilbert, PhD – Deloitte Consulting, L.L.C.

Location: Room 301

Translational Research Evaluation

John Stevenson, PhD (he/him/his) – University of Rhode Island ### 2044065###Author###Professor Emeritus###University of Rhode Island###
Author: John Stevenson, PhD (he/him/his) – University of Rhode Island
### he/him/his @@@ John Stevenson, PhD (he/him/his) – University of Rhode Island ### 2044065###Chair###Professor Emeritus###University of Rhode Island###
Chair: John Stevenson, PhD (he/him/his) – University of Rhode Island
### he/him/his @@@ Clara Pelfrey, PhD (she/her/hers) – Case Western Reserve University ### 2044061###Disscussant###Evaluation Director, CTSC###Case Western Reserve University###
Disscussant: Clara Pelfrey, PhD (she/her/hers) – Case Western Reserve University
### she/her/hers @@@ Sue Giancola, PhD (she/her/hers) – University of Delaware ### 2043996###Presenter###Senior Associate Director, CRESP###University of Delaware###
Presenter: Sue Giancola, PhD (she/her/hers) – University of Delaware
### she/her/hers @@@ Ingrid Philibert, PhD – University of Nebraska Medical Center ### 2044281###Author###Director, Tracking and Evaluation, Great Plains IDeA CTR###University of Nebraska Medical Center###
Author: Ingrid Philibert, PhD – University of Nebraska Medical Center
### @@@ Reagan Curtis, PhD (he/him/his) – West Virginia University ### 2044282###Presenter###Professor, School of Education###West Virginia University###
Presenter: Reagan Curtis, PhD (he/him/his) – West Virginia University
### he/him/his @@@ Nikki Lewis, MS – West Virginia Clinical Translational Research Institute ### 2044283###Author###Program Manager###West Virginia Clinical Translational Research Institute###
Author: Nikki Lewis, MS – West Virginia Clinical Translational Research Institute
### @@@ Evana Nusrat Dooty, MS – West Virginia University ### 2044284###Author###Graduate Student Researcher###West Virginia University###
Author: Evana Nusrat Dooty, MS – West Virginia University
### @@@ Mohammad Muntashir Raquib, MA – West Virginia University ### 2044285###Author###Graduate Student Researcher###West Virginia University###
Author: Mohammad Muntashir Raquib, MA – West Virginia University
### @@@ Sarah Mason, PhD – The University of Mississippi ### 2044248###Presenter###Director, Center for Research Evaluation###The University of Mississippi###
Presenter: Sarah Mason, PhD – The University of Mississippi
### @@@ S. Hope Gilbert, PhD – Deloitte Consulting, L.L.C. ### 2044286###Author###Manager###Deloitte Consulting, L.L.C.###
Author: S. Hope Gilbert, PhD – Deloitte Consulting, L.L.C.
###

2:30 PM – 3:30 PM ET

Fostering protective factors in translational research: Reflections from Mississippi

Presenter: Sarah Mason, PhD – The University of Mississippi

Presenter: S. Hope Gilbert, PhD – Deloitte Consulting, L.L.C.

2:30 PM – 3:30 PM ET

NA

Presenter: John Stevenson, PhD (he/him/his) – University of Rhode Island

Presenter: Clara Pelfrey, PhD (she/her/hers) – Case Western Reserve University

Presenter: Ingrid Philibert, PhD – University of Nebraska Medical Center

Presenter: Nikki Lewis, MS – West Virginia Clinical Translational Research Institute

Presenter: Evana Nusrat Dooty, MS – West Virginia University

Presenter: Mohammad Muntashir Raquib, MA – West Virginia University

Presenter: S. Hope Gilbert, PhD – Deloitte Consulting, L.L.C.

2:30 PM – 3:30 PM ET

Navigating times of change while building evaluation capacity in the West Virginia Clinical and Translational Science Institute

Presenter: Reagan Curtis, PhD (he/him/his) – West Virginia University

Presenter: Nikki Lewis, MS – West Virginia Clinical Translational Research Institute

Presenter: Evana Nusrat Dooty, MS – West Virginia University

Presenter: Mohammad Muntashir Raquib, MA – West Virginia University

2:30 PM – 3:30 PM ET

Stories of challenges to evaluation over time: CTR evaluator survey results

Presenter: Sue Giancola, PhD (she/her/hers) – University of Delaware

Presenter: John Stevenson, PhD (he/him/his) – University of Rhode Island

Presenter: Ingrid Philibert, PhD – University of Nebraska Medical Center

2:30 PM – 3:30 PM ET

N/A because she is a discussion facilitator

Presenter: Salome Tsereteli-Stephens, MEL Expert – American Bar Association Rule of Law Initiative

2:30 PM – 3:30 PM ET

Telling the Training Story Using the Kirkpatrick Model in a Global Fellowship Program

Presenter: Jeanette Tocol, MEL Expert – American Bar Association Rule of Law Initiative

2:30 PM – 3:30 PM ET

Telling the Training Story Using the Kirkpatrick Model in Colombia Programs for Judges and Court Personnel

Presenter: Paola Suarez, MEL Expert – American Bar Association Rule of Law Initiative

2:30 PM – 3:30 PM ET

Telling the Training Story Using the Kirkpatrick Model in Peru Programs for Justice Actors

Presenter: Victoria Alegre, MEL Expert – American Bar Association Rule of Law Initiative

2:30 PM – 3:30 PM ET

Telling Your Evaluation Story in an Executive Summary

Presenter: Fanny Hernandez De Alvarez, Ph.D. Candidate – Western Michigan University

Author: Fanny Hernandez De Alvarez, Ph.D. Candidate – Western Michigan University

Presenter: Najat Elgeberi, Ph.D. – University of Nevada Reno

Author: Najat Elgeberi, Ph.D. – University of Nevada Reno

Data Visualization and Reporting

2:30 PM – 3:30 PM ET

The 25-Year Journey: Changes, Cycles, and Culture in Government Evaluation

Presenter: Ted Kniker, n/a – IMPACT Paradigm Associates

Presenter: Natalie R. Donahue (she/her/hers) – U.S. Department of State

Location: White River Ballroom G

Government Evaluation

2:30 PM – 3:30 PM ET

The Contextuality of Evaluation Practice in Global South - A China Story

Presenter: Charles Leung, PhD; RSW(HK); Accredited Mediator(HK); Project DPro(Level 1&2) – Beijing Normal University-Hong Kong Baptist University United International College (BNU-HKBU UIC)

Author: Charles Leung, PhD; RSW(HK); Accredited Mediator(HK); Project DPro(Level 1&2) – Beijing Normal University-Hong Kong Baptist University United International College (BNU-HKBU UIC)

Author: Jianchao Huang, n/a – Freelancer

Location: Room 209

International and Cross Cultural Evaluation

2:30 PM – 3:30 PM ET

Visualizing the Landscape of Evaluation Education

Presenter: Cindy Shuman, PhD (she/her/hers) – Kansas State University

Presenter: Kelly McGinn, Ph.D. – Temple University

Presenter: Krisanna Machtmes, Ph.D. – Ohio University

Presenter: Seema Mahato, Ph.D. – Washington University in St. Louis

Location: Room 203

Teaching of Evaluation

2:30 PM – 3:30 PM ET

Weaving Personal Histories into a Tapestry of Change: Using Oral History to Document Long-Term Impact

Presenter: Katie Rose Dailey, MA – FHI 360

Presenter: Amy Detgen, MPA – FHI 360

Location: White River Ballroom B

Qualitative Methods

2:30 PM – 3:30 PM ET

Adding a voice to the story: Retailer collaboration in tobacco control policy and evaluation

Presenter: Jessica Price, MS (she/her/hers) – Center for Public Health Systems Science

Author: Veronica Chaitan, n/a – Center for Public Health Systems Science

Author: Caren Bacon, MPH – Center for Public Health Systems Science

Author: Todd Combs, n/a – Center for Public Health Systems Science

Author: Tonia Smith, RDN, MCHES, REHS, CTTS – Cincinnati Health Department

Author: Kelley Adcock, MPH – Interact for Health

Health Evaluation

2:30 PM – 3:30 PM ET

Stories as reflections on health program impact and improvement (1509782, 1507863, 1507051, 1507382)

Chair: Amy Kerr, PhD – Professional Data Analysts

Location: White River Ballroom F

Health Evaluation

2:30 PM – 3:30 PM ET

Creating Surveys that Reflect Real Youth Stories: Using Cognitive Interviews and Other Youth-Focused Steps to Get Better Teen Pregnancy Prevention Survey Data

Presenter: Pamela Drake, MEd, PhD (she/her/hers) – ETR

Author: Pamela Drake, MEd, PhD (she/her/hers) – ETR

Author: Carly Raasch, MA – ETR

Health Evaluation

2:30 PM – 3:30 PM ET

Flipping the Script: Using an Implementation Science Methodology to frame Quality Improvement across a multi-site, multi-provider HIV Care and Treatment Program

Presenter: Theresa C. Fox, MSW (she/her/hers) – Fox Caring Consultants

Author: Theresa C. Fox, MSW (she/her/hers) – Fox Caring Consultants

Presenter: Brittany Babich, MPH – VNA Health Group

Health Evaluation

2:30 PM – 3:30 PM ET

From storytelling to action: Revising evaluation tools to better capture the impact of a financial assistance program for breast cancer patients

Author: Shelby Lautner, PhD (she/her/hers) – Susan G. Komen

Author: Janet Okamoto, PhD (she/her/hers) – Susan G. Komen

Author: Dustin Scott, MPH – Susan G. Komen

Presenter: Mandy Spadine, PhD, CPH, CHES® – Susan G. Komen

Health Evaluation

2:30 PM – 3:30 PM ET

Integrating technology into evaluation

Chair: John Baek, PhD (he/him/his) – NOAA Office of Education

Presenter: Elvira Celardi (she/her/hers) – University of Catania

Presenter: Zhi Li, n/a – University of North Carolina at Charlotte

Presenter: Carl Westine, n/a – University of North Carolina at Charlotte

Presenter: Antonio Picone, PhD (he/him/his) – Physics and Astronomy Department, University of Catania

Location: Grand Ballroom 2

Integrating Technology into Evaluation

2:30 PM – 3:30 PM ET

Machine Learning algorithms for predicting university student dropout

Presenter: Elvira Celardi (she/her/hers) – University of Catania

Author: Vincenzo Miracula, n/a – University of Catania

Author: Antonio Picone, PhD (he/him/his) – Physics and Astronomy Department, University of Catania

Presenter: Antonio Picone, PhD (he/him/his) – Physics and Astronomy Department, University of Catania

Integrating Technology into Evaluation

2:30 PM – 3:30 PM ET

Project Monitoring and Evaluation: Application of Data Analytics for Interview Response Grading

Presenter: Zhi Li, n/a – University of North Carolina at Charlotte

Presenter: Carl Westine, n/a – University of North Carolina at Charlotte

Integrating Technology into Evaluation

2:30 PM – 3:30 PM ET

The Importance of Supporting The Health of Military Personnel, Veterans and Their Families: Outcomes from a Diverse Set of Evaluation Studies

Chair: Rhodri Dierst-Davies

Location: Grand Ballroom 1

Military and Veteran Evaluation

2:30 PM – 3:30 PM ET

Evaluating the Army’s Exceptional Family Member Program

Presenter: Stacy Ann Hawkins, PhD – Research Facilitation Laboratory

Author: Stacy Ann Hawkins, PhD – Research Facilitation Laboratory

Author: Marisa M. Nihill, PhD – Research Facilitation Laboratory

Military and Veteran Evaluation

2:30 PM – 3:30 PM ET

Lessons learned from an agriculture veterans program: When the experience doesn’t yield anticipated results

Presenter: Nesma Osman, PhD (she/her/hers) – Mississippi State University

Presenter: Tiffany Drape, PhD (she/her/hers) – Virginia Tech

Military and Veteran Evaluation

2:30 PM – 3:30 PM ET

Preparing for the sequel: A formative evaluation of a mutual-aid support group for Veterans living with chronic pain

Presenter: Rachael Kenney, MA, PMP (she/her/hers) – Veterans Health Administration

Author: Rachael Kenney, MA, PMP (she/her/hers) – Veterans Health Administration

Author: Anne Hale, n/a – Veterans Health Administration

Author: John Evans, n/a – Veterans Health Administration

Author: Joe Frank, MD, MPH – Veterans Health Administration, University of Colorado

Military and Veteran Evaluation

2:30 PM – 3:30 PM ET

The Hidden Helpers Coalition Evaluation: Output Survey Findings

Presenter: Kate Clavijo, Ed.D. – Military Family Advisory Network

Presenter: Gabby L'Esperance, Ph.D. – Military Family Advisory Network

Military and Veteran Evaluation

2:30 PM – 3:30 PM ET

Participatory Evaluation: Engaging Participants in the Evaluation Process

Chair: Sarah Suiter, PhD, MS – Vanderbilt University

Location: Grand Ballroom 4

Collaborative, Participatory & Empowerment Evaluation

2:30 PM – 3:30 PM ET

Examining a Participatory Evaluation Approach that Centers BIPOC Teacher-Leaders’ Lived Experiences in a K-12 School Leadership Preparation Program

Presenter: Jilliam Joe, Ph.D. – Measure by Design Consulting

Author: Jilliam Joe, Ph.D. – Measure by Design Consulting

Author: Rodriguez Yunuen, M.A. – University of Chicago - Crown Family School

Author: Lichtenberg Caryn, n/a – Teach for America

Author: Kate San Juan, n/a – Teach for America

Author: Barron Cynthia, Ph.D. – University of Illinois at Chicago

Author: Williams Lynda, Ed.D. – National Louis University

Author: Allen Lionel, Ed.D. – University of Illinois at Chicago

Author: Lee Sarah, n/a – Teach for America

Collaborative, Participatory & Empowerment Evaluation

2:30 PM – 3:30 PM ET

Stories of change from refugees and people living with disabilities that changed programming

Author: Soledad Muniz, MSc (she/her/hers) – InsightShare

Author: Amanda Burrows, - (she/her/hers) – Opportunity International UK

Author: Melissa Bell, - (she/her/hers) – Opportunity International UK

Presenter: Amanda Burrows, - (she/her/hers) – Opportunity International UK

Presenter: Melissa Bell, - (she/her/hers) – Opportunity International UK

Collaborative, Participatory & Empowerment Evaluation

2:30 PM – 3:30 PM ET

The Power of Storytelling and Participative Research in Evaluating a STEM Program Serving Adolescent Hispanic Females from Marginalized Areas in South Texas

Presenter: Pamela D. McCray, Doctoral Student, MBA, presenter at MWERA (she/her/hers) – Doctoral student at University of the Incarnate Word, San Antonio, Texas

Author: Pamela D. McCray, Doctoral Student, MBA, presenter at MWERA (she/her/hers) – Doctoral student at University of the Incarnate Word, San Antonio, Texas

Collaborative, Participatory & Empowerment Evaluation

2:30 PM – 3:30 PM ET

True stories: Centering authenticity in bundled evaluations of programs tackling society’s biggest challenges

Chair: Lily Zandniapour, PhD – AmeriCorps

Facilitator: Megha Patel, n/a – AmeriCorps

Presenter: Jehyra Marie Asencio Yace, PhD – AmeriCorps

Presenter: Samantha Spinney, n/a – ICF

Presenter: Andrew McDonald, n/a – ICF

Presenter: Rosemarie OConner, n/a – ICF

Presenter: Kimberly Good, n/a – ICF

Collaborative, Participatory & Empowerment Evaluation

3:45 PM – 4:45 PM ET

Amplifying and Centering the Stories of the Community in an Evaluative Process to Address Racial Inequities in Two School Communities

Presenter: Latia White, Ed.D – Digital Promise

Presenter: Alexandra Merritt Johnson, PhD – Digital Promise

Location: White River Ballroom B

Collaborative, Participatory & Empowerment Evaluation

3:45 PM – 4:45 PM ET

Becoming Change Makers: The Exquisite Path to Leadership and Liberation for Women of Color

Author: Dominica McBride, PhD – BECOME

Location: Grand Ballroom 7

3:45 PM – 4:45 PM ET

Building Better Surveys

Presenter: Bianca Montrosse-Moorhead, PhD – University of Connecticut

Presenter: Amanda Sutter, MA, MSW (she/her/hers) – University of Connecticut

Location: Room 309/310

Mixed Methods Evaluation

3:45 PM – 4:45 PM ET

Building Stories of Evaluation Management: Explicating a Professional Practice through Narrative

Presenter: Melissa Chapman Haynes, PhD – Professional Data Analysts

Author: Kate LaVelle, PhD – Professional Data Analysts

Location: Room 102

Evaluation Managers and Supervisors

3:45 PM – 4:45 PM ET

Can we talk? (Can you listen?) Culturally responsive storytelling (and listening) approaches for evaluators who care

Presenter: Giovanni Dazzo, PhD – University of Georgia

Facilitator: Giovanni Dazzo, PhD – University of Georgia

Presenter: Jori Hall, PhD – Georgia State University

Facilitator: Jori Hall, PhD – Georgia State University

Chair: Jori Hall, PhD – Georgia State University

Location: White River Ballroom I

Multiethnic Issues in Evaluation

3:45 PM – 4:45 PM ET

Commitments Made: A Journey Through Values-Based Evaluation

Presenter: Lisa Frantzen, MBA – TCC Group

Presenter: Deepti Sood, n/a – TCC Group

Presenter: Stephanie Coker, MPA; BA in Political Science and Government – CVS Health

Presenter: Owen Knight, B.A. – TCC Group

Location: Room 205

Theories of Evaluation

3:45 PM – 4:45 PM ET

A tale of two perspectives: The benefits of collaborating with communications experts in evaluation storytelling

Presenter: Lauren Decker-Woodrow, Ph.D. – Westat

Presenter: Valerie Orellana, MEd – Westat

Presenter: Hayley Trentacosta, BA – Westat

3:45 PM – 4:45 PM ET

Using a hybrid story circle to capture impacts of a networked improvement community approach to educational practice challenges

Presenter: Jenny Nguyen, MEd (she/her/hers) – Westat Insight

Presenter: Allison Hyra, PhD (she/her/hers) – Westat Insight

3:45 PM – 4:45 PM ET

Using a story circle to capture impacts of a teacher development career pathway

Presenter: Allison Hyra, PhD (she/her/hers) – Westat Insight

Presenter: Karmen Perry, BA (she/her/hers) – Westat Insight

3:45 PM – 4:45 PM ET

Developing indicators for redistributing power and influence in coalitions

Presenter: Alissa Marchant, MSW – Innovation Network

Presenter: Shelli Golson-Mickens, MPH – Innovation Network

Presenter: Cory Georgopoulos, MPP – Innovation Network

Location: Room 202

Advocacy and Policy Change

3:45 PM – 4:45 PM ET

Enhancing your evaluation story: Design skills for more effective evaluation deliverables

Facilitator: Christine Robinson, MRP (she/her/hers) – Bixal

Presenter: Meredith Feenstra, MA (she/her/hers) – Bixal

Location: Grand Ballroom 8

Data Visualization and Reporting

3:45 PM – 4:45 PM ET

Evaluating a Dual Client Model: Interweaving Perspectives in Evidence Generation and Storytelling

Presenter: Lexie Maister, MPH – Blueprint

Presenter: Lauren Kupcho, MSSP – Blueprint

Location: Room 208

Design and Analysis of Experiments

3:45 PM – 4:45 PM ET

Experts of Their Own Experience: Tools and Strategies to Partner with Youth in Evaluation and Center Their Stories

Presenter: Jenna K. Sethi, PhD (she/her/hers) – Informed Change

Presenter: Clare L. Eisenberg, M.Ed. (she/her/hers) – Informed Change/Clare Eisenberg Consulting

Location: Room 201

Youth Focused Evaluation

3:45 PM – 4:45 PM ET

Facilitating the Logic Model Process with Stakeholders in a Complex Environment: A Demonstration Session

Presenter: Kate Clavijo, Ed.D. – Military Family Advisory Network

Presenter: Gabby L’Esperance, Ph.D. – Military Family Advisory Network

Presenter: Emily Warren, M.A. – National Academies of Science, Engineering, and Medicine

Presenter: Piper Grandjean Targos, M.A. – EdgeEval

Location: Room 104

Organizational Learning & Evaluation Capacity Building

3:45 PM – 4:45 PM ET

Future Proofing our Theories of Change: Using alternative scenarios--stories of the future--to test assumptions and strengthen our theories of change

Presenter: Kathleen Sullivan, JD – Fine Gauge Strategy LLC

Presenter: Thomas Kelly, MPH – KEL Advising

Presenter: Rhonda Schlangen, MA (she/her/hers) – Rhonda Schlangen Consulting, LLC

Location: White River Ballroom H

Systems in Evaluation

3:45 PM – 4:45 PM ET

Incorporating Feedback in Theories of Change Through Simulation

Presenter: Cynthia Phillips, n/a – Decision Catalyst, LLC

Author: Lisa C. Gajary, n/a – Caspian Strategy & Analytics LLC

Presenter: Anand Desai, n/a – Clarivate

Location: Room 103

Integrating Technology into Evaluation

3:45 PM – 4:45 PM ET

Launching an Evaluation Practice 101: Six Steps to Get Started as a Solo Entrepreneur in Applied Research

Presenter: Patricia E. Steele, PhD – Higher Ed Insight

Location: Grand Ballroom 9

Independent Consulting

3:45 PM – 4:45 PM ET

Let's Tell Stories: The Making of a Ted Talk

PD Workshop Presenter: David M. Fetterman, PhD (he/him/his) – Fetterman & Associates

Location: White River Ballroom F

Collaborative, Participatory & Empowerment Evaluation

3:45 PM – 4:45 PM ET

Leveraging the art of storytelling through dynamic and responsive evaluation peer-to-peer learning opportunities

Presenter: Jan K. Fields, EdD PhD (he/him/his) – Michigan DHHS

Presenter: Chris Lysy, MA – Fresh Spectrum

Presenter: Minda Reed, MD, MPH – Centers for Disease Control and Prevention

Presenter: Kendra Wilson, DrPH, MS – CDC

Presenter: Nida Ali, PhD, MPH – Centers for Disease Control and Prevention

Location: White River Ballroom D

Organizational Learning & Evaluation Capacity Building

3:45 PM – 4:45 PM ET

Making hidden connections visible: The power of stories in social network data

Presenter: Tatiana E. Bustos, PhD – RTI International, Transformative Research Unit for Equity

Author: Tatiana E. Bustos, PhD – RTI International, Transformative Research Unit for Equity

Location: Room 301

Social Network Analysis

3:45 PM – 4:45 PM ET

Chair of the panel

Presenter: Carmen Wilson-Grau, n/a – Women in Informal Employment: Globalizing and Organizing (WIEGO)

3:45 PM – 4:45 PM ET

Counting outcomes: identifying, describing and characterizing outcomes

Presenter: Julius Nyangaga, MSc, BSc. (he/him/his) – Right Track Africa

3:45 PM – 4:45 PM ET

Outcome Harvesting for Adaptive Management: Ideas, Practices and Lessons Learned For Using OH In Support Of Complex Interventions

Presenter: Steff Deprez, n/a – Voices That Count

3:45 PM – 4:45 PM ET

Power of non-conventional approaches such as storytelling in Outcomes Harvesting of The Educate A Child (EAC): a global education program.

Presenter: Awuor C. PONGE, BA, MA (Nrb), MA (London), PhD (he/him/his) – African Policy Centre (APC)

Presenter: Noor Muhammad Ansari – Education Above All (EAA) Foundation

3:45 PM – 4:45 PM ET

Strengthening Evaluation Practices Using a Regional Evaluation Capacity Building Model: Evaluation Through the Lens of the Western Regional Evaluation Network

Presenter: Najat Elgeberi, Ph.D. – University of Nevada Reno

Author: Najat Elgeberi, Ph.D. – University of Nevada Reno

Presenter: Vikram Koundinya, PhD – University of California-Davis

Author: Vikram Koundinya, PhD – University of California-Davis

Presenter: Nav Ghimire, Ph.D. – University of Idaho Boise

Author: Nav Ghimire, Ph.D. – University of Idaho Boise

Author: Mary Halbleib, Masters (she/her/hers) – Oregon State University

Presenter: LaJoy R. Spears, Ph.D. – New Mexico State University

Author: LaJoy R. Spears, Ph.D. – New Mexico State University

Author: Alda Norris, PhD (she/her/hers) – Institute of Agriculture, Natural Resources and Extension, University of Alaska Fairbanks

Author: Kristina Sayama, MPA, CM – University of Guam

Author: Christina Sanders, Ph.D. – Washington State University Extension

Presenter: Alda Norris, PhD (she/her/hers) – Institute of Agriculture, Natural Resources and Extension, University of Alaska Fairbanks

Location: Room 203

Extension Education Evaluation

Najat Elgeberi, Ph.D. – University of Nevada Reno ### 2043987###Presenter###Assistant Professor for program Evaluation###University of Nevada Reno###
Presenter: Najat Elgeberi, Ph.D. – University of Nevada Reno
### @@@ Najat Elgeberi, Ph.D. – University of Nevada Reno ### 2043987###Author###Assistant Professor for program Evaluation###University of Nevada Reno###
Author: Najat Elgeberi, Ph.D. – University of Nevada Reno
### @@@ Vikram Koundinya, PhD – University of California-Davis ### 2044183###Presenter###Associate Professor of Extension & Evaluation Specialist###University of California-Davis###
Presenter: Vikram Koundinya, PhD – University of California-Davis
### @@@ Vikram Koundinya, PhD – University of California-Davis ### 2044183###Author###Associate Professor of Extension & Evaluation Specialist###University of California-Davis###
Author: Vikram Koundinya, PhD – University of California-Davis
### @@@ Nav Ghimire, Ph.D. – University of Idaho Boise ### 2044184###Presenter###Associate Director of UI Extension###University of Idaho Boise###
Presenter: Nav Ghimire, Ph.D. – University of Idaho Boise
### @@@ Nav Ghimire, Ph.D. – University of Idaho Boise ### 2044184###Author###Associate Director of UI Extension###University of Idaho Boise###
Author: Nav Ghimire, Ph.D. – University of Idaho Boise
### @@@ Mary Halbleib, Masters (she/her/hers) – Oregon State University ### 2044185###Author###Professor (Practice)###Oregon State University###
Author: Mary Halbleib, Masters (she/her/hers) – Oregon State University
### she/her/hers @@@ LaJoy R. Spears, Ph.D. – New Mexico State University ### 2044186###Presenter###Assistant Professor, Evaluation Specialist###New Mexico State University###
Presenter: LaJoy R. Spears, Ph.D. – New Mexico State University
### @@@ LaJoy R. Spears, Ph.D. – New Mexico State University ### 2044186###Author###Assistant Professor, Evaluation Specialist###New Mexico State University###
Author: LaJoy R. Spears, Ph.D. – New Mexico State University
### @@@ Alda Norris, PhD (she/her/hers) – Institute of Agriculture, Natural Resources and Extension, University of Alaska Fairbanks ### 2044187###Author###Evaluation Specialist and Civil Rights Compliance Coordinator###Institute of Agriculture, Natural Resources and Extension, University of Alaska Fairbanks###
Author: Alda Norris, PhD (she/her/hers) – Institute of Agriculture, Natural Resources and Extension, University of Alaska Fairbanks
### she/her/hers @@@ Kristina Sayama, MPA, CM – University of Guam ### 2044188###Author###Extension Agent II / Instructor of Community Development / IOA-LSAMP Campus Coordinator###University of Guam###
Author: Kristina Sayama, MPA, CM – University of Guam
### @@@ Christina Sanders, Ph.D. – Washington State University Extension ### 2044189###Author###Director Division of Governmental Studies and Services###Washington State University Extension###
Author: Christina Sanders, Ph.D. – Washington State University Extension
### @@@ Alda Norris, PhD (she/her/hers) – Institute of Agriculture, Natural Resources and Extension, University of Alaska Fairbanks ### 2044187###Presenter###Evaluation Specialist and Civil Rights Compliance Coordinator###Institute of Agriculture, Natural Resources and Extension, University of Alaska Fairbanks###
Presenter: Alda Norris, PhD (she/her/hers) – Institute of Agriculture, Natural Resources and Extension, University of Alaska Fairbanks
### she/her/hers

3:45 PM – 4:45 PM ET

Telling the Story of U.S. DoD Global Health Engagement through Assessment, Monitoring, and Evaluation

Disscussant: Jessica Jackson, MA, MPH – Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc.

Presenter: Amber Rollings, PhD – Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc.

Presenter: Elizabeth Pertner, PhD – Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc.

Presenter: Eric Regalbuto, M.Sc. – Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc.

Location: Room 105

Military and Veteran Evaluation

3:45 PM – 4:45 PM ET

African Partnership Outbreak Response Alliance (APORA): Evaluating an initiative building multisectoral health security alliances

Presenter: Amber Rollings, PhD – Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc.

3:45 PM – 4:45 PM ET

African Peacekeeping Rapid Response Partnership Medical Program (APRRP): Successes, challenges, and enabling sustainability for peacekeeping

Presenter: Elizabeth Pertner, PhD – Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc.

3:45 PM – 4:45 PM ET

Medical Evaluations Describing Interoperability Capability Assessment Levels of Partner Trauma Institutions or Non-Battle Injury Services

Presenter: Eric Regalbuto, M.Sc. – Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc.

3:45 PM – 4:45 PM ET

Summaries of Successes and Challenges

Presenter: Jessica Jackson, MA, MPH – Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc.

3:45 PM – 4:45 PM ET

The Role of Bangladesh Government in Implementation of Right to Education for Underprivileged Children: Emerging Challenges and Prospects

Presenter: Md. Amir Hossain (he/him/his) – IBAIS University

Disabilities and Underrepresented Populations

3:45 PM – 4:45 PM ET

The Stories we tell ourselves about the big, bad private sector - repositioning the value proposition of evaluation in corporate contexts.

Facilitator: Jared Raynor, n/a – TCC Group

Presenter: Morgan Buras-Finlay, MSW – Raya Cooper Impact Consulting

Presenter: Veronica Olazabal, Masters – BHP

Presenter: John Sherman, MPH (he/him/his) – Sherman Impact Consulting

Location: Room 204

Social Impact Measurement

3:45 PM – 4:45 PM ET

New narratives for impact in finance

Presenter: Jane Reisman, PhD – Jane Reisman Ph.D.

3:45 PM – 4:45 PM ET

Painpoints that evaluation can solve in the private sector

Presenter: Veronica Olazabal, Masters – BHP

3:45 PM – 4:45 PM ET

Telling stories of evaluation to business leaders

Presenter: Morgan Buras-Finlay, MSW – Raya Cooper Impact Consulting

3:45 PM – 4:45 PM ET

The need for evaluators in market-based spaces

Presenter: Jared Raynor, n/a – TCC Group

3:45 PM – 4:45 PM ET

The story of the orchestra on the Titanic: Lessons Learned from a Sinking Evaluation

Presenter: Crystal Luce, n/a – Aurora Research Institute

Location: Room 209

Graduate Student and New Evaluators

3:45 PM – 4:45 PM ET

The transformative power of using stories to understand lived experience and strengthen cultural competency in evaluating health equity related to drug overdose

Presenter: Jasmine Kenney, MPH – Centers for Disease Control and Prevention

Author: Gary Chovnick, n/a – ICF

Author: Rosanne Hoffman, n/a – ICF

Author: Shelley Kay, n/a – ICF

Location: Room 209

Collaborative, Participatory & Empowerment Evaluation

3:45 PM – 4:45 PM ET

The Utility of Utilization-Focused Evaluation in Education: From Engagement to Co-Design

Presenter: Katherine Merriweather, PhD – E3 Alliance- Austin Community College

Location: Room 209

PreK-12 Educational Evaluation

3:45 PM – 4:45 PM ET

To Tell Powerful Stories about the Impact of Our Work, We Must First Build Evaluation Capacity: Documenting Our ECB Effort at the Collaborative for Academic, Social, and Emotional Learning (CASEL)

Presenter: Rafiqah Mustafaa, PhD (she/her/hers) – CASEL

Presenter: Duncan Meyers, Ph.D. – CASEL

Author: Duncan Meyers, Ph.D. – CASEL

Author: Alexandra Skoog-Hoffman, Ph.D. – CASEL

Location: Room 209

Organizational Learning & Evaluation Capacity Building

3:45 PM – 4:45 PM ET

Translating Evaluation for the Unrecognized Evaluator

Presenter: Ashley Chavez, CHW – Minnesota Department of Health

Location: Room 209

Collaborative, Participatory & Empowerment Evaluation

3:45 PM – 4:45 PM ET

Using Evidence for Learning in USG International Development Agencies