Skip to main content
Evaluation 2023 Main banner
Icon Legend
Presentation Icons
PD Workshop
PD Workshop
Virtual Offering
Virtual Offering
Presidential Strand
Presidential Strand
Plenary Session
Plenary Session
BOF
BOF
Ignite
Ignite
Back
ViewAttendees 1

Program Theory and Theory-Driven Evaluation

How We Model Matters: Visualizing Program Theories

Friday, October 13, 2023
2:30 PM – 3:30 PM ET
Location: Grand Ballroom 10

Abstract Information: Program theories are widely used in evaluation. Over the years, evaluators have developed a wide range of techniques and methods for developing and visualizing program theories, substantively expanding our program theory toolbox. For evaluators, the growing toolbox can invoke a mixed sense of methodological opportunity and apprehension. What exactly is a “causal loop diagram”? And how is it different from a “stock and flow diagram”? And what do evaluators mean by a “nested theory of change”? The motivation for this presentation is to promote awareness and a better understanding of different types of program theories. Towards this aim, this session describes and visually illustrates different types of program theories, including causal loop diagrams, stock-and-flow diagrams, concept maps, path models, as well as nested and hybrid models. The focus of the session is intentionally on the visual models and strategies illustrated by these different types of program theories. Light refreshments in the form of stunning visuals will be provided.

Relevance Statement: The potential role and promise of program theories is a perennial topic in evaluation in general and theory-based evaluation more specifically. Despite the widespread use and sustained interest in program theory, most program theories are in the form of theories of change (action) and logic models. Informed by comprehensive reviews of published theory-based and realist evaluations, this session aims to broaden the types of program theories applied in evaluation. The overarching argument of the session is that evaluators should be more reflective about how different types of program theories and visual modeling techniques can better serve diverse purposes and applications in evaluation. Towards this aim, the session illustrates a broad range of program theories and visual strategies, reflecting on the benefits and limitations of each. The session is motivated by a forthcoming method guide on visualizing program theories (Lemire, Porowski, & Mumma, 2023). The method guide will be made available to attendees for free during the session.

Presentations:

  • 2:30 PM – 3:30 PM ET
    Capturing Complexity in Program Theories

    Presenter: Allan W. Porowski, MPA – Abt Associates

  • 2:30 PM – 3:30 PM ET
    Mapping Minds and Relations in Program Theories

    Presenter: Kaity Mumma, PhD – Abt Associates

  • 2:30 PM – 3:30 PM ET
    Stacking, Nesting, and Integrating Program Theories

    Presenter: Sebastian Lemire, PhD – Abt Associates

  • 2:30 PM – 3:30 PM ET
    The Evolution of the Use of Program Theory in Practice: A Powerful Story and Bright Future

    Presenter: Stewart I. Donaldson, Ph.D. – Claremont Graduate University