Skip to main content
Evaluation 2023 Main banner
Icon Legend
Presentation Icons
PD Workshop
PD Workshop
Virtual Offering
Virtual Offering
Presidential Strand
Presidential Strand
Plenary Session
Plenary Session
BOF
BOF
Ignite
Ignite
Back

Poster

Quantitative Methods: Theory and Design

Quantitative Methods: Theory and Design Poster Viewing

159 - What is equivalence testing and how do I apply it to my evaluations?

Wednesday, October 11, 2023
5:30 PM – 7:00 PM ET
Location: Griffin Hall
Programs typically aim to produce measurable changes in an outcome. For many quantitative measures, Null Hypothesis Significance Testing has been used to determine whether an intervention is effective by comparing a p-value to a predetermined significance level. However, what if an evaluator wants to examine a hypothesis of no effect? For example, one wants to demonstrate that a new program or intervention is equally as effective as another, well-used, program or intervention. Equivalence testing is a statistical procedure that tests for practical equivalence, allowing for rejection of a difference that is large enough to be practically relevant. This poster will discuss the equivalence testing procedure, best practices, a practical example, software and code recommendations, and theoretical applications to the field of evaluation. This poster presentation will focus on the Two One-Sided T-Testing and Confidence Interval Construction methods. Attendees will gain an understanding of how to perform equivalence testing and when it is appropriate to use this statistical procedure. Whether you are a program evaluator, assessment professional, or researcher, this poster session will provide valuable insights into applying equivalence testing in program evaluation.