Qualitative Methods
Jacqueline Singh, PhD, MPP, Certified ROI Professional (she/her/hers)
Executive Evaluation & Program Design Advisor
Qualitative Advantage, LLC
Indianapolis, Indiana, United States
Location: Grand Ballroom 4
Abstract Information: Autoethnography combines reflexivity, storytelling, and interpretation to understand how personal experience is linked to wider cultural, political, and social structures. It enables us to explore our own experiences and thoughts, which makes it a valuable tool for evaluation in a variety of ways. For example, autoethnography can lead to deeper understanding of implicit assumptions underlying an evaluation, as well as selected strategies used to collect data and interpret results. During this roundtable, the presenter will: 1) introduce and describe autoethnography as well as the qualities that overlap with storytelling; 2) provide an overview of the process involved; 3) briefly share aspects of an autoethnography currently undertaken to understand a complex web of personal and professional experiences; and, 4) engage with participants in brainstorming potential applications of autoethnography within varying contexts and settings in evaluation.
Relevance Statement: This proposal addresses autoethnography to consider its potential applications in various evaluation contexts. According to Poulos (2021), autoethnography possesses key features that distinguish it from other qualitative methods. Autoethnography, necessitates: a) being actively engaged in reflexivity, while being grounded in systematic introspection; b) writing with an aim to tell a compelling story of self-revelation, self-evaluation, and human engagement; and, c) to treat one’s writing process as a form of inquiry to discover, inquire, explore, and show rather than to tell what is known. Autoethnography empowers individuals to describe and analyze experiences (past to present) to gain deeper understanding of how these experiences are influenced by cultural, historical, and social contexts. Essentially, autoethnography is a qualitative research methodology that draws on qualitative traditions, which includes among others, autobiography and ethnography—but, still remains mysterious to many scholars (Cooper & Lilyea, 2021).
Evaluations are sometimes designed with a single methodology in mind, while others may start with theory or an underlying framework. In either case, keeping the “purpose” of an evaluation front and center is important. Purpose informs evaluation/research questions, which informs the methodology used. At the outset, a focus on purpose ensures that related processes (e.g., key individuals’ involvement, methodology, data collection and analysis, etc.) are intentional and meaningful. As such, autoethnography could reasonably play a discerning role in evaluation. It requires intentionality and self-reflection. It also accords opportunities for individuals to purposefully examine their experiences and beliefs—including the meaning(s) others may assign to their experiences (from analytical and critical perspectives), which could be used to strengthen respective evaluation/research processes. Bearing this in mind, the proposed roundtable speaks to autoethnography (and its variations) as a qualitative research methodology, which can help diversify the power of storytelling methods that evaluators seek to bring the forefront. This roundtable addresses the potential applications of autoethnography in varying evaluation contexts. The goals are: 1) describe autoethnography and qualities that overlap with storytelling; 2) provide an overview of the process; and, 3) brainstorm plausible applications of autoethnography within different contexts and settings of evaluation (e.g., public policy, education, societal issues, government and/or nonprofit programs, etc.). In addition, aspects of a current autoethnography undertaken by the presenter to understand a complex web of experiences will be shared. What is compelling, for this evaluator, is autoethnography enabled me to focus on personal experiences within varying social/cultural contexts, as well as various social issues and policies that often get evaluated. For me, autoethnography personalized and provided tremendous learning and insights into present day issues regarding social justice, diversity, equity, and inclusion (DEI). When designing evaluations, evaluation practitioners should consider how autoethnography might be leveraged to help tell a powerful story. Takeaway: It is advantageous to be knowledgeable of this methodology—and, to experience it first-hand.