Using Rubric Methodology to Make Sense of a Complex Project

The Carolina Family Engagement Center (CFEC) is a complex, statewide initiative that is housed at our university and staffed by university personnel. CFEC has multiple components including efforts to build a statewide infrastructure for family engagement, direct support for 25 schools, a teacher partner program, and a parent leadership program. A primary challenge of the CFEC evaluation has been succinctly capturing how the data collected on the myriad project initiatives provide insight into the center’s quality and impact. This presentation will focus on how we use evaluation rubric methodology to organize and synthesize the diverse data collection methods, project components, and goals of such a complex project. We will discuss how we co-created the rubric with the project team and used the rubric to orient the project team (primarily trained in quantitative methods) to holistically answering evaluative questions by synthesizing various data sources rather than focusing solely on checking off whether a series of dichotomous performance indicators have been met. In working with this university client, who was largely receptive to formative feedback, we also used the evaluation rubric to help mitigate the challenge of scope creep. We will also discuss how we use evaluation rubric methodology to provide a framework not only for data collection and synthesis, but also for reporting in order to produce reports that are user-friendly for the client.