160 - Increasing Longitudinal Response Rates Using the Tailored Panel Management Approach

Abstract Information: Often times evaluators struggle to maintain high response rates using longitudinal data collection, thus limiting the comparisons and overall conclusions they can draw. However, there are ways in which evaluators can mitigate low response rates. For instance, the Tailored Panel Management approach (TPM; Estrada et al., 2014) has been effective in maximizing response rates and retention in longitudinal studies. It proposes building a communal relationship, rather than an exchange relationship, with participants and uses four key components (compensation, communication, consistency, and credibility) to promote a longer-term commitment. We used the TPM approach in a 5-year longitudinal study that examined identity formation and balance among 1,300 White and LatinX STEM students from 12 California State Universities. Our use of a 75-day protocol and the TPM approach yielded an 87.40% response rate at the end of our first wave of data collection (W1 – Spring 2020), followed by 81.42% (W2 – Fall 2020), 80.66% (W3 – Spring 2021), 72.13% (W4 – Fall 2021), and 73.10% (W5 – Spring 2022). Our high response rates suggest that the TPM approach is effective in creating a longer-term commitment. Establishing a communal relationship through the key components that TPM has identified can help mitigate the low response rates that are often associated with longitudinal data collection. Therefore, allowing evaluators to make better inferences with their longitudinal-evaluation projects.

Relevance Statement: The proposal is relevant and important to the field of evaluation because as evaluators, we must find ways that will enable us to best interpret findings and results in a specific context. We must also use evidence and interpretations to draw conclusions, and make recommendations when needed. Many times, evaluators propose using longitudinal data collection methods but receive very low response rates and get an incomplete picture of what may be happening with the programs they are evaluating. Additionally, low response rates have often been associated with response bias and limit the conclusions that evaluators can draw. Using this Tailored Panel Management approach can help evaluators establish a connection with those responding to their surveys and set up programs for success in the future. Therefore, allowing us to hear from those who often times may be less likely to respond. As evaluators we have the responsibility to conduct thorough and methodologically sound data inquires. We must consider potential limitations and propose ways in which we can minimize them while providing the best evaluation possible.