Manuscript Details

Wang, Y., & Sturmfels, N. (2023). Exploring Employment and Education Outcomes for Caregivers Participating in Parents as Teachers: Home Visiting Outcomes Analysis Results. Arlington, VA: James Bell Associates. https://parentsasteachers.org/wp-content/uploads/2023/05/Employment-and…

Low rating
This manuscript received a low rating because the measures of effectiveness cannot be attributed solely to the intervention due to a confounding factor.

Study reviewed under: Handbook of Procedures and Standards, Version 2.3
Study design characteristics contributing to rating
Design Random assignment compromised? Attrition Baseline equivalence Confounding factors? Valid, reliable measures?
Non-experimental comparison group design Not applicable Not applicable

Not assessed

Yes

Not assessed

Notes from the review of this manuscript

The study authors used different sources of outcomes data for the intervention and comparison groups, and they used specific imputation approaches for each data source. This approach creates a confounding factor because observed effects could be attributed to the manner of data collection rather than the effectiveness of the intervention condition. HomVEE standards require a consistent manner of data collection between the intervention and comparison conditions and that the imputation approach be the same in each group.