Manuscript Detail | Home Visiting Evidence of Effectiveness

Vogel, C. A., Xue, Y., Moiduddin, E. M., Kisker, E. E., & Carlson, B. L. (2010). Early Head Start children in grade 5: Long-term follow-up of the Early Head Start research and evaluation study sample (OPRE Report #2011-8). U.S. Department of Health and Human Services, Administration for Children and Families, Office of Planning, Research, and Evaluation. https://www.acf.hhs.gov/sites/default/files/documents/opre/grade5.pdf

Manuscript screening details
Screening decision	Screening conclusion	HomVEE procedures and standards version
Passes screens	Eligible for review	Version 2

Study design details
Rating	Design	Attrition	Baseline equivalence	Compromised randomization	Confounding factors	Valid, reliable measure(s)
Moderate	Randomized controlled trial	High	Established on race/ethnicity, SES, and baseline measures of the outcome(s)	No	No	Yes

Notes:

This study is based on data from a randomized controlled trial of 17 Early Head Start (EHS) programs. Seven programs served families through a home-based option (EHS–HBO), which includes weekly home visits and is the focus on HomVEE’s review. Some findings about parent substance and alcohol use, housing security, household income, and family conflict received a low rating because they had high attrition and did not satisfy the baseline equivalence requirement. Some findings about children’s reading and math proficiency, social-emotional skills, parent relationship, and parenting practices received an indeterminate rating because HomVEE could not assess whether the measures were reliable or if baseline equivalence requirements were satisfied according to HomVEE standards. One finding about whether a child had 26 or more books at home was ineligible to review because the “26 or more” threshold was not justified. Information on reliability of measures, along with information necessary to demonstrate equivalence of the intervention and comparison groups, is based on correspondence with the author.

Study characteristics
Study participants	Study participants were families who met criteria to qualify for Early Head Start (EHS) programs, which included having a household income at or below the federal poverty level or having a child with a disability who is eligible for Part C services under the Individuals with Disabilities Education Act in their state. A total of 1,386 families were randomly assigned to either Early Head Start–Home-based option (EHS–HBO; 707 families) or the comparison condition (679 families). At the time of enrollment, the mother was pregnant or the focal child was younger than 12 months old. Outcomes were measured when the focal child was in Grade 5. For this follow-up, 748 families (397 in EHS–HBO and 351 in the comparison group) provided data. In the study, 43 percent of the primary caregivers were non-Hispanic White, 29 percent were non-Hispanic Black, 26 percent were Hispanic, and 3 percent identified as another race. Thirty-three percent of the families in the study had household income below 33 percent of the federal poverty level (FPL); 27 percent had household income between 33 and 66 percent FPL; 28 percent had household income between 67 and 99 percent FPL; and 12 percent had household income greater than or equal to 100 percent FPL.
Setting	The study was conducted in 17 EHS programs throughout the United States, including seven programs with home-based options, which are the focus of this report.
Intervention services	As described in this manuscript, Early Head Start–Home-based option (EHS–HBO) services were delivered to families during weekly home visits. Typical home visits are at least one hour long. Topics for home visits included child growth and development, child play activities, housing issues, and parent-child communication.
Comparison conditions	Families assigned to the comparison condition were not eligible to enroll in EHS–HBO. They could receive other services available in the community.
Subgroups examined	This field lists subgroups examined in the manuscript (even if they were not replicated in other samples and not reported on the summary page for this model’s report). There were no subgroups reported in this manuscript.
Funding sources	This research was supported by the Office of Planning, Research, and Evaluation, with funding by the U.S. Department of Health and Human Services under a competitive award, Contract No. HHSP233200700009T.
Author affiliation	Authors were affiliated with Mathematica and its subcontractor, Twin Peaks Partners, LLC. HomVEE is not aware of any relationship between the authors and the home visiting model’s developer or distributor.
Peer reviewed	Peer reviewed status is not listed for manuscripts reviewed before 2021.

Study Registration:

Clinicaltrials.gov Identifier: None found. SocialScienceRegistry.org Identifier: None found. Registry of Efficacy and Effectiveness Studies Identifier: None found. Study registration was assessed by HomVEE for Clinicaltrials.gov beginning with the 2014 review, and for other registries beginning with the 2021 review.

Findings that rate moderate or high

Child development and school readiness
Rating	Outcome measure	Effect	Sample	Timing of follow-up	Sample size	Intervention group	Comparison group	Group difference	Effect size	Statistical significance	Notes
Moderate	ADD/ADHD diagnosis	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	744 children	Adjusted proportion = 0.13	Adjusted proportion = 0.18	Difference = -0.05	Study reported = -0.13	Not statistically significant, p ≥ 0.05
Moderate	Child Behavior Checklist (CBCL): Aggressive behavior	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	747 children	Adjusted mean = 5.90	Adjusted mean = 6.50	Mean difference = -0.60	Study reported = -0.11	Not statistically significant, p ≥ 0.05	Submitted by user on Fri, 03/15/2019 - 14:29 Negative effect is favorable to the intervention.
Moderate	Child Behavior Checklist (CBCL): Anxious/depressed	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	747 children	Adjusted mean = 3.20	Adjusted mean = 3.70	Mean difference = -0.50	Study reported = -0.14	Not statistically significant, p ≥ 0.05	Submitted by user on Fri, 03/15/2019 - 14:29 Negative effect is favorable to the intervention.
Moderate	Child Behavior Checklist (CBCL): Attention problems	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	747 children	Adjusted mean = 4.20	Adjusted mean = 4.60	Mean difference = 0.00	Study reported = -0.11	Not statistically significant, p ≥ 0.05	Submitted by user on Fri, 03/15/2019 - 14:29 Negative effect is favorable to the intervention.
Moderate	Child Behavior Checklist (CBCL): Externalizing behavior	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	747 children	Adjusted mean = 8.20	Adjusted mean = 9.00	Mean difference = 0.00	Study reported = -0.10	Not statistically significant, p ≥ 0.05	Submitted by user on Fri, 03/15/2019 - 14:29 Negative effect is favorable to the intervention.
Moderate	Child Behavior Checklist (CBCL): Internalizing behavior	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	747 children	Adjusted mean = 6.20	Adjusted mean = 6.80	Mean difference = -0.60	Study reported = -0.11	Not statistically significant, p ≥ 0.05	Submitted by user on Fri, 03/15/2019 - 14:29 Negative effect is favorable to the intervention.
Moderate	Child Behavior Checklist (CBCL): Rule-breaking behavior	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	747 children	Adjusted mean = 2.30	Adjusted mean = 2.50	Mean difference = -0.20	Study reported = -0.08	Not statistically significant, p ≥ 0.05	Submitted by user on Fri, 03/15/2019 - 14:29 Negative effect is favorable to the intervention.
Moderate	Child Behavior Checklist (CBCL): Social problems	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	747 children	Adjusted mean = 2.80	Adjusted mean = 3.10	Mean difference = -0.30	Study reported = -0.11	Not statistically significant, p ≥ 0.05	Submitted by user on Fri, 03/15/2019 - 14:29 Negative effect is favorable to the intervention.
Moderate	Child Behavior Checklist (CBCL): Somatic complaints	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	747 children	Adjusted mean = 1.10	Adjusted mean = 1.20	Mean difference = -0.10	Study reported = -0.07	Not statistically significant, p ≥ 0.05	Submitted by user on Fri, 03/15/2019 - 14:29 Negative effect is favorable to the intervention.
Moderate	Child Behavior Checklist (CBCL): Thought problems	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	747 children	Adjusted mean = 2.20	Adjusted mean = 2.40	Mean difference = -0.20	Study reported = -0.08	Not statistically significant, p ≥ 0.05	Submitted by user on Fri, 03/15/2019 - 14:29 Negative effect is favorable to the intervention.
Moderate	Child Behavior Checklist (CBCL): Withdrawn/depressed	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	747 children	Adjusted mean = 1.90	Adjusted mean = 1.90	Mean difference = 0.00	Study reported = -0.02	Not statistically significant, p ≥ 0.05	Submitted by user on Fri, 03/15/2019 - 14:29 Negative effect is favorable to the intervention.
Moderate	Chronic absenteeism (%)	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	737 children	Adjusted proportion = 0.11	Adjusted proportion = 0.09	Difference = 0.02	Study reported = 0.06	Not statistically significant, p ≥ 0.05	Submitted by user on Fri, 03/15/2019 - 14:29 Negative effect is favorable to the intervention.
Moderate	Early Childhood Longitudinal Studies - Kindergarten Self Description Questionnaire (ECLS-K SDQ): Anger/distractibility	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	709 children	Adjusted mean = 2.20	Adjusted mean = 2.10	Mean difference = 0.10	Study reported = 0.04	Not statistically significant, p ≥ 0.05
Moderate	Early Childhood Longitudinal Studies - Kindergarten Self Description Questionnaire (ECLS-K SDQ): Peer relations	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	707 children	Adjusted mean = 3.10	Adjusted mean = 3.20	Mean difference = 0.00	Study reported = -0.09	Not statistically significant, p ≥ 0.05
Moderate	Early Childhood Longitudinal Studies - Kindergarten Self Description Questionnaire (ECLS-K SDQ): Sad/lonely/anxious	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	709 children	Adjusted mean = 2.30	Adjusted mean = 2.30	Mean difference = 0.00	Study reported = 0.00	Not statistically significant, p ≥ 0.05
Moderate	Individualized Education Plan (IEP)	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	747 children	Adjusted proportion = 0.16	Adjusted proportion = 0.15	Difference = 0.02	Study reported = 0.04	Not statistically significant, p ≥ 0.05
Moderate	Panel Study of Income Dynamics - Child Development Supplement, Wave 2 (PSID-CDS2): Bullying scale	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	705 children	Adjusted mean = 6.80	Adjusted mean = 7.00	Mean difference = -0.20	Study reported = -0.06	Not statistically significant, p ≥ 0.05
Moderate	Retention (%)	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	747 children	Adjusted proportion = 0.13	Adjusted proportion = 0.12	Difference = 0.01	Study reported = 0.04	Not statistically significant, p ≥ 0.05	Submitted by user on Fri, 03/15/2019 - 14:29 Negative effect is favorable to the intervention.
Moderate	Self-reported delinquent behavior	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	706 children	Adjusted mean = 1.60	Adjusted mean = 1.60	Mean difference = 0.00	Study reported = 0.00	Not statistically significant, p ≥ 0.05	Submitted by user on Fri, 03/15/2019 - 14:29 Negative effect is favorable to the intervention.

Family economic self-sufficiency
Rating	Outcome measure	Effect	Sample	Timing of follow-up	Sample size	Intervention group	Comparison group	Group difference	Effect size	Statistical significance
Moderate	Current participation in TANF, SNAP, general assistance, or SSI/SSA benefits	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	746 families	Adjusted proportion = 0.46	Adjusted proportion = 0.45	Difference = 0.01	Study reported = 0.02	Not statistically significant, p ≥ 0.05
Moderate	Mother's employment status	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	681 mothers	Adjusted mean = 1.90	Adjusted mean = 1.90	Mean difference = 0.00	Study reported = -0.03	Not statistically significant, p ≥ 0.05
Moderate	Mother's highest education level	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	658 mothers	Adjusted mean = 2.40	Adjusted mean = 2.30	Mean difference = 0.10	Study reported = 0.05	Not statistically significant, p ≥ 0.05

Maternal health
Rating	Outcome measure	Effect	Sample	Timing of follow-up	Sample size	Intervention group	Comparison group	Group difference	Effect size	Statistical significance	Notes
Moderate	Center for Epidemiologic Studies Depression Scale (CES-D)	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	746 caregivers	Adjusted mean = 6.90	Adjusted mean = 7.80	Mean difference = -0.90	Study reported = -0.12	Not statistically significant, p ≥ 0.05	Submitted by user on Fri, 03/15/2019 - 14:29 Negative effect is favorable to the intervention.
Moderate	Parenting Stress Index (PSI)	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	746 caregivers	Adjusted mean = 8.40	Adjusted mean = 8.80	Mean difference = -0.40	Study reported = -0.11	Not statistically significant, p ≥ 0.05

Positive parenting practices
Rating	Outcome measure	Effect	Sample	Timing of follow-up	Sample size	Intervention group	Comparison group	Group difference	Effect size	Statistical significance	Notes
Moderate	Early Childhood Longitudinal Studies - Kindergarten Self Description Questionnaire (ECLS-K SDQ): Child relationship with the father	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	461 children	Adjusted mean = 3.50	Adjusted mean = 3.50	Mean difference = 0.00	Study reported = -0.01	Not statistically significant, p ≥ 0.05
Moderate	Family involvement in school	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	733 caregivers	Adjusted proportion = 0.36	Adjusted proportion = 0.36	Difference = 0.00	Study reported = 0.00	Not statistically significant, p ≥ 0.05
Moderate	Home Observation for Measurement of the Environment (HOME) Inventory: Total score	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	700 caregivers	Adjusted mean = 27.40	Adjusted mean = 26.90	Mean difference = 0.50	Study reported = 0.12	Statistically significant, p <0.05
Moderate	Parent supervision	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	704 caregivers	Adjusted mean = 3.20	Adjusted mean = 3.20	Mean difference = 0.00	Study reported = -0.02	Not statistically significant, p ≥ 0.05
Moderate	Parenting Stress Index (PSI): Parent-Child Dysfunctional Interaction	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	746 caregivers	Adjusted mean = 9.70	Adjusted mean = 10.30	Mean difference = -0.60	Study reported = -0.12	Not statistically significant, p ≥ 0.05	Submitted by user on Fri, 03/15/2019 - 14:29 Negative effect is favorable to the intervention.
Moderate	Support for education: External to the home	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 6	737 caregivers	Adjusted mean = -0.20	Adjusted mean = -0.40	Mean difference = 0.00	Study reported = 0.03	Not statistically significant, p ≥ 0.05
Moderate	Support for education: Internal to the home	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	738 caregivers	Adjusted mean = -0.20	Adjusted mean = -0.20	Mean difference = 0.00	Study reported = -0.03	Not statistically significant, p ≥ 0.05

Reductions in juvenile delinquency, family violence, and crime
Rating	Outcome measure	Effect	Sample	Timing of follow-up	Sample size	Intervention group	Comparison group	Group difference	Effect size	Statistical significance	Notes
Moderate	Child exposure to domestic violence	FavorableUnfavorable or ambiguousNo Effect	EHS-HBO vs. comparison, 1996-1998, full sample	Grade 5	747 children	Adjusted mean = 7.60	Adjusted mean = 7.40	Mean difference = 0.20	Study reported = 0.01	Not statistically significant, p ≥ 0.05	Submitted by user on Fri, 03/15/2019 - 14:29 Negative effect is favorable to the intervention.