Manuscript Details

Vogel, C. A., Xue, Y., Moiduddin, E. M., Kisker, E. E., & Carlson, B. L. (2010). Early Head Start children in grade 5: Long-term follow-up of the Early Head Start research and evaluation study sample (OPRE Report #2011-8). U.S. Department of Health and Human Services, Administration for Children and Families, Office of Planning, Research, and Evaluation. https://www.acf.hhs.gov/sites/default/files/documents/opre/grade5.pdf

Moderate rating
Study reviewed under: Handbook of Procedures and Standards, Version 2
Study design characteristics contributing to rating
Design Attrition Baseline equivalence Confounding factors? Valid, reliable measures?
Randomized controlled trial High

Established on race/ethnicity, SES, and baseline measures of the outcome(s)

No

Yes

Notes from the review of this manuscript

This study is based on data from a randomized controlled trial of 17 Early Head Start (EHS) programs. Seven programs served families through a home-based option (EHS–HBO), which includes weekly home visits and is the focus on HomVEE’s review. Some findings about parent substance and alcohol use, housing security, household income, and family conflict received a low rating because they had high attrition and did not satisfy the baseline equivalence requirement. Some findings about children’s reading and math proficiency, social-emotional skills, parent relationship, and parenting practices received an indeterminate rating because HomVEE could not assess whether the measures were reliable or if baseline equivalence requirements were satisfied according to HomVEE standards. One finding about whether a child had 26 or more books at home was ineligible to review because the “26 or more” threshold was not justified. Information on reliability of measures, along with information necessary to demonstrate equivalence of the intervention and comparison groups, is based on correspondence with the author.

Child Development and School Readiness
Outcome Measure Timing of Follow-Up Rating Direction of Effect Effect Size (Absolute Value) Stastical Significance Sample Size Sample Description
ADD/ADHD diagnosis Grade 5 Moderate
0.13 Not statistically significant, p ≥ 0.05 744 children EHS-HBO vs. comparison, 1996-1998, full sample
Child Behavior Checklist (CBCL): Aggressive behavior Grade 5 Moderate
0.11 Not statistically significant, p ≥ 0.05 747 children EHS-HBO vs. comparison, 1996-1998, full sample
Child Behavior Checklist (CBCL): Anxious/depressed Grade 5 Moderate
0.14 Not statistically significant, p ≥ 0.05 747 children EHS-HBO vs. comparison, 1996-1998, full sample
Child Behavior Checklist (CBCL): Attention problems Grade 5 Moderate
0.11 Not statistically significant, p ≥ 0.05 747 children EHS-HBO vs. comparison, 1996-1998, full sample
Child Behavior Checklist (CBCL): Externalizing behavior Grade 5 Moderate
0.10 Not statistically significant, p ≥ 0.05 747 children EHS-HBO vs. comparison, 1996-1998, full sample
Child Behavior Checklist (CBCL): Internalizing behavior Grade 5 Moderate
0.11 Not statistically significant, p ≥ 0.05 747 children EHS-HBO vs. comparison, 1996-1998, full sample
Child Behavior Checklist (CBCL): Rule-breaking behavior Grade 5 Moderate
0.08 Not statistically significant, p ≥ 0.05 747 children EHS-HBO vs. comparison, 1996-1998, full sample
Child Behavior Checklist (CBCL): Social problems Grade 5 Moderate
0.11 Not statistically significant, p ≥ 0.05 747 children EHS-HBO vs. comparison, 1996-1998, full sample
Child Behavior Checklist (CBCL): Somatic complaints Grade 5 Moderate
0.07 Not statistically significant, p ≥ 0.05 747 children EHS-HBO vs. comparison, 1996-1998, full sample
Child Behavior Checklist (CBCL): Thought problems Grade 5 Moderate
0.08 Not statistically significant, p ≥ 0.05 747 children EHS-HBO vs. comparison, 1996-1998, full sample
Child Behavior Checklist (CBCL): Withdrawn/depressed Grade 5 Moderate
0.02 Not statistically significant, p ≥ 0.05 747 children EHS-HBO vs. comparison, 1996-1998, full sample
Chronic absenteeism (%) Grade 5 Moderate
0.06 Not statistically significant, p ≥ 0.05 737 children EHS-HBO vs. comparison, 1996-1998, full sample
Early Childhood Longitudinal Studies - Kindergarten Self Description Questionnaire (ECLS-K SDQ): Anger/distractibility Grade 5 Moderate
0.04 Not statistically significant, p ≥ 0.05 709 children EHS-HBO vs. comparison, 1996-1998, full sample
Early Childhood Longitudinal Studies - Kindergarten Self Description Questionnaire (ECLS-K SDQ): Peer relations Grade 5 Moderate
0.09 Not statistically significant, p ≥ 0.05 707 children EHS-HBO vs. comparison, 1996-1998, full sample
Early Childhood Longitudinal Studies - Kindergarten Self Description Questionnaire (ECLS-K SDQ): Sad/lonely/anxious Grade 5 Moderate
0.00 Not statistically significant, p ≥ 0.05 709 children EHS-HBO vs. comparison, 1996-1998, full sample
Individualized Education Plan (IEP) Grade 5 Moderate
0.04 Not statistically significant, p ≥ 0.05 747 children EHS-HBO vs. comparison, 1996-1998, full sample
Panel Study of Income Dynamics - Child Development Supplement, Wave 2 (PSID-CDS2): Bullying scale Grade 5 Moderate
0.06 Not statistically significant, p ≥ 0.05 705 children EHS-HBO vs. comparison, 1996-1998, full sample
Retention (%) Grade 5 Moderate
0.04 Not statistically significant, p ≥ 0.05 747 children EHS-HBO vs. comparison, 1996-1998, full sample
Self-reported delinquent behavior Grade 5 Moderate
0.00 Not statistically significant, p ≥ 0.05 706 children EHS-HBO vs. comparison, 1996-1998, full sample
Effect rating key
Favorable finding / Statistically significant
Unfavorable finding / Statistically significant
Ambiguous finding / Statistically significant
No effect / Not statistically significant
Family Economic Self-Sufficiency
Outcome Measure Timing of Follow-Up Rating Direction of Effect Effect Size (Absolute Value) Stastical Significance Sample Size Sample Description
Current participation in TANF, SNAP, general assistance, or SSI/SSA benefits Grade 5 Moderate
0.02 Not statistically significant, p ≥ 0.05 746 families EHS-HBO vs. comparison, 1996-1998, full sample
Mother's employment status Grade 5 Moderate
0.03 Not statistically significant, p ≥ 0.05 681 mothers EHS-HBO vs. comparison, 1996-1998, full sample
Mother's highest education level Grade 5 Moderate
0.05 Not statistically significant, p ≥ 0.05 658 mothers EHS-HBO vs. comparison, 1996-1998, full sample
Effect rating key
Favorable finding / Statistically significant
Unfavorable finding / Statistically significant
Ambiguous finding / Statistically significant
No effect / Not statistically significant
Maternal Health
Outcome Measure Timing of Follow-Up Rating Direction of Effect Effect Size (Absolute Value) Stastical Significance Sample Size Sample Description
Center for Epidemiologic Studies Depression Scale (CES-D) Grade 5 Moderate
0.12 Not statistically significant, p ≥ 0.05 746 caregivers EHS-HBO vs. comparison, 1996-1998, full sample
Parenting Stress Index (PSI) Grade 5 Moderate
0.11 Not statistically significant, p ≥ 0.05 746 caregivers EHS-HBO vs. comparison, 1996-1998, full sample
Effect rating key
Favorable finding / Statistically significant
Unfavorable finding / Statistically significant
Ambiguous finding / Statistically significant
No effect / Not statistically significant
Positive Parenting Practices
Outcome Measure Timing of Follow-Up Rating Direction of Effect Effect Size (Absolute Value) Stastical Significance Sample Size Sample Description
Early Childhood Longitudinal Studies - Kindergarten Self Description Questionnaire (ECLS-K SDQ): Child relationship with the father Grade 5 Moderate
0.01 Not statistically significant, p ≥ 0.05 461 children EHS-HBO vs. comparison, 1996-1998, full sample
Family involvement in school Grade 5 Moderate
0.00 Not statistically significant, p ≥ 0.05 733 caregivers EHS-HBO vs. comparison, 1996-1998, full sample
Home Observation for Measurement of the Environment (HOME) Inventory: Total score Grade 5 Moderate
0.12 Statistically significant, p <0.05 700 caregivers EHS-HBO vs. comparison, 1996-1998, full sample
Parent supervision Grade 5 Moderate
0.02 Not statistically significant, p ≥ 0.05 704 caregivers EHS-HBO vs. comparison, 1996-1998, full sample
Parenting Stress Index (PSI): Parent-Child Dysfunctional Interaction Grade 5 Moderate
0.12 Not statistically significant, p ≥ 0.05 746 caregivers EHS-HBO vs. comparison, 1996-1998, full sample
Support for education: External to the home Grade 6 Moderate
0.03 Not statistically significant, p ≥ 0.05 737 caregivers EHS-HBO vs. comparison, 1996-1998, full sample
Support for education: Internal to the home Grade 5 Moderate
0.03 Not statistically significant, p ≥ 0.05 738 caregivers EHS-HBO vs. comparison, 1996-1998, full sample
Effect rating key
Favorable finding / Statistically significant
Unfavorable finding / Statistically significant
Ambiguous finding / Statistically significant
No effect / Not statistically significant
Reductions in Juvenile Delinquency, Family Violence, and Crime
Outcome Measure Timing of Follow-Up Rating Direction of Effect Effect Size (Absolute Value) Stastical Significance Sample Size Sample Description
Child exposure to domestic violence Grade 5 Moderate
0.01 Not statistically significant, p ≥ 0.05 747 children EHS-HBO vs. comparison, 1996-1998, full sample
Effect rating key
Favorable finding / Statistically significant
Unfavorable finding / Statistically significant
Ambiguous finding / Statistically significant
No effect / Not statistically significant

This study included participants with the following characteristics at enrollment:

Race/Ethnicity

The race and ethnicity categories may sum to more than 100 percent if Hispanic ethnicity was reported separately or respondents could select two or more race or ethnicity categories.

Black or African American
29%
Hispanic or Latino
26%
White
43%
Some other race
2%

Maternal Education

Less than a high school diploma
45%
High school diploma or GED
28%
Unknown
26%

Other Characteristics

Data not available

This study included participants from the following locations:

  • State not reported or international
Study Participants

Study participants were families who met criteria to qualify for Early Head Start (EHS) programs, which included having a household income at or below the federal poverty level or having a child with a disability who is eligible for Part C services under the Individuals with Disabilities Education Act in their state. A total of 1,386 families were randomly assigned to either Early Head Start–Home-based option (EHS–HBO; 707 families) or the comparison condition (679 families). At the time of enrollment, the mother was pregnant or the focal child was younger than 12 months old. Outcomes were measured when the focal child was in Grade 5. For this follow-up, 748 families (397 in EHS–HBO and 351 in the comparison group) provided data. In the study, 43 percent of the primary caregivers were non-Hispanic White, 29 percent were non-Hispanic Black, 26 percent were Hispanic, and 3 percent identified as another race. Thirty-three percent of the families in the study had household income below 33 percent of the federal poverty level (FPL); 27 percent had household income between 33 and 66 percent FPL; 28 percent had household income between 67 and 99 percent FPL; and 12 percent had household income greater than or equal to 100 percent FPL.

Setting

The study was conducted in 17 EHS programs throughout the United States, including seven programs with home-based options, which are the focus of this report.

Intervention condition
Comparison Conditions

Families assigned to the comparison condition were not eligible to enroll in EHS–HBO. They could receive other services available in the community.

Subgroups examined

There were no subgroups reported in this manuscript.

Author Affiliation

Authors were affiliated with Mathematica and its subcontractor, Twin Peaks Partners, LLC. HomVEE is not aware of any relationship between the authors and the home visiting model’s developer or distributor.

Funding Sources

This research was supported by the Office of Planning, Research, and Evaluation, with funding by the U.S. Department of Health and Human Services under a competitive award, Contract No. HHSP233200700009T.