Manuscript Details

Michalopoulos, C., Faucetta, K., Hill, C. J., Portilla, X., Burrell, L., Lee, H., Duggan, A., & Knox, V. (2019). Impacts on family outcomes of evidence-based early childhood home visiting: Results from the Mother and Infant Home Visiting Program Evaluation (OPRE Report 2019-07). [Study 4-PAT contrast]. U.S. Department of Health and Human Services, Administration for Children and Families, Office of Planning, Research, and Evaluation. https://www.acf.hhs.gov/sites/default/files/documents/opre/mihope_impac…

Study Registration: ClinicalTrials.gov
High rating
This manuscript received a rating of high because it is a randomized-controlled trial with low-attrition.

Study reviewed under: Handbook of Procedures and Standards, Version 2.3
Child Development and School Readiness
Outcome Measure Timing of Follow-Up Rating Direction of Effect Effect Size (Absolute Value) Stastical Significance Sample Size Sample Description
Brief Infant Toddler Social and Emotional Assessment (BITSEA), total problem score, fixed effect random slope method 15 months old High
0.07 Not statistically significant, p= 0.31 740 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Brief Infant Toddler Social and Emotional Assessment (BITSEA), total problem score, restricted maximum likelihood method 15 months old High
0.07 Not statistically significant, p= 0.37 740 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Brief Infant Toddler Social and Emotional Assessment (BITSEA), total problem score, split-sample method 15 months old High
0.03 Not statistically significant, p= 0.63 740 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Preschool Language Scales, Fifth Edition (PLS-5), auditory comprehension subtest, fixed effect random slope method 15 months old High
0.10 Not statistically significant, p= 0.20 614 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Preschool Language Scales, Fifth Edition (PLS-5), auditory comprehension subtest, restricted maximum likelihood method 15 months old High
0.10 Not statistically significant, p= 0.25 614 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Preschool Language Scales, Fifth Edition (PLS-5), auditory comprehension subtest, split-sample method 15 months old High
0.07 Not statistically significant, p= 0.39 614 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Effect rating key
Favorable finding / Statistically significant
Unfavorable finding / Statistically significant
Ambiguous finding / Statistically significant
No effect / Not statistically significant
Child Health
Outcome Measure Timing of Follow-Up Rating Direction of Effect Effect Size (Absolute Value) Stastical Significance Sample Size Sample Description
Number of Medicaid-paid child emergency department visits, fixed effect random slope method 15 months old High
Not available Not statistically significant, p= 0.93 776 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Number of Medicaid-paid child emergency department visits, restricted maximum likelihood method 15 months old High
Not available Not statistically significant, p= 0.94 776 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Number of Medicaid-paid child emergency department visits, split-sample method 15 months old High
Not available Not statistically significant, p= 0.43 776 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Number of Medicaid-paid well-child visits, fixed effect random slope method 15 months old High
Not available Not statistically significant, p= 0.98 776 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Number of Medicaid-paid well-child visits, restricted maximum likelihood method 15 months old High
Not available Not statistically significant, p= 0.82 776 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Number of Medicaid-paid well-child visits, split-sample method 15 months old High
Not available Not statistically significant, p= 0.66 776 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Effect rating key
Favorable finding / Statistically significant
Unfavorable finding / Statistically significant
Ambiguous finding / Statistically significant
No effect / Not statistically significant
Family Economic Self-Sufficiency
Outcome Measure Timing of Follow-Up Rating Direction of Effect Effect Size (Absolute Value) Stastical Significance Sample Size Sample Description
Health insurance coverage for the child (%), fixed effect random slope method 15 months old High
Not available Not statistically significant, p= 0.76 892 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Health insurance coverage for the child (%), restricted maximum likelihood method 15 months old High
Not available Not statistically significant, p= 0.78 892 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Health insurance coverage for the child (%), split-sample method 15 months old High
0.40 Not statistically significant, p= 0.84 892 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Receiving education or training (%), fixed effect random slope method 15 months old High
Not available Not statistically significant, p= 0.36 725 mothers PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Receiving education or training (%), restricted maximum likelihood method 15 months old High
Not available Not statistically significant, p= 0.33 725 mothers PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Receiving education or training (%), split-sample method 15 months old High
0.14 Not statistically significant, p= 0.24 725 mothers PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Effect rating key
Favorable finding / Statistically significant
Unfavorable finding / Statistically significant
Ambiguous finding / Statistically significant
No effect / Not statistically significant
Maternal Health
Outcome Measure Timing of Follow-Up Rating Direction of Effect Effect Size (Absolute Value) Stastical Significance Sample Size Sample Description
New pregnancy after study entry (%), fixed effect random slope method 15 months old High
Not available Not statistically significant, p= 0.80 717 mothers PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
New pregnancy after study entry (%), restricted maximum likelihood method 15 months old High
Not available Not statistically significant, p= 0.81 717 mothers PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
New pregnancy after study entry (%), split-sample method 15 months old High
0.08 Not statistically significant, p= 0.48 717 mothers PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Effect rating key
Favorable finding / Statistically significant
Unfavorable finding / Statistically significant
Ambiguous finding / Statistically significant
No effect / Not statistically significant
Positive Parenting Practices
Outcome Measure Timing of Follow-Up Rating Direction of Effect Effect Size (Absolute Value) Stastical Significance Sample Size Sample Description
Three-Bag Task composite score of parental supportiveness, fixed effect random slope method 15 months old Moderate
0.17 Statistically significant, p= 0.04 617 mothers PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Three-Bag Task composite score of parental supportiveness, restricted maximum likelihood method 15 months old Moderate
0.17 Statistically significant, p= 0.05 617 mothers PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Three-Bag Task composite score of parental supportiveness, split-sample method 15 months old Moderate
0.15 Not statistically significant, p= 0.06 617 mothers PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Effect rating key
Favorable finding / Statistically significant
Unfavorable finding / Statistically significant
Ambiguous finding / Statistically significant
No effect / Not statistically significant
Reductions In Child Maltreatment
Outcome Measure Timing of Follow-Up Rating Direction of Effect Effect Size (Absolute Value) Stastical Significance Sample Size Sample Description
Any Medicaid-paid health care encounter for injury or ingestion (%), fixed effect random slope method 15 months old High
Not available Not statistically significant, p= 0.38 776 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Any Medicaid-paid health care encounter for injury or ingestion (%), restricted maximum likelihood method 15 months old High
Not available Not statistically significant, p= 0.56 776 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Any Medicaid-paid health care encounter for injury or ingestion (%), split-sample method 15 months old High
0.13 Not statistically significant, p= 0.23 776 children PAT vs. Resource referral RCT (MIHOPE), 2012-2015, United States, full sample
Effect rating key
Favorable finding / Statistically significant
Unfavorable finding / Statistically significant
Ambiguous finding / Statistically significant
No effect / Not statistically significant

This study included participants with the following characteristics at enrollment:

Race/Ethnicity

The race and ethnicity categories may sum to more than 100 percent if Hispanic ethnicity was reported separately or respondents could select two or more race or ethnicity categories.

Black or African American
28%
Hispanic or Latino
30%
White
34%
Unknown
8%

Maternal Education

Less than a high school diploma
45%
Unknown
56%

Other Characteristics

Enrollment in means-tested programs
67%

This study included participants from the following locations:

  • California
  • Georgia
  • Illinois
  • Iowa
  • Kansas
  • Michigan
  • Nevada
  • New Jersey
  • Pennsylvania
  • South Carolina
  • Washington
  • Wisconsin
Study Participants
  • Participants were eligible for the Mother and Infant Home Visiting Program Evaluation (MIHOPE) evaluation if they were age 15 or older at enrollment, were pregnant or had a young child, and spoke English or Spanish proficiently.
  • A total of 963 participants were recruited for the study in PAT programs and randomly assigned to either the PAT home visiting intervention group (486 participants) or the comparison condition (477 participants).
  • Fifty-one percent of the mothers recruited through PAT programs were pregnant at the time of enrollment.
  • Outcomes were measured when children were approximately 15 months old.
Setting

Researchers recruited families from 21 local PAT programs in 12 U.S. states. The programs mainly operated in metropolitan areas.

Intervention condition
Comparison Conditions

Women assigned to the comparison group were not eligible to receive PAT services. They received information about other services in their local community.

Subgroups examined

None

Author Affiliation

Authors are affiliated with MDRC and subcontractors James Bell Associates, Johns Hopkins University, Mathematica, the University of Georgia, and Columbia University. HomVEE is not aware of any relationship between the authors and the home visiting model developer or distributor.

Funding Sources

This research was supported by the Administration for Children and Families and funded by the U.S. Department of Health and Human Services under a competitive award, Contract No. HHS-HHSP23320095644WC.

Study design characteristics contributing to rating
Design Attrition Baseline equivalence Confounding factors? Valid, reliable measures?
Randomized controlled trial Low

Not assessed for randomized controlled trials with low attrition

No

Yes

Notes from the review of this manuscript

The Mother and Infant Home Visiting Program Evaluation (MIHOPE) was a national evaluation of the Maternal, Infant, and Early Childhood Home Visiting (MIECHV) Program. MIHOPE included four evidence-based home visiting models. This review focuses on Parents as Teachers (PAT) and the findings in Michalopoulos et al. (2019). HomVEE has reviewed additional analyses from the MIHOPE evaluation under Knox & Michalopoulos (2023) and McCombs-Thornton et al. (2023). Findings in the manuscript that are pooled across various home visiting models are ineligible for review because HomVEE only reviews findings that isolate the effects of a specific model. Findings from the manuscript about quality of the home environment, receptive language skills, and child maltreatment outcomes related to physical assault or psychological aggression receive a rating of indeterminate because HomVEE could not assess whether the measures were reliable according to HomVEE standards. Information on sample sizes and reliability and validity of measures is based on correspondence with the authors.