Manuscript Details

Shaw, D. S., Connell, A., Dishion, T. J., Wilson, M. N., & Gardner, F. (2009). Improvements in maternal depression as a mediator of intervention effects on early childhood problem behavior. Development and Psychopathology, 21, 417–439.

High rating
Study reviewed under: Handbook of Procedures and Standards, Version 1
Study design characteristics contributing to rating
Design Attrition Baseline equivalence Confounding factors? Valid, reliable measures?
Randomized controlled trial Low

Established on race/ethnicity and SES; not established on baseline measures of the outcomes.

None

Not assessed in manuscripts reviewed under Handbook of Procedures and Standards, Version 1
Notes from the review of this manuscript

Even though baseline equivalence was not established on baseline measures of the outcomes, this study rated high because it had low attrition, established baseline equivalence on race/ethnicity and SES, and controlled for baseline measures of some outcomes in the analyses. Those outcomes rated high. In addition to the outcomes that rated high, several outcomes in this study rated low: Eyeberg problem behavior at ages 3 and 4, externalizing behavior at ages 3 and 4, parent involvement at age 3, positive parenting at age 3, parent neutral at age 3, and Proactive parenting at age 3. These outcomes rated low because we could not assess attrition or baseline equivalence based on information reported in the study, nor was this information available from the author. Also, some outcomes in the structural equation models reported in this study were not eligible for review because the model did not estimate the direct, total effect of the intervention on the outcome.This study is part of a large RCT described by Dishion et al. (2008).

This study review was updated in 2017. Specifically, HomVEE identified additional outcomes within this study that were eligible for review in the course of the 2017 annual review. Those additional outcomes that received a moderate or high rating are reported for the study. The review of additional outcomes did not affect the overall study rating.

Child Development and School Readiness
Outcome Measure Timing of Follow-Up Rating Direction of Effect Effect Size (Absolute Value) Stastical Significance Sample Size Sample Description
Child Behavior Checklist (CBCL) Externalizing, Age 3, Correlation Age 3 High
Not statistically significant, p ≥ 0.05 651 children WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Child Behavior Checklist (CBCL) Externalizing, Age 4, Correlation Age 4 High
Statistically significant, p 619 children WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Child Behavior Checklist (CBCL) Internalizing, Age 3, Correlation Age 3 High
Not statistically significant, p ≥ 0.05 651 children WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Child Behavior Checklist (CBCL) Internalizing, Age 4, Correlation Age 4 High
Statistically significant, p 619 children WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Eyeberg Child Behavior Inventory Problem Score, Age 3, Correlation Age 3 High
Not statistically significant, p ≥ 0.05 642 children WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Eyeberg Child Behavior Inventory Problem Score, Age 4, Correlation Age 4 High
Statistically significant, p 616 children WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Growth in Child Behavior Checklist (CBCL) Externalizing from ages 2 to 4, Latent growth model Ages 3 and 4 High
0.23 Statistically significant, p 731 children WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Growth in Child Behavior Checklist (CBCL) Internalizing from ages 2 to 4, Latent growth model Ages 3 and 4 High
0.21 Statistically significant, p 731 children WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Growth in Eyeberg Child Behavior Inventory Problem Score from ages 2 to 4, Latent growth model Ages 3 and 4 High
0.23 Statistically significant, p 731 mothers WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Effect rating key
Favorable finding / Statistically significant
Unfavorable finding / Statistically significant
Ambiguous finding / Statistically significant
No effect / Not statistically significant
Maternal Health
Outcome Measure Timing of Follow-Up Rating Direction of Effect Effect Size (Absolute Value) Stastical Significance Sample Size Sample Description
Maternal Depression (Center for Epidemiological Studies Depression Scale), Age 3, SEM, Figure 2 Age 3 High
Statistically significant, p 731 mothers WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Maternal Depression (Center for Epidemiological Studies Depression Scale), Age 3, SEM, Figure 3 Age 3 High
Statistically significant, p 731 mothers WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Maternal Depression (Center for Epidemiological Studies Depression Scale), Age 3, SEM, Figure 4 Age 3 High
Statistically significant, p 731 mothers WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Maternal Depression (Center for Epidemiological Studies Depression Scale), Age 3, SEM, Figure 5 Age 3 High
Statistically significant, p 731 mothers WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Maternal Depression (Center for Epidemiological Studies Depression Scale), Age 3, SEM, Figure 6 Age 3 High
Statistically significant, p 731 mothers WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Maternal Depression (Center for Epidemiological Studies Depression Scale), Age 3, SEM, Figure 7 Age 3 High
Statistically significant, p 731 mothers WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Maternal Depression (Center for Epidemiological Studies Depression Scale), Age 3, Autoregressive model Age 3 High
0.18 Statistically significant, p 731 mothers WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Maternal Depression (Center for Epidemiological Studies Depression Scale), Age 3, Correlation Age 3 High
Not statistically significant, p ≥ 0.05 651 mothers WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Effect rating key
Favorable finding / Statistically significant
Unfavorable finding / Statistically significant
Ambiguous finding / Statistically significant
No effect / Not statistically significant
Positive Parenting Practices
Outcome Measure Timing of Follow-Up Rating Direction of Effect Effect Size (Absolute Value) Stastical Significance Sample Size Sample Description
Positive Parenting, Age 3, SEM, Figure 5 Age 3 High
Statistically significant, p 731 mothers WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Positive Parenting, Age 3, SEM, Figure 6 Age 3 High
Statistically significant, p 731 mothers WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Positive Parenting, Age 3, SEM, Figure 7 Age 3 High
Statistically significant, p 731 mothers WIC sites in Pittsburgh, PA, Eugene, OR, and Charlottesville, VA
Effect rating key
Favorable finding / Statistically significant
Unfavorable finding / Statistically significant
Ambiguous finding / Statistically significant
No effect / Not statistically significant

This study included participants with the following characteristics at enrollment:

Race/Ethnicity

The race and ethnicity categories may sum to more than 100 percent if Hispanic ethnicity was reported separately or respondents could select two or more race or ethnicity categories.

Black or African American
28%
Hispanic or Latino
13%
White
50%
Two or more races
13%
Unknown
9%

Maternal Education

Less than a high school diploma
24%
High school diploma or GED
41%
Unknown
35%

Other Characteristics

Enrollment in means-tested programs
100%

This study included participants from the following locations:

  • Oregon
  • Pennsylvania
  • Virginia
Study Participants

The study included 731 families that met two criteria. First, they participated in the Supplemental Nutrition Program for Women, Infants, and Children (WIC) when their son or daughter was between 2 years 0 months old and 2 years 11 months old. Second, they met the study’s criteria for being at risk for behavior problems—defined as one standard deviation or more above normative averages in at least two of three domains: (1) child behavior problems (such as conduct problems or high-conflict relationships with adults); (2) primary caregiver problems (such as maternal depression, daily parenting challenges, self-reported substance or mental health diagnosis, or status as a teen parent at first birth); and (3) socioeconomic status (a caregiver with low educational achievement or low family income based on WIC criteria). Screening was conducted in 2002 and 2003. Of the 731 primary caregivers who agreed to participate, 41 percent had a high school diploma or GED, 32 percent had one or two years of post-high school training, and 24 percent had less than a high school diploma or GED. More than two-thirds of the randomized sample had an annual income below $20,000. Of the 731 children in the study, 50 percent were European American, 28 percent were African American, 13 percent were biracial, and 9 percent were from another racial group. Thirteen percent were Hispanic. The children were 29.9 months old on average at the time of the age 2 assessments. Forty-nine percent of the children were female, and 58 percent lived in two-parent households.

Setting

Families were recruited from WIC program sites in and around Pittsburgh, Pennsylvania (37 percent of sample); Eugene, Oregon (37 percent of sample); and Charlottesville, Virginia (26 percent of sample).

Intervention condition
Comparison Conditions

Families in the comparison group received the Family Check-Up's comprehensive assessment but did not receive any other interventions or services.

Author Affiliation

The authors are associated with the University of Pittsburgh, Case Western Reserve University, the University of Oregon, the University of Virginia, and Oxford University. In addition, Thomas Dishion, a study author, is a developer of this model.

Funding Sources

Not reported.