Frequently Asked Questions

For the purposes of the HomVEE review, an early childhood home visiting model is an intervention in which trained home visitors meet with expectant parents or families with young children to deliver a specified set of services through a specified set of interactions. These programs are voluntary interventions that are either designed or adapted and tested for delivery in the home. During the visits, home visitors aim to build strong, positive relationships with families to improve child and family outcomes. Services may be delivered on a schedule that is defined or can be tailored to meet family needs. A model has a set of fidelity standards that describe how the model is to be implemented.

Models reviewed by HomVEE must serve pregnant women or families with children from birth to kindergarten entry (that is, up until their sixth birthday), and the primary service delivery strategy must be home visiting. In addition, the model must have research that examines its effects in at least one of eight outcome domains.

Yes. HomVEE will review research about models that use entirely in-person home visiting and models with hybrid approaches that use both in-person and virtual home visits. Models that deliver all services virtually are ineligible; a model must be designed or adapted to require at least one in-person (that is, not virtual) home visit. HomVEE defines a virtual home visit as “delivery of an intervention’s home visit content to an individual caregiver or family conducted solely by use of electronic information and telecommunications technologies. The content should be designed or adapted for synchronous delivery. Some content may be delivered asynchronously, but asynchronous delivery cannot be the primary mode of delivery.”

HomVEE applies the same standards to research about virtual home visits as to research about in-person home visits. An evidence-based model may incorporate hybrid service delivery; doing so does not affect the model’s existing evidence rating. Previously reviewed research about evidence-based models is not re-reviewed to assess use of virtual service delivery.

Yes, any model that meets the definition of the early childhood home visiting model is included in the review, and this may include models that enroll people during pregnancy and aim to improve maternal health, infant health, and birth outcomes. For models with well-designed research that meets HomVEE’s published standards, detailed information about the theoretical approach, intended population, and targeted outcomes can be found via the implementation link on the Model Search Page on HomVEE’s website. That page also has a search function that allows the user to filter all models by population served. Detailed information about maternal and child health outcomes can be found in the “Effects shown in research” tab of each model effectiveness research report.

MIECHV’s authorizing statute (Social Security Act, Section 511(d)(3)(A)(i)(1) [42 U.S.C. 711(d)(3)(A)(i)(1)]) requires that models implemented through MIECHV be evaluated using well-designed and rigorous randomized controlled research designs or quasi-experimental designs (QEDs). Therefore, HomVEE only reviews studies using these types of designs. In addition to randomized controlled trials (RCTs), HomVEE reviews three types of QEDs: (1) single-case designs (SCDs), (2) regression discontinuity designs (RDDs), and (3) non-experimental comparison group designs (NEDs). These are the only study designs that are eligible for review by HomVEE.

Study designs vary in their relative risk of bias—that is, they vary in the extent to which researchers can be confident that impacts are due to home visiting rather than other factors. HomVEE accounts for risk of bias when assigning ratings to research. Generally, HomVEE assigns manuscripts about impact studies a rating of high, moderate, or low. Research with a higher risk of bias receives a lower rating. HomVEE routinely contacts authors if additional details are needed to assess the appropriate rating to assign to the manuscript. The fourth rating HomVEE can assign is “indeterminate.” An indeterminate rating means that HomVEE reviewers lacked sufficient information on one or more features of the study design to rate the manuscript as high or moderate. A rating of indeterminate is not a statement about the quality of the research or the research design. For more details, please see Chapter 3 of the Handbook of Procedures and Evidence Standards located on the Resources page.

HomVEE focuses its resources on reviewing manuscripts about impact studies that answer the review’s core question of whether an early childhood home visiting model is effective. Research that answers other questions is not eligible for review by HomVEE. For example, questions about for whom and under what circumstances a model is effective are valuable to the field but beyond the scope of the HomVEE review.

Research evaluating the impact of an isolated model feature or group of features is generally ineligible for HomVEE’s annual review, as are certain types of findings based on (1) covariate-unadjusted analyses, (2) item-level measures, and (3) binary variables. Additionally, analyses designed to answer questions other than whether a model is effective are generally ineligible for review. A longer discussion of contrasts that HomVEE reviews and ineligible and preferred analyses can be found in Chapter 3 of the Handbook of Procedures and Evidence Standards.

HomVEE’s Reporting Guide for Authors provides guidance about how to describe each eligible research design and how to report findings in a way that is clear, complete, and transparent. Reporting the information described in the Reporting Guide for Authors is considered a best practice in general, but it can also help HomVEE reviewers determine the appropriate rating to assign to the manuscript.