Frequently Asked Questions

HomVEE lists the subgroups examined in each high- or moderate-rated manuscript reported on the HomVEE website. However, HomVEE only reports detailed subgroup findings when the subgroup is replicated, meaning that HomVEE has reviewed at least two well-designed studies that analyzed research about a sample with the subgroup characteristic. The Handbook of Procedures and Evidence Standards provides additional information about HomVEE procedures for subgroup research.

HomVEE’s website provides several resources for users that wish to know more about the characteristics of the research samples in a home visiting model’s evidence base. For more information, see FAQ “What information is available on the study samples in HomVEE's research database?”

HomVEE’s website provides several resources for users that wish to know more about the characteristics of the research samples in a home visiting model’s evidence base.

Information about individual study manuscripts: HomVEE records and displays information about study settings and participant characteristics for all manuscripts that receive a moderate or high rating. That information is available in the Manuscript Search page for individual manuscripts under the heading Study Participant Characteristics.

Information about a home visiting model: Users can find individual model pages by selecting Search for Models on the home page under the Models drop-down menu or by using the quick search under “Get Started” on the home page. Study settings and participant characteristics are available on a model’s home page under the heading Research Characteristics. These characteristics describe research participants across manuscripts that received a rating of moderate or high.

HomVEE reports data describing the race and ethnicity of participants in home visiting research in accordance with federal standards. The standards allow for participants in research to select multiple race and ethnicity categories (for example, selecting both White and Hispanic) and for manuscript authors to report that information in a way that may sum to greater than 100 percent.

HomVEE uses the term “evidence-based model” to refer specifically to a model that meets HHS criteria developed based on statutory requirements in the authorizing legislation for the MIECHV Program. HomVEE recognizes that other systematic reviews may use different criteria to evaluate evidence of effectiveness. Thus, an evidence-based model in the context of HomVEE might or might not meet requirements for evidence of effectiveness according to other systematic reviews. The HHS criteria for an evidence-based early childhood home visiting service delivery model are designed to ensure confidence in model impacts through replicated findings from well-designed research.

All research, including research that includes virtual service delivery, is subject to the same standards and procedures. HomVEE groups together all research on a model to apply the HHS criteria unless the model developer indicates that particular manuscripts are research on an adaptation of their model.

HomVEE assesses whether each model meets the HHS criteria for an “evidence-based early childhood service delivery model.” To operationalize the HHS criteria related to studies, and because study findings may be reported across several manuscripts, HomVEE rates manuscripts based on the highest-rated finding reported in that manuscript. Any high- or moderate-rated finding from a study about a model is considered as part of the evidence base for that model. Notably, for models with research solely from either randomized controlled trial (RCT) or single-case design (SCD) studies, additional criteria apply (see the HHS criteria). For example, the additional criteria for RCTs to be from peer-reviewed journal articles and to have sustained findings align with MIECHV Program statutory requirements. The HHS criteria for an evidence-based model have no additional requirements for regression discontinuity design (RDD) or non-experimental comparison group design (NED) studies.

A model may be evidence based on the strength of subgroup findings alone only if the research about it satisfies all of the subgroup criteria.

For details, please see the HHS criteria for evidence-based early childhood home visiting service delivery models.

No. A model may be evidence-based, according to HHS criteria, on the strength of either RCT research or quasi-experimental design (QED) research (including non-experimental comparison group, single-case, and regression discontinuity designs). The research must be of high or moderate quality based on HomVEE’s published standards. Additional HHS criteria apply when the research uses an RCT design. For details, please see the HHS criteria for evidence-based early childhood home visiting service delivery models.

Users can find a filtered list of models that meet the HHS criteria on the Model Search page by clearing the "MIECHV Eligible" filter. The information is also available in the summary brief, available on the HomVEE Summary page. Notably, a HomVEE designation as an evidence-based model does not guarantee that a model is eligible to be implemented with MIECHV funding.

The HHS criteria do not consider the magnitude of impacts in determining whether a model has evidence of effectiveness.

Even though magnitude is not considered in the HHS criteria, HomVEE reports standardized effects (or, effect sizes) for findings rated high and moderate when they are available in the manuscripts or the HomVEE team had enough information to calculate them. Effect sizes can be found in the "Effects shown in research" section of each model effectiveness research report. The reports can be accessed through the Model Search Page.