Frequently Asked Questions

For models that are not yet evidence based (Track 1), HomVEE will select models to review by calculating a prioritization score using a combination of model and manuscript characteristics. Prioritization scoring assigns points based on various factors, including (1) number and design of eligible impact studies, (2) sample sizes and sample characteristics of the impact studies, and (3) characteristics of the model. After a model is selected for review, HomVEE will apply its latest standards to review all research that is unreviewed or was reviewed under prior standards. See the Handbook of Procedures and Evidence Standards located on the Resources page of the website for the most up to date information on these processes.

Models that are already evidence based (Track 2) are updated based on a predetermined schedule instead of using a prioritization process. Previously reviewed research about these models is not re-reviewed for these updates. The purpose of the Track 2 review is to update existing Model Effectiveness Research Reports and Model Implementation Profiles to keep them current; HomVEE does not reassess a model’s evidence rating based on a Track 2 review.

HomVEE screens all research identified through its annual call for research and literature review to identify which manuscripts are eligible for review according to HomVEE’s published procedures and standards. Specific screening criteria can be found in Chapter 2 of the Handbook of Procedures and Evidence Standards located on the Resources page of the website. Once manuscripts are screened in, manuscripts about impact studies contribute to prioritization scores. Research on models that are not prioritized for review in a given year remains in the HomVEE database for consideration in future years.

Yes, HomVEE issues a call for research every year in August that is open through September. The call is sent to relevant electronic mailing lists and is also posted on the HomVEE website homepage with instructions on how to submit research. Research can be submitted at any time, but if it is submitted outside of the call window, it will be screened the following year.

HomVEE will review new grey literature only if it is publicly available and accessible on a website (this can include a requirement for purchase) or if it is an in-press journal article. Even if the content is publicly available, HomVEE will not review dissertations, theses, conference papers, and manuscripts labeled as working papers or under review. For additional details, please see the Handbook of Procedures and Evidence Standards on the Resources page.

HomVEE aims to treat all models consistently and fairly and to have a complete picture of all observed effects for a model. Therefore, HomVEE has a systematic process for identifying all relevant research and prioritizing models for review based on the available empirical evidence. Accepting new information, studies, or research during the course of the review would significantly delay HomVEE’s annual review process. For these reasons, HomVEE cannot review specific manuscripts on request. More details on this process are available in Chapter 2 of the Handbook of Procedures and Evidence Standards located on the Resources page.

Please sign up for the HomVEE mailing list to be notified of the call for research and other HomVEE-related news. To join the email list, find the "Stay in touch" box on the bottom of the Home page, enter your email address and click the Subscribe button.

Track 1 early childhood home visiting models are models that HomVEE has not yet found to be evidence-based. Track 2 models are models that HomVEE has already found to be evidence-based. 

HomVEE treats Track 1 and Track 2 models differently. 

HomVEE reviews Track 1 models to determine if they meet HHS criteria for evidence of effectiveness (see FAQ “How does HomVEE apply HHS criteria for evidence-based early childhood service delivery models?” ). During each review for a Track 1 model, HomVEE re-reviews all previously-reviewed research about that model using the latest HomVEE standards. This may result in changes to a manuscript’s rating or eligibility. If a study manuscript no longer meets standards, HomVEE may remove the findings from the website. Based on the most recent review results, HomVEE determines whether a Track 1 model meets the criteria to be evidence-based. 

HomVEE does not re-review Track 2 models but periodically updates their model reports to include the most recent research. Each update uses the current standards to review new research identified since the last update, but does not re-review research. That means that some research on the HomVEE website about Track 2 models might no longer be eligible for review under the latest procedures and standards. Importantly, HomVEE does not reassess Track 2 models against the HHS criteria when it updates their reports. That means Track 2 models retain their evidence-based status.

MIECHV’s authorizing statute (Social Security Act, Section 511(d)(3)(A)(i)(1) [42 U.S.C. 711(d)(3)(A)(i)(1)]) requires that models implemented through MIECHV be evaluated using well-designed and rigorous randomized controlled research designs or quasi-experimental designs (QEDs). Therefore, HomVEE only reviews studies using these types of designs. In addition to randomized controlled trials (RCTs), HomVEE reviews three types of QEDs: (1) single-case designs (SCDs), (2) regression discontinuity designs (RDDs), and (3) non-experimental comparison group designs (NEDs). These are the only study designs that are eligible for review by HomVEE.

Study designs vary in their relative risk of bias—that is, they vary in the extent to which researchers can be confident that impacts are due to home visiting rather than other factors. HomVEE accounts for risk of bias when assigning ratings to research. Generally, HomVEE assigns manuscripts about impact studies a rating of high, moderate, or low. Research with a higher risk of bias receives a lower rating. HomVEE routinely contacts authors if additional details are needed to assess the appropriate rating to assign to the manuscript. The fourth rating HomVEE can assign is “indeterminate.” An indeterminate rating means that HomVEE reviewers lacked sufficient information on one or more features of the study design to rate the manuscript as high or moderate. A rating of indeterminate is not a statement about the quality of the research or the research design. For more details, please see Chapter 3 of the Handbook of Procedures and Evidence Standards located on the Resources page.

HomVEE focuses its resources on reviewing manuscripts about impact studies that answer the review’s core question of whether an early childhood home visiting model is effective. Research that answers other questions is not eligible for review by HomVEE. For example, questions about for whom and under what circumstances a model is effective are valuable to the field but beyond the scope of the HomVEE review.

Research evaluating the impact of an isolated model feature or group of features is generally ineligible for HomVEE’s annual review, as are certain types of findings based on (1) covariate-unadjusted analyses, (2) item-level measures, and (3) binary variables. Additionally, analyses designed to answer questions other than whether a model is effective are generally ineligible for review. A longer discussion of contrasts that HomVEE reviews and ineligible and preferred analyses can be found in Chapter 3 of the Handbook of Procedures and Evidence Standards.

Yes. In addition to the main HomVEE review, HomVEE periodically updates a review of models that were implemented with Indigenous communities or included substantial proportions of Indigenous peoples (such as American Indian and Alaska Native families) in the study samples. The results of this review are presented in a report that can be accessed on the Home visiting resources for Indigenous peoples and communities page.

HomVEE lists the subgroups examined in each high- or moderate-rated manuscript reported on the HomVEE website. However, HomVEE only reports detailed subgroup findings when the subgroup is replicated, meaning that HomVEE has reviewed at least two well-designed studies that analyzed research about a sample with the subgroup characteristic. The Handbook of Procedures and Evidence Standards provides additional information about HomVEE procedures for subgroup research.

HomVEE’s website provides several resources for users that wish to know more about the characteristics of the research samples in a home visiting model’s evidence base. For more information, see FAQ “What information is available on the study samples in HomVEE's research database?”

HomVEE’s website provides several resources for users that wish to know more about the characteristics of the research samples in a home visiting model’s evidence base.

Information about individual study manuscripts: HomVEE records and displays information about study settings and participant characteristics for all manuscripts that receive a moderate or high rating. That information is available in the Manuscript Search page for individual manuscripts under the heading Study Participant Characteristics.

Information about a home visiting model: Users can find individual model pages by selecting Search for Models on the home page under the Models drop-down menu or by using the quick search under “Get Started” on the home page. Study settings and participant characteristics are available on a model’s home page under the heading Research Characteristics. These characteristics describe research participants across manuscripts that received a rating of moderate or high.

All research, including research that includes virtual service delivery, is subject to the same standards and procedures. HomVEE groups together all research on a model to apply the HHS criteria unless the model developer indicates that particular manuscripts are research on an adaptation of their model.

HomVEE assesses whether each model meets the HHS criteria for an “evidence-based early childhood service delivery model.” To operationalize the HHS criteria related to studies, and because study findings may be reported across several manuscripts, HomVEE rates manuscripts based on the highest-rated finding reported in that manuscript. Any high- or moderate-rated finding from a study about a model is considered as part of the evidence base for that model. Notably, for models with research solely from either randomized controlled trial (RCT) or single-case design (SCD) studies, additional criteria apply (see the HHS criteria). For example, the additional criteria for RCTs to be from peer-reviewed journal articles and to have sustained findings align with MIECHV Program statutory requirements. The HHS criteria for an evidence-based model have no additional requirements for regression discontinuity design (RDD) or non-experimental comparison group design (NED) studies.

A model may be evidence based on the strength of subgroup findings alone only if the research about it satisfies all of the subgroup criteria.

For details, please see the HHS criteria for evidence-based early childhood home visiting service delivery models.

Information on implementation of models with manuscripts about high- and moderate-quality impact studies is available in the implementation profiles. The implementation profiles give an overview of the model and information about developers’ input on the following: theoretical approach, implementation support availability, intended population, targeted outcomes, model services, requirements, and model contact information. These profiles can be accessed on the Model Search page. Model Search page.