Frequently Asked Questions
This page compiles responses to frequently asked questions. For more detailed information, please consult the HomVEE Handbook of Procedures and Evidence Standards. If you do not see the information you are looking for, please feel free to email the HomVEE team at: HomVEE@acf.hhs.gov
Search By
Methods and Standards
Which study designs are eligible for review?
MIECHV’s authorizing statute (Social Security Act, Section 511(d)(3)(A)(i)(1) [42 U.S.C. 711(d)(3)(A)(i)(1)]) requires that models implemented through MIECHV be evaluated using well-designed and rigorous randomized controlled research designs or quasi-experimental designs (QEDs). Therefore, HomVEE only reviews studies using these types of designs. In addition to randomized controlled trials (RCTs), HomVEE reviews three types of QEDs: (1) single-case designs (SCDs), (2) regression discontinuity designs (RDDs), and (3) non-experimental comparison group designs (NEDs). These are the only study designs that are eligible for review by HomVEE.
Why can research with some designs rate higher than research with other designs?
Study designs vary in their relative risk of bias—that is, they vary in the extent to which researchers can be confident that impacts are due to home visiting rather than other factors. HomVEE accounts for risk of bias when assigning ratings to research. Generally, HomVEE assigns manuscripts about impact studies a rating of high, moderate, or low. Research with a higher risk of bias receives a lower rating. HomVEE routinely contacts authors if additional details are needed to assess the appropriate rating to assign to the manuscript. The fourth rating HomVEE can assign is “indeterminate.” An indeterminate rating means that HomVEE reviewers lacked sufficient information on one or more features of the study design to rate the manuscript as high or moderate. A rating of indeterminate is not a statement about the quality of the research or the research design. For more details, please see Chapter 3 of the Handbook of Procedures and Evidence Standards located on the Resources page.
What types of analyses or contrasts are not eligible for review?
HomVEE focuses its resources on reviewing manuscripts about impact studies that answer the review’s core question of whether an early childhood home visiting model is effective. Research that answers other questions is not eligible for review by HomVEE. For example, questions about for whom and under what circumstances a model is effective are valuable to the field but beyond the scope of the HomVEE review.
Research evaluating the impact of an isolated model feature or group of features is generally ineligible for HomVEE’s annual review, as are certain types of findings based on (1) covariate-unadjusted analyses, (2) item-level measures, and (3) binary variables. Additionally, analyses designed to answer questions other than whether a model is effective are generally ineligible for review. A longer discussion of contrasts that HomVEE reviews and ineligible and preferred analyses can be found in Chapter 3 of the Handbook of Procedures and Evidence Standards.
Does HomVEE provide guidelines authors can refer to when writing up their research findings?
HomVEE’s Reporting Guide for Authors provides guidance about how to describe each eligible research design and how to report findings in a way that is clear, complete, and transparent. Reporting the information described in the Reporting Guide for Authors is considered a best practice in general, but it can also help HomVEE reviewers determine the appropriate rating to assign to the manuscript.
Information Available on the Website
Is there a list of models reviewed but that did not meet the requirements?
A list of models reviewed by HomVEE is available on the Model Search page. Users can find a list of models that includes those that did not meet the HHS criteria by selecting "clear all". This removes the filters and displays a complete list of all models HomVEE has reviewed. The information is also available in the summary brief, available on the HomVEE Summary page.
Is information on implementation of models available?
Information on implementation of models with manuscripts about high- and moderate-quality impact studies is available in the implementation profiles. The implementation profiles give an overview of the model and information about developers’ input on the following: theoretical approach, implementation support availability, intended population, targeted outcomes, model services, requirements, and model contact information. These profiles can be accessed on the Model Search page. Model Search page.
How can a model developer request that HomVEE update its contact information?
Model developers may contact HomVEE at any time to update contact information on the website. Please see our Contact Us page to provide updated contact details. HomVEE will publish these updates within a reasonably short timeframe, rather than waiting for the next full HomVEE review of the model.
Does HomVEE categorize research that is in progress on these models?
No. HomVEE does not have consistent information about research underway on home visiting models. HomVEE users who are seeking information about research in progress on specific models should contact the model developer directly.