June 2025
HomVEE is pleased to publish its updated definitions for model adaptations and enhancements as well as other updates to our procedures and standards.
These are shared in two new products:
- A brief describing updates to how HomVEE defines and handles model adaptations and enhancements
- The HomVEE Handbook of Procedures and Evidence Standards (Version 2.3), featuring updates about:
- How HomVEE defines and handles model adaptations and enhancements
- The difference between unfavorable and ambiguous findings
- Differences in how HomVEE handles research on models that are already evidence based versus those that are not yet evidence based
- Changes to HomVEE’s reliability standard. These changes include the following:
- Updating HomVEE’s list of measures that are assumed to be reliable to include self-reported, single-item measures of counts or dichotomous events
- Clarifying that, for measures in the reductions in child maltreatment domain, substantiated reports from administrative records and data from medical records do not require reliability statistics (unsubstantiated reports remain ineligible for review)
- Raising the threshold for internal consistency reliability from 0.50 to 0.70 (for example, for Cronbach’s alpha, Pearson’s r, and Spearman’s rho)
- Replacing the current inter-rater reliability threshold of 0.50 with thresholds of 0.70 or higher for inter-rater percent agreement and 0.60 or higher for kappa
The updates about model adaptations and enhancements and the revised reliability standards were informed by consultation with experts in the field and feedback provided through listening sessions and in response to an invitation for public comments. The HomVEE team appreciates the thoughtful feedback that informed these changes.