Page 23

Demonstration Approval: November 1, 2023, through October 31, 2028 19

If qualitative analysis methods will be used, they must be described in detail. 2. Focus and Comparison Populations – Describe the characteristics of the focus and comparison populations, incorporating the inclusion and exclusion criteria. Include information about the level of analysis (beneficiary, provider, or program level), and if populations will be stratified into subgroups. Additionally, discuss the sampling methodology for the populations, as well as support that a statistically reliable sample size is available. 3. Evaluation Period – Describe the time periods for which data will be included. 4. Evaluation Measures – List all measures that will be calculated to evaluate the demonstration. The state also should include information about how it will define the numerators and denominators. Furthermore, the state should ensure the measures contain assessments of both process and outcomes to evaluate the effects of the demonstration during the period of approval. When selecting metrics, the state shall identify opportunities for improving quality of care and health outcomes, and controlling cost of care. The state also should incorporate benchmarking and comparisons to national and state standards, where appropriate. Include the measure stewards (i.e., the organization(s) responsible for the evaluation data elements/sets by “owning”, defining, validating, securing, and submitting for endorsement, etc.) Proposed health measures could include CMS’s Core Set of Health Care Quality Measures for Children in Medicaid and CHIP, Consumer Assessment of Health Care Providers and Systems (CAHPS), the Core Set of Health Care Quality Measures for Medicaid-Eligible Adults, metrics drawn from the Behavioral Risk Factor Surveillance System (BRFSS) survey, and/or measures endorsed by National Quality Forum. Proposed performance metrics can be selected from nationally recognized metrics, for example from sets developed by the Center for Medicare and Medicaid Innovation or for meaningful use under Health Information Technology. 5. Data Sources – Explain from where the data will be obtained, describe any efforts to validate and clean the data, and discuss the quality and limitations of the data sources. If the state plans to collect primary data (i.e., data collected specifically for the evaluation), include the methods by which the data will be collected, the source of the proposed questions and responses, and the frequency and timing of data collection. Additionally, copies of any proposed surveys must be provided to CMS for approval before implementation. 6. Analytic Methods – This section includes the details of the selected quantitative and/or qualitative analysis measures that will adequately assess the effectiveness of the demonstration. This section should: a. Identify the specific statistical testing which will be undertaken for each measure (e.g., t-tests, chi-square, odds ratio, ANOVA, regression). b. Explain how the state will isolate the effects of the demonstration from other initiatives occurring in the state at the same time (e.g., through the use of comparison groups). c. Include a discussion of how propensity score matching and difference-in- differences designs may be used to adjust for differences in comparison populations over time, if applicable.