Page 17

13 Demonstration Approval: November 1, 2023, through October 31, 2028 these STCs. Per 42 CFR 431.424(c), the state will publish the approved Evaluation Design within 30 days of CMS approval. The state must implement the Evaluation Design and submit a description of its evaluation progress in each of the Annual Monitoring Reports. Once CMS approves the Evaluation Design, if the state wishes to make changes, the state must submit a revised Evaluation Design to CMS for approval if the changes are substantial in scope; otherwise, in consultation with CMS, the state may include updates to the Evaluation Design in Monitoring Reports. 30. Evaluation Questions and Hypotheses. Consistent with Attachments A and B (Developing the Evaluation Design and Preparing the Interim and Summative Evaluation Reports) of these STCs, the evaluation deliverables must include a discussion of the evaluation questions and hypotheses that the state intends to test. In alignment with applicable CMS evaluation guidance and technical assistance, the evaluation must outline and address well-crafted hypotheses and research questions for all key demonstration policy components that support understanding the demonstration’s impact and its effectiveness in achieving the goals. The hypothesis testing should include, where possible, assessment of both process and outcome measures. Proposed measures should be selected from nationally-recognized sources and national measures sets, where possible. Measures sets could include CMS’s Core Set of Health Care Quality Measures for Children in Medicaid and CHIP, Consumer Assessment of Health Care Providers and Systems (CAHPS), the Core Set of Health Care Quality Measures for Medicaid-Eligible Adults, the Behavioral Risk Factor Surveillance System (BRFSS) survey, and/or measures endorsed by National Quality Forum (NQF). 31. Evaluation Budget. A budget for the evaluation shall be provided with the draft Evaluation Design. It will include the total estimated cost, as well as a breakdown of estimated staff, administrative, and other costs for all aspects of the evaluation such as any survey and measurement development, quantitative and qualitative data collection and cleaning, analyses, and report generation. A justification of the costs may be required by CMS if the estimates provided do not appear to sufficiently cover the costs of the design or if CMS finds that the design is not sufficiently developed, or if the estimates appear to be excessive. 32. Interim Evaluation Report. If the state is seeking an extension of the demonstration, the state must submit an Interim Evaluation Report for the completed years of the demonstration, and for each subsequent extension of the demonstration, as outlined in 42 CFR 431.412(c)(2)(vi). When submitting an application for extension, the Interim Evaluation Report should be posted to the state's website with the application for public comment. a. The Interim Evaluation Report will discuss evaluation progress and present findings to date as per the approved Evaluation Design. b. For demonstration authority or any component within the demonstration that expires prior to the overall demonstration’s expiration date and depending on the timeline of the expiration/phase-out, the Interim Evaluation Report must include an evaluation of the authority, to be collaboratively determined by CMS and the state. c. The state must submit a revised Interim Evaluation Report within 60 calendar days after receiving CMS’s comments on the draft Interim Evaluation Report.