Page 68

TEAMKY Demonstration

Approval Period: January 1, 2025 through December 31, 2029

Page 67 of 155 103. Draft Evaluation Design. The state must submit, for CMS comment and approval, a draft Evaluation Design, no later than one hundred eighty (180) calendar days after approval of the demonstration.

The draft Evaluation Design must be developed in accordance with the following CMS guidance (including but not limited to):

a. Attachment A (Developing the Evaluation Design) of these STCs, and

b. Any applicable CMS evaluation guidance and technical assistance specific to the demonstration’s policy components.

c. The draft Evaluation Design must also be developed in alignment with CMS guidance on applying robust evaluation approaches, such as quasi-experimental methods like difference-in-differences and interrupted time series, as well as establishing valid comparison groups and assuring causal inferences in demonstration evaluations. In addition to these requirements, if determined appropriate for the communities impacted by the demonstration, the state is encouraged to consider implementation approaches involving randomized control trials and staged rollout (for example, across geographic areas, by service setting, or by beneficiary characteristic), as these implementation strategies help create strong comparison groups and facilitate robust evaluation. The state is strongly encouraged to use the expertise of the independent party in the development of the draft Evaluation Design. The draft Evaluation Design also must include a timeline for key evaluation activities, including the deliverables outlined in STCs 107 and 108.

d. For any amendment to the demonstration, the state will be required to update the approved Evaluation Design to accommodate the amendment component. The amended Evaluation Design must be submitted to CMS for review no later than 180 calendar days after CMS’s approval of the demonstration amendment. Depending on the scope and timing of the amendment, in consultation with CMS, the state may provide the details on necessary modifications to the approved Evaluation Design via the monitoring reports. The amended Evaluation Design must also be reflected in the state’s Interim (as applicable) and Summative Evaluation Reports, described below.

104. Evaluation Design Approval and Updates. The state must submit to CMS a revised draft Evaluation Design within 60 calendar days after receipt of CMS’s comments, if any. Upon CMS approval of the draft Evaluation Design, the document will be included as an attachment to these STCs. Per 42 CFR 431.424(c), the state will publish the approved Evaluation Design to the state’s Medicaid website within 30 calendar days of CMS approval. The state must implement the Evaluation Design and submit a description of its evaluation progress in each of the Quarterly and Annual Monitoring Reports. Once CMS approves the Evaluation Design, if the state wishes to make changes, the state must submit a revised Evaluation Design to CMS for approval. if the changes are substantial in scope;