Page 87

Pennsylvania Keystones of Health Section 1115 Demonstration Approval Period: December 26, 2024 through December 31, 2029 Page 74 of 90 appropriate data development and collection in a timely manner to support developing an Interim Evaluation Report.

This section provides the evidence that the demonstration evaluation used the best available data and describes why potential alternative data sources were not used. The state also should report on, control for, and make appropriate adjustments for the limitations of the data and their effects on results, and discusses the generalizability of results. This section should provide enough transparency to explain what was measured and how, in sufficient detail so that another party could replicate the results. Specifically, this section establishes that the approved Evaluation Design was followed by describing:

1. Methodological Design – Whether the evaluation included an assessment of pre/post or post–only data, with or without comparison groups, etc.

2. Focus and Comparison Populations – Describe the focus and comparison populations, describing inclusion and exclusion criteria.

3. Evaluation Period – Describe the time periods for which data will be collected.

4. Evaluation Measures – List the measures used to evaluate the demonstration and their respective measure stewards.

5. Data Sources – Explain from where the data were obtained, and efforts to validate and clean the data.

6. Analytic Methods – Identify specific statistical testing which was undertaken for each measure (t–tests, chi–square, odds ratio, ANOVA, regression, etc.).

7. Other Additions – The state may provide any other information pertinent to the evaluation of the demonstration.

E. Methodological Limitations – This section provides sufficient information for discerning the strengths and weaknesses of the study design, data sources/collection, and analyses.

F. Results – In this section, the state presents and uses the quantitative and qualitative data to demonstrate whether and to what degree the evaluation questions and hypotheses of the demonstration were addressed. The findings should visually depict the demonstration results, using tables, charts, and graphs, where appropriate. This section should include findings from the statistical tests conducted.

G. Conclusions – In this section, the state will present the conclusions about the evaluation results. Based on the findings, discuss the outcomes and impacts of the demonstration and identify the opportunities for improvements. Specifically, the state should answer the following questions: