Page 45

Virginia FAMIS MOMS and FAMIS Select Section 1115 Demonstration Demonstration Period: October 25, 2019 through June 30, 2029; Amended November 18, 2021 Page 39 of 61

An Interim Evaluation Report should provide any available data to date, including both quantitative and qualitative assessments. The Evaluation Design should assure there is appropriate data development and collection in a timely manner to support developing an Interim Evaluation Report.

This section provides the evidence that the demonstration evaluation used the best available data and describes why potential alternative data sources were not used. The state also should report on, control for, and make appropriate adjustments for the limitations of the data and their effects on results, and discusses the generalizability of results. This section should provide enough transparency to explain what was measured and how, in sufficient detail so that another party could replicate the results. Specifically, this section establishes that the approved Evaluation Design was followed by describing:

1. Methodological Design – Whether the evaluation included an assessment of pre/post or post-only data, with or without comparison groups, etc. 2. Target and Comparison Populations – Describe the target and comparison populations, describing inclusion and exclusion criteria. 3. Evaluation Period – Describe the time periods for which data will be collected. 4. Evaluation Measures – List the measures used to evaluate the demonstration and their respective measure stewards. 5. Data Sources – Explain from where the data were obtained, and efforts to validate and clean the data. 6. Analytic Methods – Identify specific statistical testing which was undertaken for each measure (t-tests, chi-square, odds ratio, ANOVA, regression, etc.). 7. Other Additions – The state may provide any other information pertinent to the evaluation of the demonstration.

E. Methodological Limitations – This section provides sufficient information for discerning the strengths and weaknesses of the study design, data sources/collection, and analyses.

F. Results – In this section, the state presents and uses the quantitative and qualitative data to demonstrate whether and to what degree the evaluation questions and hypotheses of the demonstration were addressed. The findings should visually depict the demonstration results, using tables, charts, and graphs, where appropriate. This section should include findings from the statistical tests conducted.

G. Conclusions – In this section, the state will present the conclusions about the evaluation results. Based on the findings, discuss the outcomes and impacts of the demonstration and identify the opportunities for improvements. Specifically, the state should answer the following questions:

1. In general, did the results show that the demonstration was/was not effective in achieving the goals and objectives established at the beginning of the demonstration?