Evaluation
Evaluation provides the evidence HHS needs to understand how its programs work, for whom, and under what circumstances. HHS builds evidence through a wide range of evidence building activities, including evaluation, to inform budget, legislative, regulatory, strategic planning, program operation, and policy decisions. Given the breadth of work supported by HHS, many evaluations and analyses are conducted each year. These efforts range in scope, scale, design, and methodology, but all aim to understand how the effect of programs and policies and how they can be improved.
The Evidence Act
The Foundations for Evidence-based Policymaking Act of 2018 (also referred to as the Evidence Act) was enacted to advance evidence-building in the federal government by improving access to data and expanding evaluation capacity. Title I of the Evidence Act requires federal agencies to designate an Evaluation Officer; adopt an agency-wide evaluation policy; develop a plan that identifies priority questions and the evaluations and other evidence-building activities that will answer them; and periodically assess the agency's capacity to build and use evidence. Agencies carry out these requirements following the statute and guidance from the Office of Management and Budget (OMB), including M-19-23 and OMB Circular A-11, Section 290.
ASPE's Role
Through the HHS Evaluation Officer, ASPE leads coordination of the evaluation and evidence-building activities required under Title I, working across the Department to develop the annual HHS Evidence Plan and ensure that HHS evaluations meet the standards set in the HHS Evaluation Policy.
The HHS Evaluation Officer, within ASPE's Office of Human Services Policy, convenes the HHS Evidence and Evaluation Council to develop and coordinate a community that can advise and consult with their agencies on evaluation and evidence activities. The Council aims to promote the effective use of evaluation across the Department to inform decision-making while ensuring the integrity, rigor, and relevance of the information collected, analyzed, and used as evidence. The Council fosters cross-agency collaboration to improve efficiency and effectiveness in planning and conducting evaluations and disseminating their findings throughout HHS and to the public. Questions about HHS Evidence Act implementation and related reports may be sent to evaluation@hhs.gov.
Title I Activities at HHS
HHS Evaluation Policy
The Evidence Act requires each agency to develop an agency-wide evaluation policy to guide its evaluation activities. Specifically, the policy should “affirm the agency’s commitment to conducting rigorous, relevant, evaluations and to using evidence from evaluations to inform policy and practice. The policy will provide the agency's stakeholders with a clear understanding of the expectations related to key principles, such as evaluation rigor, relevance, transparency, independence, and ethics” (M-19-23).
ASPE convened agency representatives from across HHS operating and staff divisions to develop the Department of Health and Human Services Evaluation Policy (2021). The policy is designed to allow appropriate flexibility for each HHS Operating and Staff Division to determine specific practices suited for their context and activity. The standards provide guidance on (1) rigor, (2) relevance and utility, (3) independence and objectivity, (4) transparency, and (5) ethics. All HHS evaluations, including those in the annual Evidence Plan, are expected to adhere to these principles.
HHS Evidence Plan
Beginning with the FY 2027 planning cycle, OMB Circular A-11, Section 290 directs agencies to incorporate the required elements of the learning agenda (evidence-building plan) and the annual evaluation plan into a single Evidence Plan, updated annually rather than on the four-year strategic planning cycle. The Evidence Plan identifies the agency's priority questions, as well as the methods and data required to answer them, and the evaluations and other evidence-building activities the agency will undertake in the coming fiscal year to answer those questions. For each priority question, the plan describes the data the agency will collect, use, or acquire; the methods and analytical approaches it will apply; the steps it will take; how it will use the resulting evidence in decisions; anticipated challenges; and the estimated timing for completing the planned activities.
- FY 2027 HHS Evidence Plan (in development)
Annual Evaluation Plans (FY 2022–2026)
From FY 2022 through FY 2026, HHS published annual Evaluation Plans that outlined the evaluations and analyses the Department would aim to undertake to answer the questions outlined in the HHS Evidence-Building Plan, including priority questions, data needs, methods, anticipated challenges, and plans for dissemination and use of results. Beginning with the FY 2027 planning cycle, these elements are incorporated into the annual HHS Evidence Plan, and HHS no longer produces a separate Annual Evaluation Plan. Prior plans remain available here.
HHS Capacity Assessment
The Evidence Act requires each agency to submit, as part of its Strategic Plan, an assessment of the agency's evaluation and evidence-building capacity and functions. Specifically, this should be "an assessment of the coverage, quality, methods, effectiveness, objectivity, scientific integrity, and balance of the portfolio of evaluations, policy research, and ongoing evaluation activities of the agency, in consultation with other methodologists, such as the Statistical Official, when appropriate" (M-19-23).
- FY 2027-2030 HHS Capacity Assessment (in development)
- FY 2023-2026 HHS Capacity Assessment
HHS Evidence-Building Plan (Learning Agenda)
HHS previously published the FY 2023-2026 Evidence-Building Plan, a four-year plan to outline evidence-building priorities, including priority questions as well as the methods and data required to answer them. As of FY 2027, OMB guidance requires agencies to develop an Annual Evidence Plan that combines elements of the Evidence-Building Plan (or Learning Agenda) with the requirements for the Annual Evaluation Plans rather than producing a four-year Evidence Building plan.
Evidence Act Resources
- M-19-23 Phase 1 Implementation of the Foundations for Evidence-Based Policymaking Act of 2018: Learning Agendas, Personnel, and Planning Guidance
- M-20-12 Phase 4 Implementation of the Foundations for Evidence-Based Policymaking Act of 2018: Program Evaluation Standards and Practices (March 2020)
- Foundations for Evidence-Based Policymaking Act of 2018