Sponsoring Agency: U.S. Department of Health and Human Services Administration for Children and Families
Project Officer: Molly Irwin
Performance Period: April 2011 – December 2011
Project Summary:
The Administration for Children and Families (ACF) of the U.S. Department of Health and Human Services (HHS) has contracted with Abt Associates Inc. and The Urban Institute to conduct an impact evaluation of the Health Profession Opportunity Grants (HPOG). The HPOG grants fund programs that provide Temporary Assistance for Needy Families (TANF) recipients, other low-income individuals, and members of Native American tribes with training and support needed to find and keep employment in healthcare occupations and fill the growing demand for skilled healthcare workers. Thirty-two grants were awarded in September 2010 to government agencies, community-based organizations, post-secondary educational institutions, and tribal-affiliated organizations to conduct these activities. The purpose of the study is to conduct the most rigorous possible evaluation to measure the relationship between the HPOG program design and implementation and participant outcomes. The overall evaluation focuses on estimating the impacts of varied HPOG program components to inform future program design and improvement. Key participant outcomes to be measured and analyzed include completion of education and training, receipt of certificates and/or degrees, and post-program employment and earnings in a healthcare career. The sample includes 20 HPOG grantees serving TANF recipients and other low-income individuals. Among those HPOG grantees not already engaged in HHS-supported evaluation (e.g., University Partnership Research Grants; Innovative Strategies for Increasing Self-Sufficiency (ISIS), all grantee program locations randomly assign eligible applicants to be part of the HPOG program or to receive “services as usual,” which means they may participate in and receive any other services in the community for which they are eligible. Some HPOG programs also have an opportunity to receive additional funds to test “program enhancements” (e.g., peer support, emergency cash assistance).
The Health Profession Opportunity Grant (HPOG) Program Performance Reporting System (PRS), an automated participant information system, was developed to support the evaluation of HPOG, including enabling sites to randomly assign participants to treatment and control groups, collecting participant demographic, service, and outcome data; and support ongoing program monitoring and reporting. Capital Research Corporation, Inc. assisted with design, testing and implementation of this automated data system. This system is used for program performance management and evaluation purposes, and can be used for case management purposes:
- Program Performance Management. The system includes all data needed to track and manage grantee performance. The quantitative sections of grantees’ required semi-annual Performance Progress Reports (PPR) to ACF are produced from the information in the HPOG data system. Grantees are also able to insert the narrative portions of the semi-annual PPR and thus submit the entire report directly from the data system.
- Program Evaluation. The system includes data necessary for to support analyses and evaluations of HPOG. Data items support a range of analyses at the participant, program, and grantee levels.
- Case Management. The HPOG PRS can be used for case management at the program level. Data on individual participants can be entered into the PRS at enrollment as part of the initial interaction between the participant and program staff. Subsequently, information on activities and services can be entered and added to the participant record. Narrative case notes can also be added as text in every module of the PRS.
The HPOG PRS resides on a secure website maintained by the Urban Institute.