Treatment Episode Outcomes System: 2010 and Beyond

Staff from the ODMH Office of Research and Evaluation (ORE) are managing the development and implementation of a treatment episode outcomes system that collects four client-level National Outcome Measures (NOMs) and randomly surveys consumers on perception of care, social functioning, and social connectedness with the Mental Health Statistics Improvement Program (MHSIP) and the Youth Services Survey for Families (YSS-F) instruments. The new system of outcomes data collection and reporting is guided by two principles developed by the Measuring Outcomes Efficiently Workgroup in the spring of 2009:

Featured News

New Timeline for Client-level Data Reporting
On April 5, 2012, ODMH Director Tracy Plouck and ODADAS Director Orman Hall announced that submission of records for mental health consumers with SMD and SED to the OH BH would be voluntary until July 1, 2013. More information about the decision to move the initiation of statewide data submission to FY 2014 can be found in the Correspondence section of this page under Update on Development of a More Efficient Outcomes Measurement System.

Results of OH BH Web Based Facility Pilot Test
In late March 2012, the Department concluded testing the admission record template for consumers with SMD or SED in the OH BH web-based facility. Three providers participated in the web-based records test, which began in early December 2011. Records were evaluated for frequency of missing or implausible values or "unknown" or "don't know" responses. Results of the data analysis can be reviewed in Statistics for OH BH/TEO Pilot Data.

After reviewing results of the pilot and statewide policy and program requirements, an internal ODMH workgroup provided recommendations concerning the data elements in the SMD/SED record to be tested in the batch upload phase of development. Those data elements, with update requirements, can be found in TEO Measures.

The OH BH/TEO web-based pilot also included qualitative evaluation of operational barriers and supports. Two providers that expressed interest in pilot participation dropped out of the pilot due to problems with technical support. At the time of the pilot, the ODADAS Help Desk could be accessed only via email. As a consequence of the pilot, ODMH and ODADAS are developing a virtual Help Desk with a central phone line and staff from both departments. Pilot provider questions concerning the MH setup in the OH BH are answered under Correspondence.

Data Collection

To support Ohio's Block Grant reporting of the National Outcome Measures (NOMs), the Department is pursuing two major approaches to data collection:

  • Collection of client-level NOMs for employment status/school suspensions, living situation, and criminal justice involvement through an expanded mental health option in the existing electronic Ohio Behavioral Health System (OH-BH) administered by ODADAS
  • Collection of NOMs for social functioning, social connectedness, and consumer perception of care through randomized sampling of consumers with the MHSIP and YSS-F survey instruments.

MHSIP/YSS-F Surveys

Current Year (SFY 2012)
In February 2012, the Office of Research & Evaluation initiated its annual randomized MHSIP and YSS-F mail surveys of adult consumers and parent/guardians of child and adolescent consumers. Sampling of some 4,700 adults and 6,400 parent/guardians concluded on April 6, 2012. A subsample of 1,750 adults who received the MHSIP also was surveyed on perceptions of culturally competent service delivery using the Consumer-Based Cultural Competence Survey. Consumers receiving mail notices were given the option of responding to the MHSIP, YSS-F and CBCC surveys using paper forms and pre-paid business envelopes, over the toll free bridge line, or through web-based forms on Survey Monkey. Results of the MHSIP/YSS-F surveys will be available at this website in July 2012; results of the CBCC survey will be posted in September 2012.

Prior Years (SFY 2010-11)
From January through June 2011, the Office of Research and Evaluation conducted a random mail survey of 16,000 adult consumers and parents of child and adolescent consumers. Data from the surveys are used for Block Grant reporting requirements, to inform quality improvement initiatives, and to give stakeholders an indication of how consumers perceive their experience of the community mental health system. Responses from the 2011 random mail survey were analyzed and compiled into a public report of findings. Results of the 2011 survey were reported to SAMHSA in November 2011.

OH BH/TEO Client-level Data

Forms
Newly revised versions of the Admission, Update, Discharge, Transfer and Setup forms for the new mental health record (TEO) are available. These forms are under a continuing quality improvement approach that requires user feedback. Contact ORE-ODMH@mh.ohio.gov with your comments and suggestions.

Guidelines and Definitions
The OH BH web-based facility manual has been corrected and revised to reflect removal of two data entry fields from the admission, update and discharge records as a result of the pilot. Definitions for the new mental health records in the OH BH / TEO reporting system are also available.

Reports

OH BH Report on Mental Health Consumers with Military Service
Approximately 30% of adults (N = 71,980/240,871) treated for mental illness in SFY 2011 had an admission record in the Ohio Behavioral Health Module or OH BH. ODMH analysts examined admission and discharge records of adult consumers with a history of military service to produce the Special Population Report: Mental Health Consumers with Military Service. The Vets Report presents information on the 2% of adult consumers identified as having military service histories. The vast majority of veterans identified in the analysis--98.6%--were from service eras other than Iraqi Freedom or Afghani Enduring Freedom.

Correspondence

Data Infrastructure Grant (DIG)

In April 2010, the Department applied for a SAMHSA-funded Data Infrastructure Grant (DIG) to support collection and reporting of the NOMs through the Treatment Episode Outcomes module of the OH-BH and randomized sampling of consumers. Ohio’s DIG proposal was written by staff in the Department’s Office of Research and Evaluation (ORE). SAMHSA funded the proposal through a letter of award on September 17, 2010.

DIG project staff at ODMH submit an annual report to SAMSHA regarding progress of the project's implementation. Stakeholders are welcome to review this project accountability information:

Back to top