Patient-Reported Experience Measures for In- and Outpatients in Mental Health and Substance Use Services: Psychometric Properties and Results From a Nationwide Survey in Finland.

  • Abstract
  • Literature Map
  • Similar Papers
Abstract
Translate article icon Translate Article Star icon

We implemented the first national patient experience survey, with novel patient-reported experience measures (PREMs), in out- and inpatient mental health and substance use services in Finland. The Outpatient Experience Scale (OPES) and the Inpatient Experience Scale (IPES) were co-designed with experts by experience and professionals. The survey was carried out in 2021 in 435 treatment facilities. We applied bi-factor analysis of ordinal indicators to prespecified and exploratory models. We received 8794 outpatient and 1112 inpatient responses. Both the OPES and the IPES were essentially unidimensional, with high internal consistency (omega 0.98 in both) and strong factor loadings. The Net Promoter Score item was a fairly poor indicator of overall satisfaction. The most positive experiences were related to respect and acceptance, while statements related to receiving information and inclusion of significant others in the treatment process received more critical feedback. The best experience was in integrated mental health and substance use services. Involuntarily admitted patients had the most negative patient experiences. The new PREMs proved to work well in measuring patient experience. Service users generally reported positive experiences. The primary service development need is sharing information with patients.

Similar Papers
  • Research Article
  • Cite Count Icon 90
  • 10.1176/ajp.156.8.1250
Shifting to outpatient care? Mental health care use and cost under private insurance.
  • Aug 1, 1999
  • American Journal of Psychiatry
  • Douglas L Leslie + 1 more

Concern over rising health care costs has put pressure on providers to reduce costs, purportedly by reducing inpatient care and increasing outpatient care. Inpatient and outpatient claims were analyzed for adult users of mental health services (180,000/year on average) from a national study group of 3.9 million privately insured individuals per year from 1993 to 1995. Costs and treatment days per patient were compared across diagnostic groups and stratified by whether patients were hospitalized. Inpatient mental health costs fell $2,507 (30.4%) over the period, driven primarily by decreases in hospital days per patient per year (19.9%), with smaller changes in the proportion of enrollees who received inpatient care (increase of 0.8%) and a decrease in per diem costs (9.1%). Outpatient mental health costs also declined over the period, falling 13.6% for patients also using inpatient services and 14.6% for patients receiving only outpatient care. Patients whose primary diagnosis was mild to moderate depression saw the largest decreases in inpatient cost per patient (42.8%); those diagnosed with schizophrenia experienced the smallest decrease (23.5%). For patients using outpatient services only, those diagnosed with substance abuse experienced the largest decrease in costs (23.5%); those diagnosed with schizophrenia experienced the smallest decrease (8.6%). Substantial cost reductions for mental health services are primarily a result of reductions in inpatient and outpatient treatment days. Declines in inpatient service use were not accompanied by increases in outpatient service use, even for severely ill patients requiring hospitalization. Managed care has not caused a shift in the pattern of care but an overall reduction of care.

  • Research Article
  • Cite Count Icon 132
  • 10.1176/ps.48.12.1553
Influence of patient and hospital factors on consumer satisfaction with inpatient mental health treatment.
  • Dec 1, 1997
  • Psychiatric Services
  • Robert A Rosenheck + 2 more

This study examines patient- and facility-related determinants of satisfaction with inpatient mental health services. A random sample of veterans discharged from Department of Veterans Affairs inpatient units with primary diagnoses of a psychiatric or substance use disorder (N = 13,574) were mailed a 73-item questionnaire that addressed aspects of their recent hospital experience. Multiple regression analysis was used to evaluate the relationship between patient and hospital characteristics and both the likelihood of responding to the survey and aspects of satisfaction measured by 14 subscales. A total of 4,968 veterans, or 37 percent, mailed back responses to the questionnaire. Respondents were older than nonrespondents and were more likely to be white and married and to have nonpsychotic disorders other than substance use disorders. The strongest and most consistent predictors of satisfaction were older age and better self-reported health. Longer length of stay was also associated with greater satisfaction on a majority of subscales. Findings among female and minority veterans were mixed across measures. Large facilities and facilities that specialize in mental health treatment had lower levels of satisfaction than others. Patient characteristics accounted for more of the variance in satisfaction than did facility characteristics. Older and healthier patients reported greater satisfaction with mental health care services. Accurate comparison of patient satisfaction between facilities requires that adjustments be made for differences in patient characteristics. Large facilities may need to make special efforts to personalize their services.

  • Research Article
  • Cite Count Icon 14
  • 10.1176/ps.2008.59.3.304
The Long Road Home: Rebuilding Public Inpatient Psychiatric Services in Post-Katrina New Orleans
  • Mar 1, 2008
  • Psychiatric Services
  • Jose Calderon-Abbo

In August 2006, a year after Hurricane Katrina, the first acute inpatient public psychiatric unit for adults was opened in New Orleans to serve patients referred from local emergency departments. This article describes the clinical and administrative experiences of providing inpatient care in post-Katrina New Orleans, including the increased demand for programs to treat patients with co-occurring disorders, the expanded scope of practice for psychiatrists to include primary care, and ongoing staff shortages in a traumatized and displaced workforce. Lessons learned in regard to disaster planning and recovery are also discussed.

  • Research Article
  • Cite Count Icon 72
  • 10.1176/ps.2010.61.1.17
Mental Health Service Use Among Suicidal Adolescents: Findings From a U.S. National Community Survey
  • Jan 1, 2010
  • Psychiatric Services
  • Ping Wu + 4 more

This study assessed patterns of mental health service use among adolescents who had attempted suicide and examined factors associated with their service use at individual, family, and community levels. Bivariate and multiple logistic regression analyses were conducted with data from 877 adolescents aged 12-17 who had attempted suicide in the past 12 months and who participated in the 2000 National Household Survey on Drug Abuse. Of the 877 adolescents, less than half (45%) reported that they had used mental health services in the past 12 months. Adolescents from racial-ethnic minority groups were less likely than whites to receive inpatient or outpatient mental health treatment, even when the analyses controlled for other demographic, individual, and family and community characteristics. Poor self-perceived health and living in a single-parent family were associated with use of inpatient services. Female gender, higher family income, participation in extracurricular activities, and the presence of symptoms of anxiety or disruptive disorders were associated with use of outpatient services. Use of school-based mental health services was associated only with participation in extracurricular activities. The mental health service needs of suicidal adolescents, especially those from ethnic minority groups and lower-income families, too frequently remain unmet. Larger racial-ethnic disparities were found in use of inpatient and outpatient mental health services than in use of school-based services. Mental health services offered within school settings can reach suicidal adolescents who need services but may experience barriers to standard types of care.

  • Research Article
  • Cite Count Icon 3
  • 10.1176/ps.2008.59.8.860
The Impact of Integrating Mental and General Health Services on Mental Health's Share of Total Health Care Spending in Alberta
  • Aug 1, 2008
  • Psychiatric Services
  • Ray Block + 6 more

In April 2003 the Alberta government integrated specialized mental health services, formerly organized independently, with the health regions, which are responsible for general health services. The objective of this article is to determine whether the transfer was associated with an increase or decrease in the share of resources in the region allocated to mental health care relative to total spending for health care. The measure of the share for mental health care is the total costs for mental health care resources as a percentage of total health care spending. Resources and spending examined were those that were actually or potentially under the regions' control. Annual costs for mental health services in the province were obtained for a seven-year period (fiscal year [FY] 2000 through FY 2006) from provincial utilization records for all residents in the province. Unit costs were assigned to each visit. The trend in the share measure was plotted for each year. The share for mental health care increased overall from FY 2000 (7.6%) to FY 2003 (8.2%), but returned to pre-FY 2003 levels in the three years after the transfer (7.6%). Despite concerns expressed before the transfer by federal and provincial reports over the level of expenditures devoted to mental health care, the integration of mental health services with other health services did not result in an increase of the share for mental health care.

  • Research Article
  • 10.1080/09638237.2026.2622083
Measuring older people’s experience of mental health care: a systematic and critical review of patient and carer-reported experience measures
  • Feb 25, 2026
  • Journal of Mental Health
  • Georgia Smith + 2 more

Background There is growing interest in measuring patient experience within mental health care and central to doing so is the development of appropriate measurement methods. Whilst numerous patient-reported experience measures (PREMs) are available, systematic reviews examining their psychometric properties have excluded measures designed specifically for older people. Aims This review aimed to identify and critically analyse all available patient and carer-reported patient experience measures designed to, or applicable in, measuring the mental health care experience of older people. Methods Four databases were systematically searched and identified 21 reports dealing with the process of development and/or validation of relevant instruments. Results The methodological quality and psychometric properties of the instruments were assessed according to Pesudovs et al. (2007) quality criteria, and results were heterogeneous. An inductive qualitative analysis of instrument content identified 10 key domains of patient experience applicable to OPMH: interpersonal/relational aspects, information, patient involvement, service aspects, discharge, goal setting, safety, social support, access and medication. Conclusions The heterogeneity of study designs highlights the need for greater standardization and rigour of methodological processes for the development and validation of PREMs. Further well-designed studies to appropriately validate existing and new PREMs applicable for use within older people’s mental health services are required.

  • Research Article
  • Cite Count Icon 1
  • 10.1176/appi.ps.57.5.692
Perceived Effectiveness of Medications Among Mental Health Service Users With and Without Alcohol Dependence
  • May 1, 2006
  • Psychiatric Services
  • M J Edlund + 1 more

Perceived Effectiveness of Medications Among Mental Health Service Users With and Without Alcohol Dependence

  • Research Article
  • Cite Count Icon 61
  • 10.1176/ps.2010.61.5.451
Characteristics and Experiences of Adults With a Serious Mental Illness Who Were Involved in the Criminal Justice System
  • May 1, 2010
  • Psychiatric Services
  • Robert Constantine + 7 more

This study identified characteristics and experiences of arrestees and jail inmates with a serious mental illness that were associated with misdemeanor and felony arrests and additional days in jail. County and statewide criminal justice records and health and social service archival data sets were used to identify inmates with serious mental illness who were in the Pinellas County, Florida, jail between July 1, 2003, and June 30, 2004, and their health and social service contacts from July 1, 2002, to June 10, 2006. Criminal justice and mental health services were recorded longitudinally across 16 quarters, or 90-day periods. Generalized estimating equations for count data were used to describe the associations between individual characteristics and experiences and the risks of misdemeanor and felony arrests and additional days in jail. A total of 3,769 jail inmates (10.1% of all jail inmates) were diagnosed as having a serious mental illness. Participants experienced a mean+/-SD of .90+/-.60 arrest for every three quarters and 10.9+/-23.6 days in jail per quarter that they resided in the county. Being male, being homeless, not having outpatient mental health treatment, and having an involuntary psychiatric evaluation in the previous quarter were independently associated with significantly increased odds of misdemeanor arrests and additional days in jail. On the other hand, being black, being younger than 21 years, having a nonpsychotic diagnosis, and a co-occurring substance use disorder diagnosis were all independently associated with significantly increased odds of felony arrests, and with the exception of having a nonpsychotic diagnosis, they were also significantly associated with additional days in jail. Findings suggest that there are subgroups of individuals with a serious mental illness in the criminal justice system that may require different policy and programmatic responses.

  • Research Article
  • Cite Count Icon 1
  • 10.1111/jpm.12999
Seclusion within the first 24 h following admission into inpatient mental health services and associations with referral pathways, recent service contact and HoNOS ratings.
  • Nov 10, 2023
  • Journal of psychiatric and mental health nursing
  • Jennifer Lai + 9 more

WHAT IS KNOWN ON THE SUBJECT?: Seclusion is a harmful and traumatising intervention for people accessing mental health services. People who are subject to seclusion in inpatient mental health services often first experience this within the first 24 h following admission. There is limited research examining how recent contact with services impacts the likelihood of seclusion when people are admitted to inpatient services. WHAT THE PAPER ADDS TO EXISTING KNOWLEDGE?: Males, Māori and Pasifika experience higher rates of seclusion within the first 24 h following inpatient admission. People perceived by clinicians as overactive, aggressive, disruptive or agitated are seven times more likely to be secluded within the first 24 h. People referred from police or justice services are three times more likely to be secluded within the first 24 h. People who had frequent contact with community mental health services prior to inpatient admission were less likely to be secluded. WHAT ARE THE IMPLICATIONS FOR PRACTICE?: The first 24 h of inpatient admission is a critical focus for eliminating the use of seclusion. Initial interactions with people recently admitted should focus on nurturing relationships and reducing distress. Mental health staff should consider the person's cultural needs, referral pathway, recent service contact and baseline ratings on the Health of the Nation Outcomes Scales (HoNOS) when working proactively to prevent the use of seclusion in the first 24 h following admission. Strengthening the focus on nurturing relationships, cultural understanding and non-coercive de-escalation approaches requires leadership support and strategic workforce development. ABSTRACT: Introduction People who experience seclusion in inpatient mental health services often do so within the first 24 h following admission. There is limited research examining the potential contributing factors, particularly recent contact with services. Aim/Question To identify factors associated with seclusion within the first 24 h following admission into acute inpatient mental health services. Method A retrospective analysis was undertaken using routinely collected data from Aotearoa New Zealand mental health services. Results A higher likelihood of seclusion within the first 24 h following admission was associated with: males, Māori, Pasifika, referrals from police/justice services, inpatient transfers, recent contact with crisis assessment teams and clinician perceptions of aggression, problematic substance use, cognitive problems and hallucinations or delusions. Recent contact with community mental health services was associated with a lower likelihood. Discussion People's cultural needs, referral pathway, recent service contact and HoNOS scores should be considered when working to prevent the use of seclusion in the first 24 h following admission. Implications for Practice The first 24 h following inpatient admission is a critical period for preventing the use of seclusion. Nurturing relationships, cultural understanding and use of non-coercive de-escalation approaches can support better outcomes for people recently admitted.

  • Research Article
  • Cite Count Icon 9
  • 10.1176/appi.ps.58.12.1555
Initiation and Use of Public Mental Health Services by Persons With Severe Mental Illness and Limited English Proficiency
  • Dec 1, 2007
  • Psychiatric Services
  • T P Gilmer + 5 more

Initiation and Use of Public Mental Health Services by Persons With Severe Mental Illness and Limited English Proficiency

  • Research Article
  • Cite Count Icon 18
  • 10.1176/appi.ps.61.8.759
Trends in Behavioral Health Care Service Provision by Community Health Centers, 1998–2007
  • Aug 1, 2010
  • Psychiatric Services
  • Rebecca Wells + 3 more

Objective-The federal government boosted support for community health centers in medically underserved areas in 2002-2007.This investigation compared trends in behavioral health services provided by community health centers nationwide during the first several years of that initiative with immediately prior trends.Methods-Data were extracted from the Health Resources and Services Administration's Uniform Data System on community health centers for 1998-2007 (2007, N=1,067).Regression analyses revealed trends in individual community health centers' likelihood of providing on-site specialty mental health care, crisis services, and substance abuse treatment.Aggregate data were used to show national trends in numbers of behavioral health encounters, patients, and encounters per patient.Results-The number of federally funded community health centers increased 43% between 2001 and 2007, from 748 to 1,067, over twice the annual growth rate between 1998 and 2001.However, trends in individual community health centers' likelihood of providing different types of behavioral health care were generally consistent across the two time periods.In 2007, 77% of community health centers offered specialty mental health services, 20% offered 24-hour crisis intervention services, and 51% offered substance abuse treatment.The mean number of mental health encounters per mental health patient at community health centers in 2007 was 2.9.Conclusions-The behavioral health care safety net has widened through rapid recent growth in the number of community health centers as well as a continuing increase in the proportion offering specialty mental health services.Access to behavioral health care remains a major public health concern in the United States (1-4), most acutely affecting people who have low income or are uninsured (5-7).One

  • Research Article
  • Cite Count Icon 140
  • 10.1176/appi.ps.201700475
Contact With Mental Health Services Prior to Suicide: A Systematic Review and Meta-Analysis.
  • Apr 16, 2018
  • Psychiatric Services
  • Fredrik A Walby + 2 more

Access to mental health care is regarded as a central suicide prevention strategy. This is the first systematic review and meta-analysis of the prevalence of contact with mental health services preceding suicide. A systematic search for articles reporting prevalence of contact with mental health services before suicide was conducted in MEDLINE and PsycINFO, restricted to studies published from January 1, 2000, to January 12, 2017. A random-effects meta-analysis with double arcsine transformations was conducted, with meta-regression used to explore heterogeneity. Thirty-five studies were included in the systematic review, and 20 were included in the meta-analysis. Among suicide decedents in the population, 3.7% (95% confidence interval [CI]=2.6%-4.8%) were inpatients at the time of death. In the year before death, 18.3% (CI=14.6%-22.4%) of suicide decedents had contact with inpatient mental health services, 26.1% (CI=16.5%-37.0%) had contact with outpatient mental health services, and 25.7% (CI=22.7%-28.9%) had contact with inpatient or outpatient mental health services. Meta-regression showed that women had significantly higher levels of contact compared with men and that the prevalence of contact with inpatient or outpatient services increased according to the sample year. Contact with services prior to suicide was found to be common and contact with inpatient or outpatient mental health services before suicide seems to be increasing. However, the reviewed studies were mainly conducted in Western European and North American countries, and most studies focused on psychiatric hospitalization, which resulted in limited data on contact with outpatient services. Better monitoring and data on suicides that occur during and after treatment seem warranted.

  • Research Article
  • Cite Count Icon 28
  • 10.1176/appi.ps.61.11.1081
Health Reform and the Scope of Benefits for Mental Health and Substance Use Disorder Services
  • Nov 1, 2010
  • Psychiatric Services
  • R L Garfield + 2 more

Health Reform and the Scope of Benefits for Mental Health and Substance Use Disorder Services

  • Research Article
  • 10.1016/j.ptdy.2021.06.027
Mental health care among marginalized populations in the United States
  • Jul 1, 2021
  • Pharmacy Today
  • Jeffrey Gold

Mental health care among marginalized populations in the United States

  • Research Article
  • Cite Count Icon 68
  • 10.1002/1520-6629(199404)22:2<82::aid-jcop2290220205>3.0.co;2-i
Asian Americans' differential patterns of utilization of inpatient and outpatient public mental health services in Hawaii
  • Apr 1, 1994
  • Journal of Community Psychology
  • Frederick T L Leong

The major purpose of the present study was to examine Asian Americans' differential patterns of utilization of mental health services in Hawaii. It was proposed that an analysis of Asian Americans' differential patterns of utilization of inpatient and outpatient mental health services may provide some clues to the reasons behind their overall pattern of underutilization. More specifically, whereas it has been established in many studies that Asian Americans tend to underutilize mental health services, the present research questions are directed at determining if Asian Americans tend to (a) underutilize inpatient mental health services, (b) overutilize or use at their representative level outpatient mental health services, and (c) exhibit different patterns in the sources of referral into the mental health system. Using a dataset from the state of Hawaii's Department of Health, mental health service utilization rates for three Asian-American groups (Chinese, Japanese, and Filipino) were compared to each other and to those of White Americans. It was found that there were ethnic subgroups (e.g., Chinese versus Filipino) and intergroup differences (i.e., Asian versus White) in the utilization of inpatient and outpatient mental health services as well as in sources of referral into the mental health system. The clinical and research implications of the findings are discussed.

Save Icon
Up Arrow
Open/Close