Mixed Methods Projects Research Articles

Using mixed methods approaches to study families and relationships

AbstractMixed methods research—methodologies that synthesize qualitative and quantitative approaches in the design, collection, analysis, and dissemination of research related to a specific topic or aim—is increasingly common, offering innovative empirical insight into families and relationships. We first elaborate on our definition of mixed methods research, emphasizing that there is significant heterogeneity within mixed methods approaches to studying families and relationships. Second, we discuss benefits of mixed methods projects within family and relationship research, including theory building and innovation. Third, we provide practical suggestions for designing and implementing a mixed methods project, highlighting useful resources for researchers as they develop research questions, plan designs, collect and analyze data, and disseminate findings. We emphasize the unique opportunities from abductive analytic approaches for mixed methods researchers and point to the need for reflexivity. Fourth, we consider common obstacles associated with disseminating mixed methods research and explain why family researchers need “mixed methods literacy” regardless of their research paradigm. Finally, we identify key areas of future growth for mixed methods researchers. We advocate that understanding mixed methods research has practical benefits, even for researchers not using these approaches. To cohesively build—and critique—our knowledge of families and relationships, family and relationship researchers across paradigms should be familiar with the basic tenets, strengths, and limitations of qualitative, quantitative, and mixed methods research.

The ebbs and flows of empathy: a qualitative study of surgical trainees in the UK

BackgroundEmpathy is widely recognised as an important element of medical practice contributing to patient outcomes and satisfaction. It is also an important element of collaborative work in a healthcare team. However, there is evidence to suggest that empathy towards patients declines over time, particularly in surgical specialities. There is little qualitative research on this decline in surgical trainees, particularly in the UK. Therefore, the aim of this study was to explore how trainee surgeons experience empathy over the course of their career, both towards patients and colleagues and how they perceive it in others.Methods10 semi-structured interviews were carried out with surgical trainees of different grades and specialties in January and February 2022. Framework analysis was used to interpret the data.ResultsParticipants experienced an evolution in empathy over their career as their personal and professional experience was added to. They drew a distinction between desensitisation and actual decline in empathy and identified more with experiencing the former in their careers. Participants also felt interprofessional relationships require empathy, and this could be improved upon. Finally, they highlighted specific impacts of the COVID-19 pandemic upon their training, including reduced theatre time.ConclusionsParticipants felt training could be improved in regard to accessing training opportunities and relationships with colleagues, although many felt empathy between colleagues is better than it has been in the past. This project highlighted areas for future research, such as with surgeons in later stages of their careers, or mixed-methods projects.

OPPORTUNITIES AND CHALLENGES IN LARGE QUALITATIVE DATASETS IN GERONTOLOGICAL RESEARCH

Abstract Qualitative research focuses on in-depth data to understand people, processes, and phenomena. It often involves smaller datasets that do not intend to produce generalizable results but instead illuminate nuances, counterexamples, or underrepresented voices. Qualitative data can produce theory and allow for in-depth analyses. Recent methodological developments have created opportunities for large mixed methods projects to produce voluminous amounts of qualitative data that can and sometimes are shared as secondary datasets. The growing use of big data has also produced new possibilities for large qualitative datasets. Additionally, longitudinal and comparative qualitative research can produce significant data. This symposium presents four studies that examine opportunities and challenges in large qualitative datasets in gerontology. The first article uses multiple qualitative datasets to examine how long-term care staff balance resident rights of safety and autonomy. The second article uses multiple qualitative methods in a larger mixed methods Friendship Study to examine meaningful connections among people living with dementia in long-term care. Through a multi-site community university partnership, the third study extracts qualitative data from over 500 patient records to examine experiences of terminally ill hospice patients from residential homes for the dying. The fourth study examines nearly ten years of qualitative data from over 20 communities to examine successful aging from an Alaska Native perspective. Altogether, these four studies illuminate diverse strategies for identifying qualitative data, using data software, managing data, addressing ethical dilemmas, and employing research teams for coding and analyzing large qualitative datasets in gerontological research. This is a Qualitative Research Interest Group Sponsored Symposium.

‘Amusing and Fun’, ‘Arresting’, or ‘The Wrong Pictures’? Methodological Lessons from Using Photo-Elicitation in a Study of Academic Retirement

This article reports on the use of photo-elicitation in a mixed methods study of academics’ later careers and retirement. Interviewees, who were either in their later career stage or retired from university work, were asked during the interviews to discuss the resonance that pre-selected images had with their understanding of retirement. Despite reluctance on some participants’ part to engage with the images, the majority took the opportunity to elaborate on themes of time, purpose, trajectories, hopes, and fears, rejecting images that they considered stereotypically negative. The argument is made that photo-elicitation’s pioneers have served subsequent users of the method well by being candid about its challenges as well as its potential and by encouraging creativity and flexibility in its application rather than presenting a set way to proceed. Because research does not always go according to plan, photo-elicitation’s potential for creative and flexible use recommends it to both novice and established practitioners, possibly as a complement to other methods in mixed methods projects.

Simulation-Based Training and Its Use Amongst Practicing Paramedics and Emergency Medical Technicians: An Evidence-Based Systematic Review

Objectives: This systematic review (SR) describes how simulation-based training (SBT) is utilized by paramedics and emergency medical technicians (EMTs). Data sources: PubMed, CINAHL, Cochrane CENTRAL, Scopus, Web of Science, and Google Scholar were searched from 2010 to 2021. Review methods: Standard SR methodology was utilized according to PRISMA guidelines. Eligibility criteria included English studies conducted in the United States or Canada published and published between 2010 and 2021. Study designs were somewhat heterogeneous and included quantitative, qualitative, and mixed-methods projects. The specific populations included paramedics and EMTs. Results: 595 articles were initially identified and reviewed, 25 of which met our inclusion criteria. Of them, the most common SBT areas of focus documented in the literature was general assessment and treatment (7 studies) and airway management (7 studies). The majority of the studies were conducted in a mobile simulation lab (6 studies), simulation centers (5 studies), and ambulances (5 studies). Many of the studies report simulations involving using manikins alone and a combination of manikins and simulated patients. Overall, 21 studies documented the use of high-fidelity simulation. 16 studies involved paramedics only, 8 involved both paramedics and EMTs, and one study involved only EMTs. Most of the impact of SBT appeared to be on objective measures such as performance, procedural success, and ability to identify errors, as well as subjective metrics such as perceived improvement in knowledge and skill. The degree of sustained impact of SBT on skill retention was not frequently reported, and direct enhancement in patient outcomes such as length-of-stay, or mortality were not documented in any of the studies. Conclusions: Paramedics and EMTs provide critically important, often lifesaving, prehospital care. However, the opportunities to enhance their skills are limited by several factors; most notably their undergraduate and certificate educational requirements, which are much ... (truncated)

Joint Displays of Integrated Data Collection in Mixed Methods Research

Mixed methods researchers need tools for planning and demonstrating integration. Mixed methods joint displays have a growing presence in the literature for representing mixed methods findings, and for use as an analytic tool as in the case of joint display analysis. However, the joint display of integrated data collection represents a lesser-known application for use by mixed methods researchers. A joint display for integrated data collection links the qualitative and the quantitative data collection questions, scales, and/or items. Here we demonstrate how joint displays of integrated data collection can be used as a planning, implementation, and presentation tool to illustrate integration of the data collection process. We examine variations in joint displays of integrated data collection based on three core mixed methods designs, a convergent design, and two sequential mixed methods designs, and provide examples of each from the literature. We recommend the joint display of integrated mixed data collection as a highly effective tool for mixed methods researchers to use for planning, implementing, and representing integrated data collection in their mixed methods projects.

Object-centered interviews in mixed methods: Yielding the emotions of overseas migrant households in family financial socialization

This interdisciplinary methods paper talks about how families receiving overseas remittances discuss, decide and act about finance (what is called family financial socialization). Money matters yield delicate family dynamics, and families and their members hesitate to talk about money to others. Usual verbal interview methods may not be enough to surface emotions when remittance senders and receivers engage with each other surrounding family finances. On this score, visual methods provide opportunities to innovate mixed methods projects while trying to surface the lived experiences of people through visual stimuli. This paper shares the story of a mixed methods project —done in two rural municipalities in the Philippines— that implemented a visual method called object-centered interviews (OCIs). OCI participants (N ​= ​69) recruited for this study came from a household survey (N ​= ​443 migrant and 463 non-migrant households) done in research sites. In terms of data analysis, phenomenological reduction was employed to the OCI answers; major themes from the visual and verbal interview answers were then presented as a metaphorical visual display. “Cuts” of survey data and the major phenomenological themes were then integrated. The OCI as a visual method and an elicitation interview technique became useful in further understanding the behaviors and emotions of migrant families during family financial interactions. Psychologists, from various sub-fields, may find the use of objects during interviews helpful when research participants become verbally tight-lipped to narrate their lived experiences and emotions on ordinary and sensitive topics.

Ethical challenges of researching emergent socio-material-technological phenomena: insights from an interdisciplinary mixed-methods project using mobile eye-tracking

PurposeThis paper aims to discuss research ethics in mixed-methods research (MMR) and MMR development with a focus on ethical challenges that stem from working with technical instruments such as mobile eye-trackers.Design/methodology/approachThe case of an interdisciplinary mixed-methods development study that aimed at researching the impacts of emerging mobile augmented-reality technologies on the perception of public places serves as an example to discuss research-ethical challenges regarding (1) the practical implementation of the study, (2) data processing and management and (3) societal implications of developing instruments to track and understand human practices.FindingsThis study reports challenges and experiences in ethical decision-making in the practical implementation of the study regarding the relationship to research subjects, the use of mobile research instruments in public places and the interdisciplinary cooperation among research team members. Further, this paper expounds on ethical challenges and recommendations in data processing and management and with a view to societal implications of method development and the aspirations of transdisciplinarity. This study concludes that institutionalized ethics need to become more flexible, while applied ethics and reflection must make their entry into university curricula across disciplines.Originality/valueComplex interdisciplinary mobile and mixed-methods projects that involve sensors and instruments such as mobile eye-trackers are on the rise. However, there is a significant lack of engagement with practical research ethical challenges, practices and requirements in both mixed-methods and method-development literature. By taking a context- and process-oriented perspective focusing on doing ethics, the paper contributes a concrete empirical case to these underdeveloped fields.

Understanding young adult Muslim and Christian attitudes toward queer identity: A Canadian and UK comparison.

This article utilises data from two parallel mixed-methods projects to examine attitudes to queer identity among heterosexual Muslim and Christian young adults aged between 18 and 25 in Canada and the UK. Drawing on questionnaires, interviews and video diaries, our analysis revealed the enormous complexity regarding how participants made sense of their, largely contextually mediated, attitudes. A qualitative approach enabled us to carefully consider how these attitudes are forged, formulated and embodied, offering greater nuance and detail compared with attitudinal approaches focused solely on quantitative data. Responses by these young Muslim and Christian participants explore the fluidity and movement in the attitudes expressed, further emphasising complexity.

Project Management Principles for Optimizing Publication Productivity of Mixed Methods Studies

Mixed methods research is increasingly valued, although little attention has been placed on how to execute such projects well to achieve optimal publication for impact. Multiple publications from a single study allow scholars to explicate findings that cannot be contained in a single article and which address different aspects of study findings. This article contributes to the fields of mixed methods research by building on their roots in pragmatism, which we argue calls for effective research studies resulting in published findings. This article proposes a project management framework and describes how to optimize mixed methods manuscript production during each of 5 research phases. We describe lessons learned from project management and implementation of our own mixed methods projects to help research teams build quality projects with optimal publication outputs and impact.

An Application of a Tivaivai Research framework to a quantitative Pacific health research project using New Zealand’s Integrated Data Infrastructure

Using the Integrated Data Infrastructure (IDI) to investigate or research various social, cultural, health, or other related outcomes is appealing and has a lot of potential. The IDI offers sufficient numbers for researchers to investigate outcomes in Pacific communities to a level of detail not available in many studies. Additionally, it allows organisations to upload their own data to supplement measures in the IDI. The overall aim of this paper is discuss the appropriate values for research projects involving Pacific communities using IDI data; issues around ownership of data from Pacific communities; consent; identification; and other ethical considerations. 
 Although the IDI has a great deal of potential for Pacific health research, many findings based on research using IDI data have been recognised as deficit-framed and polarising for the communities they describe. Some would argue that such findings highlight discrepancies in health or social equity and point to deficiencies that should be the responsibility of governmental organisations. Most analyses stop short of investigating practical pathways for communities to find solutions that are sympathetic to the values or established infrastructure of those communities. Instead, most communities found themselves characterised by deficit and feeling solely responsible for their poor situation.
 This paper proposes an extension to the Tivaivai/Tivaevae research framework and shows how it incorporates values that should be reflected in Pacific research using IDI data. With applications in a range of disciplines, the Tivaivai framework, like many Pacific research models, has been applied to quantitative or small mixed-methods projects, and usually restricted to Cook Islands research. This paper shows its usefulness can be applied to a strictly quantitative research framework, making it sympathetic to wider Pacific values as well as consistent with other familiar Pacific research frameworks. These concepts will be incorporated into a research project for an HRC funded Post-doctoral study investigating the value of education to health outcomes for Pacific families. It is hoped that this paper may provide a starting point for other quantitative Pacific research projects involving administrative or other big data.

Methods Braiding: A Technique for Arts-Based and Mixed-Methods Research

This article introduces a technique for doing mixed-methods research which I term the methods braiding technique. Contributing to established techniques for mixing methods across and within the quantitative and qualitative spectra, methods braiding incorporates arts-based research considerations. This aims to assist the growing number of researchers seeking to incorporate creative methods into their projects and add to established integrative, iterative, and synergistic approaches with insights from arts-based research. The methods braiding technique offers three main strengths. First, it assists researchers with cultivating reflexivity through periodic process reviews. Second, methods braiding helps researchers engage with the potentially divergent conceptual foundations of mixed-methods projects; by framing ‘mixing’ as a braiding process, this technique emphasises the synergistic integration of methods, analysis, and interpretation. Finally, and especially valuable for projects using arts-based methods, this technique centralises the crafting of multiple research outputs throughout the duration of a project. The use of this technique is illustrated via an example of a project in which a sociological fiction novel is constructed.

Qualitative or Mixed Methods Research Inquiry Approaches: Some Loose Guidelines for Publishing in Sex Roles

The number of papers submitted to Sex Roles that present, analyze, and discuss qualitative data has been increasing in recent years (Frieze 2008, 2013). At the same time, mixed methods studies are becoming ever more popular within the fields of social and behavioral sciences, especially because mixed methods’ design possibilities lend themselves well to interdisciplinary investigations. In addition to studies utilizing a qualitative approach, Sex Roles: A Journal of Research, a journal dedicated to multiple disciplines, also welcomes submissions that reflect upon mixed methods projects. To expand upon Editor Yoder’s (2016) recent reflections on the directions and editorial practices of this journal, my editorial focuses on our expectations for both qualitative and mixed methods submissions to Sex Roles. As part of the Sex Roles editorial team, I look forward to providing consultation to the editor about qualitative and mixed methods research inquiry approaches.

Using mixed methods research designs in health psychology: an illustrated discussion from a pragmatist perspective.

To outline some of the challenges of mixed methods research and illustrate how they can be addressed in health psychology research. This study critically reflects on the author's previously published mixed methods research and discusses the philosophical and technical challenges of mixed methods, grounding the discussion in a brief review of methodological literature. Mixed methods research is characterized as having philosophical and technical challenges; the former can be addressed by drawing on pragmatism, the latter by considering formal mixed methods research designs proposed in a number of design typologies. There are important differences among the design typologies which provide diverse examples of designs that health psychologists can adapt for their own mixed methods research. There are also similarities; in particular, many typologies explicitly orient to the technical challenges of deciding on the respective timing of qualitative and quantitative methods and the relative emphasis placed on each method. Characteristics, strengths, and limitations of different sequential and concurrent designs are identified by reviewing five mixed methods projects each conducted for a different purpose. Adapting formal mixed methods designs can help health psychologists address the technical challenges of mixed methods research and identify the approach that best fits the research questions and purpose. This does not obfuscate the need to address philosophical challenges of mixing qualitative and quantitative methods. Statement of contribution What is already known on this subject? Mixed methods research poses philosophical and technical challenges. Pragmatism in a popular approach to the philosophical challenges while diverse typologies of mixed methods designs can help address the technical challenges. Examples of mixed methods research can be hard to locate when component studies from mixed methods projects are published separately. What does this study add? Critical reflections on the author's previously published mixed methods research illustrate how a range of different mixed methods designs can be adapted and applied to address health psychology research questions. The philosophical and technical challenges of mixed methods research should be considered together and in relation to the broader purpose of the research.

Weaving a Multimethodology and Mixed Methods Praxis Into Randomized Control Trials to Enhance Credibility

Most disciplines within the health and social sciences regard randomized control trials (RCTs) as the “gold standard” of evidence-based practice (EBP). The move toward mixed methods within evidence-based research has proven daunting to many researchers, and few best practices for RCT mixed methods studies currently exist. This article provides some strategies for incorporating mixed methods into RCT designs. Furthermore, the author argues for the value of also infusing a multimethodological approach into RCT mixed methods projects to further offer research strategies for enhancing the credibility of RCT research findings through, for example, incorporating participants’ lived experiences and methodological reflexivity into the research process. The bulk of this article presents four case studies that analyze how researchers in diverse fields have taken a multimethodological praxis into account in their RCT mixed methods projects, including the integration of a mixed methods multimethodological component into RCT research designs. The author also addresses the missed opportunities in these studies to maximize the validity of RCT projects by using mixed methods and multimethodological designs.

Reconciling incongruous qualitative and quantitative findings in mixed methods research: Exemplars from research with drug using populations

Mixed methods research is increasingly being promoted in the health sciences as a way to gain more comprehensive understandings of how social processes and individual behaviours shape human health. Mixed methods research most commonly combines qualitative and quantitative data collection and analysis strategies. Often, integrating findings from multiple methods is assumed to confirm or validate the findings from one method with the findings from another, seeking convergence or agreement between methods. Cases in which findings from different methods are congruous are generally thought of as ideal, whilst conflicting findings may, at first glance, appear problematic. However, the latter situation provides the opportunity for a process through which apparently discordant results are reconciled, potentially leading to new emergent understandings of complex social phenomena. This paper presents three case studies drawn from the authors’ research on HIV risk amongst injection drug users in which mixed methods studies yielded apparently discrepant results. We use these case studies (involving injection drug users [IDUs] using a Needle/Syringe Exchange Program in Los Angeles, CA, USA; IDUs seeking to purchase needle/syringes at pharmacies in Tijuana, Mexico; and young street-based IDUs in San Francisco, CA, USA) to identify challenges associated with integrating findings from mixed methods projects, summarize lessons learned, and make recommendations for how to more successfully anticipate and manage the integration of findings. Despite the challenges inherent in reconciling apparently conflicting findings from qualitative and quantitative approaches, in keeping with others who have argued in favour of integrating mixed methods findings, we contend that such an undertaking has the potential to yield benefits that emerge only through the struggle to reconcile discrepant results and may provide a sum that is greater than the individual qualitative and quantitative parts.

The Adoption and Practice of Mixed Methods: U.S. Trends in Federally Funded Health-Related Research

Mixed methods research that combines qualitative and quantitative approaches is an emergent method that is achieving increasing acceptance and use across disciplines. Despite the importance of funding to the adoption of a new research approach, there is no clear understanding of U.S. funding agencies’ support for mixed methods. This study examines recent trends in health-related mixed methods projects funded by the National Institutes of Health and similar federal agencies. The results indicate that mixed methods projects are getting funded and their numbers are increasing but that their prevalence is still low overall. The nature of the projects indicates that researchers are adopting many conventions of the field of mixed methods research and planning approaches that integrate advanced qualitative and quantitative designs and procedures. The article concludes with recommendations to enhance the dynamic relationship between researchers’ decisions to propose mixed methods studies and existing extramural funding mechanisms.

Practical considerations for higher degree research students undertaking mixed methods projects

AbstractAs is the trend in nursing and health services research, mixed methods research is becoming increasingly popular in higher degree research programs. The aim of this paper is to identify and discuss the practical considerations that need to be contemplated by both the research student and the research supervisors before embarking on a mixed methods project, during the candidature and following completion of the project. Such considerations include the timing of the various data collections, the resource and skill development implications of using mixed methods, the need to create a supervisory panel with a combination of skills to support the project, strategies for managing the often extensive datasets, planning for integration or mixing within the study and reporting study findings. Adequate consideration of these issues has the potential to significantly reduce problems encountered during the candidature and enhance the quality of the work.

“I Knew I Wasn't Like Anybody Else”: Young Men's Accounts of Coming Out and Being Gay in Northern Ireland

This article is based on 20 one-to-one in-depth interviews conducted with young gay and bisexual men in Northern Ireland between 2000 and 2006. These interviews were conducted during two larger mixed-methods projects: one undertaken by the University of Ulster and the Northern Ireland branch of the Family Planning Association on sexual attitudes and lifestyles of 14–25 year olds, and the other conducted by the Rainbow Project on mental health of same-sex-attracted young men. During the interviews the respondents were asked to recall their experiences of coming out and living as same-sex-attracted people in Northern Ireland. Sociological narrative text–analytical coding techniques are used to identify core categories and themes of the coming-out process experienced by these young people. Firstly, the data are related to a model of gay identity formation. Secondly, Northern Ireland-specific circumstances impacting on gay identity formation are considered and embedded in a wider discussion using available literature.

Qualitative and Quantitative Research: Two Cultures

Back to table of contents Next article Taking IssueFull AccessQualitative and Quantitative Research: Two CulturesKim Hopper Ph.D.,Kim Hopper Ph.D.Search for more papers by this author,Published Online:1 Jul 2008AboutSectionsPDF/EPUB ToolsAdd to favoritesDownload CitationsTrack Citations ShareShare onFacebookTwitterLinked InEmail Aside from an understandable need to support the "Full Employment for Anthropologists Act of 2008," there is a very good reason to embrace the call to expand use of qualitative research methods in mental health services: we can't understand what's actually going on without them. This isn't special pleading—it is mundane fact. If we want to understand how it works (whatever "it" may messily turn out to be), what it means, and the enabling contingencies that seem to sustain it, we need to deploy such methods.That both quantitative and qualitative methods are needed and appropriate, depending upon the task at hand, seems deniable only by those with a professional stake in being contrary. As Robins and colleagues argue in the lead article in this issue, parity in planning and engaged communication make for fruitful mixed-methods projects. "Q-squared" as our merry European colleagues sometimes call it.Calls for closely watched, carefully documented, and scrupulously interpreted accounts of programs in action, of undeclared (and potentially disabling) agendas, and of tacit refusals that masquerade as enthusiastic endorsements steadily pour in from clinicians and researchers. It isn't hard to see why. Within the irksome, recalcitrant, unsettled, misbehaving nest of hidden variables—what Hohmann and Shear once mischievously referred to as "the noise of real life"—often lie undetected arbiters of program success. It can be as elusive as the added value of unpaid work or as plain as the transportation costs no one asked about.Published examples of qualitative methods in action are becoming more common. In this issue, Palinkas and colleagues found evidence for Schoen's "reflexive practitioner," but not as rare exemplar of craft. Instead, such practitioners appear as common and ill-accommodated burrs in intervention studies. When this finding is added to the study's jarring contextual finding that nearly a third of clinicians withdrew from the study for reasons external to the intervention itself, the difficulties of conducting and learning from such research projects become evident. In a remarkably matter-of-fact passage, however, Palinkas and colleagues describe how "creativity and compromise" were used to keep clinicians engaged—a hopeful if inadvertent rejoinder to the problems inventoried by Robins and colleagues.Requiring students to take sides in this long-running civil war between methods of inquiry has outlived its utility. A working knowledge of each other's toolkits and sensibilities seems essential to productive work in the field today. And more: Clifford Geertz argued that an ethnographic proficiency is key to competent citizenship on the globalized home front. Mixed-methods research is good practice in diversity—in "learning to grasp what we cannot [or choose not to] embrace." The skill of bridging cultures is "arduously learned" (Geertz again) and, once learned, something we must "work continuously to keep alive." Words to live (and work) by.Nathan Kline Institute, Orangeburg, New York FiguresReferencesCited byDetailsCited ByThe ties that bind: Using ethnographic methods to understand service engagement17 April 2012 | Qualitative Social Work, Vol. 11, No. 4Mixed-Methods Designs in Mental Health Services Research: A ReviewLawrence A. Palinkas, Ph.D., Sarah M. Horwitz, Ph.D., Patricia Chamberlain, Ph.D., Michael S. Hurlburt, Ph.D., and John Landsverk, Ph.D.1 March 2011 | Psychiatric Services, Vol. 62, No. 3LetterLaurence P. Karper, M.D.1 September 2008 | Psychiatric Services, Vol. 59, No. 9LetterKim Hopper, Ph.D.1 September 2008 | Psychiatric Services, Vol. 59, No. 9LetterVincenzo Villari, M.D.Giulio Barzega, M.D.1 September 2008 | Psychiatric Services, Vol. 59, No. 9LetterChih-Ming Lin, Ph.D.Chung-Yi Li, Ph.D.1 September 2008 | Psychiatric Services, Vol. 59, No. 9 Volume 59Issue 7 July, 2008Pages 711-711PSYCHIATRIC SERVICES July 2008 Volume 59 Number 7 Metrics PDF download History Published online 1 July 2008 Published in print 1 July 2008