Workshop Description

The Sixth Annual Workshop on Computational Linguistics and Clinical Psychology (CLPsych) will be held at the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL). Register here! Schedule now available here! (subject to change)

Sixth Annual Workshop on Computational Linguistics and Clinical Psychology (CLPsych): Reconciling Outcomes

NAACL 2019
June 6th
Minneapolis, MN

A closer union between clinical psychology and natural language processing introduces a new frontier for mental health at a time when supporting more people —  and faster — is a financial and public health priority. There is a substantial and rising burden of mental health disorders and a significant shortage of resources available to prevent, diagnose, and treat them. For 5 years, CLPsych has brought together scientists and clinicians interested in improving the efficiency and reach of mental health treatment through scholarship and discussion focused on:

(a) objective, naturalistic behavioral data to improve upon the assessment of mental health needs provided by self-reported questionnaires — currently the most common method of assessment;

(b) providing language researchers a deeper understanding of the field of mental and neurological health and the needs of those currently responsible for diagnosis and treatment;

(c) increasing clinicians’ understanding of innovations in language technology and realistic expectations for implementation;

(d) the co-development of high-value NLP tools that can be deployed in the clinical community; and

(e) discussion of critical ethical questions concerning the opportunities and challenges created by human-technology interactions and analysis of the data generated.

CLPsych appeals to an interdisciplinary audience sharing findings, models, and methods to increase access to and scalability of mental health care.

This year’s workshop will focus on reconciling outcomes, a construct central to each of the main audiences participating in CLPsych; however, operationalized differently, with definitions ranging from treatment response to prediction accuracy. We encouraged researchers to contribute papers that address different definitions of what constitutes an “outcome” in the intersection of language and clinical psychology, connected with focus areas (a-e) above. We were particularly interested in papers contributing to a discussion of how to align the outcomes that are most important to pursue as a community.

A key goal of this workshop is to foster the conversation with clinicians, both at the workshop and when these papers are read in the future. We therefore include practicing clinicians and clinical researchers on our program committee, and the ability to communicate ideas, approaches, and results clearly to people who are not computational linguists will be as important as the quality of the work itself.  This year we took two categories of submission: standard and position papers.

Standard papers followed the guidelines for Long Papers in the NAACL 2019 call for papers at  These permit 8 pages of content plus references. In addition to papers describing algorithms, models, and experimentation, we were happy to receive carefully argued and supported position papers, insightful reviews or synthesis of relevant literature, or informative descriptions of real-world experiences deploying language technology (including prototypes) in relevant clinical settings.

Position papers could contain up to 4 pages of content, plus references of any length. These papers clearly articulated a position, argument, or agenda that may be of value to the Workshop’s community. For example, authors with a clinical focus could have a position on ethical issues, promises and pitfalls of adopting technological approaches and digital mental health solutions, the connection between technology and interventions, or issues the CLPsych community should be considering with respect to specific conditions or populations. Position papers from either the technological or clinical communities were welcomed and encouraged.

Submissions were accepted for oral or poster presentation.


As part of the efforts to improve diversity and inclusion in at the NAACL 2019 conference, we were pleased to offer a service that could help authors improve their workshop submissions. Grammarly is a program that checks English writing and suggests corrections. We provided free premium access to authors for one month. We hoped that this initiative would especially benefit non-native English speakers in the NLP community. We thank Grammarly for generously donating this service (at NAACL’s request) and supporting diversity and inclusion in NLP!

Important Dates

10 March 2019: Papers due (deadline extended!)
18-28 March 2019: Review period
2 April 2019: Notification of acceptance
9 April 2019: Camera-ready papers due
6 June 2019: Workshop!

Shared task. CLPsych 2019 held a shared task that focused on predicting individuals’ suicide risk from de-identified, public Reddit data.  You can read more about the shared task here. Findings will be presented at the workshop.

Keynote speaker. Becky Inkster from the Department of Psychiatry, Cambridge University will be presenting a keynote talk. Becky is an active researcher in digital innovation for mental health, and is co-founder of Hip Hop Psych, a social venture that uses hip-hop music to raise awareness about mental health in diverse settings. Becky is an International Advisory Board Member to Lancet Digital Health, an Advisor to the Alan Turing Institute, and a Global Advisor to Mental Health and Suicide Prevention at Facebook.

Panel. This year’s workshop will host a panel of clinicians and technologists including Nick Allen (University of Oregon), Glen Coppersmith (Qntfy), Nazli Goharian (Georgetown University), and Michelle Kuchuk (National Suicide Prevention Lifeline).

Organizing Committee (

Kristy Hollingshead, IHMC
Kate Loveys, University of Auckland School of Medicine
Kate Niederhoffer, 7 Cups
Philip Resnik, University of Maryland
Rebecca Resnik, Rebecca Resnik and Associates, LLC

Shared Task Organizers

Ayah Zirikly, NIH
Philip Resnik, University of Maryland
Özlem Uzuner, George Mason University
Kristy Hollingshead, IHMC

Keynote Speaker

Becky Inkster, University of Cambridge


Nick Allen, University of Oregon
Glen Coppersmith, Qntfy
Nazli Goharian, Georgetown University
Michelle Kuchuk, National Suicide Prevention Lifeline

Program Committee

Nazli Goharian, Georgetown University
H. Andrew Schwartz, Stony Brook University
Glen Coppersmith, Qntfy
Ayah Zirikly, NIH
Cindy Chung, 7 Cups
Adam Miner, Stanford University
Frank Rudzicz, University of Toronto
Nick Allen, University of Oregon
Steven Bedrick, Oregon Health & Science University
Mike Conway, University of Utah
Danielle Mowery, University of Pennsylvania
Eric Morley, Google
Sean Murphy, Small Data Consulting, LLC
Daniel Preotiuc-Pietro, Bloomberg
Mark Rosenstein, Pearson Knowledge Technologies
Masoud Rouhizadeh, Johns Hopkins University
Maarten Sap, University of Washington
J. Ignacio Serrano, Spanish National Research Council (CSIC) Matthew Purver, Queen Mary University of London
Shervin Malmasi, Harvard Medical School
Molly Ireland, Texas Tech University
Craig Pfeifer, Mitre
Dimitrios Kokkinakis, University of Gothenburg
Loring Ingraham, George Washington University
Archna Bhatia, IHMC
Hiroki Tanaka, Naist
Kathleen C. Fraser, National Research Council Canada
Craig Harman, Johns Hopkins University
Tong Liu, RIT
William Jarrold, Nuance
Paul Thompson, Dartmouth
Christopher Homan, RIT
Micah Iserman, Texas Tech University
Jill Dolata, Oregon Health & Science University
Patrick Crutchley, Qntfy
Jonathan Schler, Bar Ilan University
Raymond Tucker, Louisiana State University
Joseph Costello, Western Michigan University School of Medicine
James Sexton, George Washington University