The Workshop on Computational Linguistics and Clinical Psychology

CLPsych 2021, held in conjunction with NAACL 2021

June 11, 2021

Workshop 2021

In the era of COVID-19, when many people are experiencing unprecedented pressure — due to financial strain, health concerns, struggles with online work and education, and social isolation — experts report serious concerns about mental health. CLPsych has an important role to play in bringing people together to discuss and exchange their recent work and results. Together, we hope to be able to advance the common goals of using human language as a tool to better understand emotional and mental states, and reducing emotional suffering and the potential for self-harm. 

This year, like the NAACL conference, the workshop is being held entirely remotely. It’s unfortunate that the community won’t be getting together in person, but a silver lining is that this will expand the reach of the workshop to people who might not typically attend in person.

In addition to great accepted papers, we are delighted to have a superb slate of invited speakers and panelists.

Keynote talks will be given by Dr. Munmun De Choudhury (Georgia Tech) and Dr. Matthew Nock (Harvard), with additional invited talks by Dr. Glen Coppersmith (Qntfy), Dr. Carol Espy-Wilson (University of Maryland), and Dr. Lyle Ungar (University of Pennsylvania). A panel discussion with all five speakers will be moderated by Dr. Lorenzo Norris, who is Medical Director of Psychiatric & Behavioral Services at George Washington University Hospital and host of MDedge Psychcast, the official psychiatry podcast of the MDedge Network.

Supported by:

Silver Sponsor

call for papers

The call for papers and shared task participation


Info on registration and student registration awards


All times are Mexico City
U.S. Central time 


2021 organizing committee


Register for the Workshop

Registration for the workshop is is open on the NAACL 2021 site. A single registration fee provides access to CLPsych, other workshops, and the main conference!

Student Registration Awards

Students can apply for financial support to cover or offset their cost of registration. The deadline for these applications has been extended to 5pm U.S. Central time on June 9, 2021.

Workshop Schedule

Note: all times are Mexico City (U.S. Central) time

Time in Central Time:


Welcome and Keynotes


Conference introduction
Nazli Goharian, Rebecca Resnik, and Philip Resnik


Keynote speaker session introduction
Philip Resnik


Keynote and Q&A 
Matthew Nock, Harvard 


Introduction: Nazli Goharian

Keynote and Q&A
Munmun De Choudhury, Georgia Tech



Dr. Amanda Purnell




Paper session 1

Session chair: Andrew Yates

On the State of Social Media Data for Mental Health Research
Keith Harrigian, Carlos Aguirre and Mark Dredze

Individual Differences in the Movement-Mood Relationship in Digital Life Data
Glen Coppersmith, Alex Fine, Patrick Crutchley and Joshua Carroll


Commentary and discussion
Dr. April Foreman


Lunch / Zoom poster session

Intro to poster session: Molly Ireland

Breakout A: Social media analysis

Discussant: Dr. April Foreman

Automatic Detection and Prediction of Psychiatric Hospitalizations From Social
Media Posts
Zhengping Jiang, Jonathan Zomick, Sarah Ita Levitan, Mark Serper and Julia

Breakout B: Speech/language analysis

Discussants: Molly Ireland and Steven Bedrick

Safeguarding against spurious AI-based predictions: The case of automated verbal
memory assessment
Chelsea Chandler, Peter Foltz, Alex Cohen, Terje Holmlund and Brita Elvevåg
[ video, poster, teaser video ]


Paper session 2

Session chair: Molly Ireland

Dissociating Semantic and Phonemic Search Strategies in the Phonemic Verbal Fluency Task in early Dementia
Hali Lindsay, Philipp Müller, Nicklas Linz, Radia Zeghari, Mario Magued Mina, Alexandra Konig and Johannes Tröger

Demonstrating the Reliability of Self-Annotated Emotion Data
Anton Malko, Cecile Paris, Andreas Duenser, Maria Kangas, Diego Molla, Ross Sparks and Stephen Wan
[ video ]

Hebrew Psychological Lexicons
Natalie Shapira, Dana Atzil-Slonim, Daniel Juravski, Moran Baruch, Dana Stolowicz-Melman, Adar Paz, Tal Alfi-Yogev, Roy Azoulay, Adi Singer, Maayan Revivo, Chen Dahbash, Limor Dayan, Tamar Naim, Lidar Gez, Boaz Yanai, Adva Maman, Adam Nadaf, Elinor Sarfati, Amna Baloum, Tal Naor, Ephraim Mosenkis, Badreya Sarsour, Jany Gelfand Morgenshteyn, Yarden Elias, Liat Braun, Moria Rubin, Matan Kenigsbuch, Noa Bergwerk, Noam Yosef, Sivan Peled, Coral Avigdor, Rahav Obercyger, Rachel Mann, Tomer Alper, Inbal Beka, Ori Shapira and Yoav Goldberg
[ video, slides ]


Commentary and discussion
Dr. Rebecca Resnik




Invited talks and panel discussion

Session chair: Molly Ireland


Invited talk 1
Glen Coppersmith, Qntfy


Invited talk 2
Carol Espy-Wilson, University of Maryland


Invited talk 3
Lyle Ungar, University of Pennsylvania
[ video ]


Speakers & Lorenzo Norris (moderator)


Shared task

Session chair: Philip Resnik

Using Psychologically-Informed Priors for Suicide Prediction in the CLPsych 2021 Shared Task
Avi Gamoran, Yonatan Kaplan, Almog Simchon and Michael Gilead
[ video ]

Learning Models for Suicide Prediction from Social Media Posts
Ning Wang, Luo Fan, Yuvraj Shivtare, Varsha Badal, Koduvayur Subbalakshmi,
Rajarathnam Chandramouli and Ellen Lee




Break to make cocktails/obtain a drink


Zoom cocktail poster session

Intro to poster session: Molly Ireland

Breakout C: Therapeutic/Counseling Focused

Discussant: Dr. Kate Neiderhoffer

Towards Low-Resource Real-Time Assessment of Empathy in Counselling
Zixiu Wu, Rim Helaoui, Diego Reforgiato Recupero and Daniele Riboni
[ video ]

Analysis of Behavior Classification in Motivational Interviewing
Leili Tavabi, Trang Tran, Kalin Stefanov, Brian Borsari, Joshua Woolley, Stefan Scherer and Mohammad Soleymani
teaser video ]

Automatic Identification of Ruptures in Transcribed Psychotherapy Sessions
Adam Tsakalidis, Dana Atzil-Slonim, Asaf Polakovski, Natalie Shapira, Rivka
Tuval-Mashiach and Maria Liakata

Breakout D: Shared Task Q&A and Discussion

Shared Task papers from 4pm session above


Closing remarks

2021 Organizing Committee


Georgetown University


University of Maryland


Texas Tech University


Knowable Research


Rebecca Resnik and Associates


Max-Planck-Institut für Informatik

Call for Papers

A key goal of this workshop is to foster the conversation with clinicians and clinical researchers, both at the workshop and when these papers are read in the future. We therefore include practicing clinicians and clinical researchers on our program committee, and the ability to communicate ideas, approaches, and results clearly to people who are not computational linguists will be as important as the technical quality of the work.  

Submissions will be done using softconf, and detailed information will appear at We will be taking submissions of both long papers (up to eight pages of core content) and short papers (up to four pages of core content); plus unlimited references. Up to an extra page can be added in the final camera-ready version to allow space for addressing the reviewers’ comments. We strongly encourage all authors to include relevant discussions of ethical considerations and impact in the body of the paper. 

Authors may optionally include appendices, but these constitute additional information and might not be looked at by reviewers. If anything in the appendix is an important part of the contribution, or important for the reviewers to assess the work, they should be a part of the main paper, and not appear in the appendix. 

All paper submissions must describe substantial, original, completed, and unpublished work. In addition to papers describing algorithms, models, or experimentation, we are happy to receive carefully argued and supported position papers, insightful reviews or synthesis of relevant literature, or informative descriptions of real-world experiences deploying language technology (including prototypes) in relevant clinical settings (Topics include, but are not limited to, the ones listed in the Intent To Submit formsee under Important Dates below) .

All submissions must be fully anonymized to preserve the double-blind reviewing policy. Insufficiently anonymized submissions will be considered for desk-reject.

Authors should adhere to the policies under Submission Types & Requirements in the NAACL 2021 final call for papers at in terms of author guidelines, double submission, anonymity period calculation, double blind review, data management, human subjects discussion, and referencing prior work.

Specifically regarding dual submissions, papers submitted to this workshop must not have been accepted for publication elsewhere or be under review for another workshop, conference or journal.

Paper formatting information, including Word and LaTeX templates, can be found at In order for the paper to appear in the proceedings, at least one author must register for the workshop by the early registration deadline.

Authors of accepted papers will be asked to provide a pre-recorded video presenting their work and to participate in discussant-led breakout sessions during the workshop, in which their paper will be discussed.

This year, we are adopting the theme “Improving Access” to encourage submission and discussion of work that has the potential to help identify and serve people at risk, to create stronger links between patients and providers, and to address the needs of underrepresented communities.  We particularly welcome papers that seek to understand people who are difficult to reach, who are traditionally less likely to seek and receive help, or who may be socially or digitally excluded because of conventional measurement/diagnosis or care models.

Organizing Committee

Contact organizers at:

Nazli Goharian, Georgetown University (co-chair)
Philip Resnik, University of Maryland (co-chair)
Andrew Yates, Max Planck Institute for Informatics
Molly Ireland, Texas Tech University
Kate Niederhoffer, Knowable Research
Rebecca Resnik, Rebecca Resnik and Associates, LLC

Shared Task Organizers

Sean MacAvaney, Georgetown University & University of Glasgow
Anjali Mittu, University of Maryland
Philip Resnik, University of Maryland

Important dates

  • February 15, 2021: Authors are encouraged to send in an optional “intent to submit” at by this date, to help in planning. Although this date has passed, you are still welcome to send an “intent to submit” if you’d like; the more information we have, the better.
  • February 18, 2021: Anonymity period begins
  • March 15, 2021 Extended to March 18, 2021 at 11:59 pm UTC-12: Workshop paper submissions are due at
  • April 15, 2021: Notification of acceptance
  • April 23, 2021: Camera-ready papers due 
  • June 11, 2021: Remote workshop was held as part of NAACL

Shared Task

Announcement of the shared task was delayed but we have put together an activity that is worth the wait! We have created an opportunity for secure and ethical access to sensitive data in order to work as a community on the problem of predicting suicide risk from social media, and the dataset for the task includes de-identified Twitter posts and ground-truth outcomes from individuals who have attempted or succeeded in a suicide attempt, along with control individuals who have not. These data were donated for research purposes on Qntfy’s OurDataHelps platform. Teams participating in the shared task will do their experimentation on the UMD/NORC Mental Health Data Enclave, a secure computing environment that brings researchers to the data rather than vice-versa. Please see the shared task page for details on registration and participation.

Program Committee

Nick Allen, University of Oregon
Steven Bedrick, Oregon Health & Science University
Arman Cohan, Allen Institute for AI
Glen Coppersmith, Qntfy
Tyler Davis, Texas Tech University
Bart Desmet, National Institutes of Health
Samuel Dooley, UMD
Ophir Frieder, Georgetown University
Pranav Goel, University of Maryland
David Hancock, Weill Cornell Medicine
Kristy Hollingshead, IHMC
Loring Ingraham, George Washington University
Andrew Littlefield, Texas Tech University
Sean MacAvaney, IR Lab, Georgetown University
Adam Miner, Stanford University School of Medicine
Taleen Nalabandian, Texas Tech University

Yaakov Ophir, Technion – Israel Institute of Technology
Ted Pedersen, University of Minnesota, Duluth
Daniel Preotiuc-Pietro, Bloomberg LP
Emily Prud’hommeaux, Boston College
Masoud Rouhizadeh, Johns Hopkins University
Jonathan Schler, HIT
H. Andrew Schwartz, Stony Brook University
Han-Chin Shing, University of Maryland at College Park
Luca Soldaini, Amazon
Amelia Talley, Texas Tech University
Jason Van Allen, Texas Tech University
Sarah Wayland, Guiding Exceptional Parents, LLC
Eugene Yang, Georgetown University
Jessica Yu, Livongo
Ayah Zirikly, Johns Hopkins University

Follow us on Twitter

The #CLPsych2021 workshop at @NAACLHLT has extended the deadline for Student Registration Awards to June 9, 2021. Students who need financial assistance with registration are encouraged to apply.

Students: We’re pleased to announce that you can apply for financial support to cover or offset your cost of #CLPsych @NAACLHLT registration! Workshop site is Many thanks to @umiacs for a sponsorship making this possible.

The 2021 CLPsych workshop will take place online on June 11 at @NAACLHLT, and early (i.e. discounted) registration ends tomorrow, May 20th! Info at #NAACL2021 #CLPsych2021 Please pass this info along to folks who might be interested.

CLPsych 2021 is extending its workshop paper submission deadline from Monday March 15 to Thursday March 18. Looking forward to seeing your submissions! #NAACL2021 #clpsych

Load More…