"And how does that make you feel? Empathy is the foundation of therapeutic intervention. But how can you know if your therapist is or will be empathetic? Technology developed by researchers from USC, University of Washington, and the University of Utah can tell you.

Leveraging developments in automatic speech recognition, natural language processing and machine learning, researchers Bo Xiao (Ming Hsieh Department of Electrical Engineering at the USC Viterbi School of Engineering), Zac E. Imel (Department of Educational Psychology at the University of Utah), Panayiotis G. Georgiou (Ming Hsieh Department of Electrical Engineering at the USC Viterbi School of Engineering), David C. Atkins (Department of Psychiatry and Behavioral Sciences at the University of Washington) and Shrikanth S. Narayanan (Ming Hsieh Department of Electrical Engineering at the USC Viterbi School of Engineering), developed software to detect "high-empathy" or "low-empathy" speech by analyzing more than 1,000 therapist-patient sessions. The researchers designed a machine-learning algorithm that takes speech as its input to generate an empathy score for each session automatically.

Their methodology is documented in a forthcoming article titled, "'Rate My Therapist': Automated Detection of Empathy in Drug and Alcohol Counseling via Speech and Language Processing," and according to the authors, is the first study of its kind to record therapy sessions and automatically determine the quality of a therapy session based on a single characteristic. The study appears in the December issue of PLoS ONE.

Currently, there are very few ways to assess the quality of a therapy session. In fact, according the researchers, the methods for evaluating therapy have remained unchanged for seventy years. Methods requiring third-party human evaluators are time-consuming and affect the privacy of each session.

Instead, imagine a natural language processing app like SIRI listening in for the right phrases and vocal qualities. The researchers are building on a emerging a new field in engineering and computer science called behavioral signal processing, which "utilizes computational methods to assist in human decision-making about behavioral phenomena."

The authors taught their algorithm to recognize empathy via data from training sessions for therapists, specifically looking at therapeutic interactions with individuals coping with addiction and alcoholism. Using automatic speech recognition and machine learning based models, the algorithm then automatically identified select phrases that would indicate whether a therapist demonstrated high or low empathy.

Key phrases such as: "it sounds like," "do you think," and "what I'm hearing," indicated high empathy, while phrases such as "next question," "you need to," and "during the past," were perceived as low-empathy by the computational model.

Speaking about this innovation Shri Narayanan, Andrew J. Viterbi Professor of Engineering at USC and the senior author on this study, said, "Technological advances in human behavioral signal processing and informatics promise not only scale up and provide cost savings through automation of processes that are typically manual, but enable new insights by offering tools for discovery. This particular study gets at a hidden mental state and what this shows is that computers can be trained to detect constructs like empathy using observational data."

Narayanan's team in the Signal Analysis and Interpretation Lab at USC continues to develop more advanced models -- giving the algorithm the capacity to analyze diction, the tone of voice, the musicality of one's speech (prosody) as well as how the cadence of one speaker in conversation is echoed with another (for example when a person talks fast and the listener's oral response mirrors the rhythm with quick speech).

In the near term, the researchers are hoping to use this tool to train aspiring therapists.

"Being able to assess the quality of psychotherapy is critical to ensuring that patients receive quality treatment, said David Atkins, a University of Washington research professor of psychiatry.

"...The sort of technology our team of engineers and psychologists is developing may offer one way to help providers get immediate feedback on what they are doing - and ultimately improve the effectiveness of mental health care," said Zac Imel, a University of Utah professor of educational psychology and the paper's corresponding author.

In the long run, the team hopes to create software that provides real-time feedback or rates a therapy session on the spot. In addition, the researchers want to incorporate additional elements into their empathy rating algorithm, including acoustic channels and the frequency with which a therapist or patient speaks.