Using Facial EMG to Track Emotion During Language Comprehension: Past, Present, and Future
van Berkum, J.J.A.; Struiksma, M.E.; 't Hart, B.
(2023) Grimaldi, Mirko, Brattico, Elvira, Shtyrov, Yury (eds.), Language Electrified, pp.
Neuromethods, pp.
(Part of book)
Abstract
Beyond recognizing words, parsing sentences, building situation models, and other cognitive accomplishments, language comprehension always involves some degree of emotion too, with or without awareness. Language excites, bores, or otherwise moves us, and studying how it does so is crucial. This chapter examines the potential of facial electromyography (EMG) to
... read more
study language-elicited emotion. After discussing the limitations of self-report measures, we examine various other tools to tap into emotion, and then zoom in on the electrophysiological recording of facial muscle activity. Surveying psycholinguistics, communication science, and other fields, we provide an exhaustive qualitative review of the relevant facial EMG research to date, exploring 55 affective comprehension experiments with single words, phrases, sentences, or larger pieces of discourse. We discuss the outcomes of this research, and evaluate the various practices, biases, and omissions in the field. We also present the fALC model, a new conceptual model that lays out the various potential sources of facial EMG activity during language comprehension. Our review suggests that facial EMG recording is a powerful tool for exploring the conscious as well as unconscious aspects of affective language comprehension. However, we also think it is time to take on a bit more complexity in this research field, by for example considering the possibility that multiple active generators can simultaneously contribute to an emotional facial expression, by studying how the communicator’s stance and social intention can give rise to emotion, and by studying facial expressions not just as indexes of inner states, but also as social tools that enrich everyday verbal interactions.
show less
Download/Full Text
Keywords: Communication science, EMG, Emotion, Evaluation, Facial electromyography, Mimicry, Psycholinguistics, Psychophysiology, Review, Simulation, Psychiatry and Mental health, General Biochemistry,Genetics and Molecular Biology, General Neuroscience, Pharmacology, Toxicology and Pharmaceutics(all)
ISSN: 0893-2336
ISBN: 978-1-0716-3262-8
978-1-0716-3263-5
Publisher: Springer
Note: Funding Information: This work is partly supported by NWO Vici grant #277-89-001 to JvB. We thank Anita Eerland and Mirko Grimaldi for comments on an earlier version of this chapter, the members of the ILS Language & Communication research group for feedback on some of the ideas presented here, and Ton van Boxtel for Fig. 1, and for generously sharing his expertise when we embarked upon our first EMG project. Publisher Copyright: © 2023, Springer Science+Business Media, LLC, part of Springer Nature.
(Peer reviewed)