Text-Centered versus Multimodal Analysis of Instant Messaging Conversation
Article Sidebar
Main Article Content
Abstract
The primary objective of this study is to show the methodological benefits of a multimodal analysis of computer-mediated discussions. In order to go beyond the limits of a text-centered analysis, this study takes the kinesic behaviors of participants into account. An analysis of nonverbal communication, facial expression, and the relationship between text and kinesic behaviors in video recordings of four instant messaging discussions reveals that some kinesic behaviors can be seen as markers of engagement in interaction, even though an instant messaging discussion is not really interactive. Moreover, analyzing the kinesic behaviors of the participants shows that linear transcripts of the discussion generated by computer software hide many overlap phenomena. Finally, observation of the participants' facial expressions permits a more precise analysis of the emotional dimension of the discussion and highlights the discrepancy between text and nonverbal behaviors.
Article Details
Michel Marcoccia
Michel Marcoccia is Assistant Professor of Communication Studies at the University of Technology of Troyes (France). His research interests include conversational analysis of computer-mediated communication, computer-mediated social support, and virtual speech communities.
Hassan Atifi
Hassan Atifi is Assistant Professor of Communication Studies at the University of Technology of Troyes (France). His research interests include ethnography of computer-mediated communication, digital corpora, and cultural variation in CMC.
Nadia Gauducheau
Nadia Gauducheau is Assistant Professor of Psychology at the University of Technology of Troyes (France). Her research interests include emotion in CMC, evaluation of information and communication technologies, and communicative competence in CMC.

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Licensing and Reuse: Unless another option is selected below, reuse of the published Work will be governed by a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY https://creativecommons.org/licenses/by-nc/4.0/ ). This lets others remix, tweak, and build upon the Work non-commercially; although new works must acknowledge the original Language@Internet publication and be non-commercial, they do not have to be licensed on the same terms.