The article I’ve read this time is “The visual basis of linguistic meaning and its implications for critical discourse studies: Integrating cognitive linguistic and multimodal methods” by Christopher Hart, published in Discourse & Society in 2016 (find it here). This is the first non-media studies article during this little article reading experiment of mine!
The disclaimer:
I don’t aim to write ‘academic reviews’ of these papers, but very informal and subjective thoughts about how these papers or chapters could influence my own work. I even avoid direct quotes of the text to also make it visually more apparent that this is not an academic text.
I was drawn to this paper because of my continued interest in multimodality and, well, the intriguing wording of ‘visual basis of linguistic meaning’. However, the ‘cognitive linguistic’ aspect of it intimidated me a little; the term ‘cognitive’ tends to make me think of all things psychological and things that happen inside a person’s mind, which is not really what I’ve been studying so far. Sure, I’ve analysed meanings produced in discourse, but I’ve tried to be careful not to step over the line to make suggestions about what people think when they are experiencing this or that. These are two different things.
I think partially because of the fear that I was stepping over into (to me) unexplored area of research it took me a lot longer to finish reading this paper than the previous ones. There’s nothing wrong with the paper or how it was written (on the contrary, it demonstrates its arguments and examples well). I’m just experiencing that good ol’ impostor syndrome and sometimes encountering something that isn’t immediately and easily understandable to me makes me question my intelligence, and that is destructive for my motivation to keep reading. Especially if I feel like it’s something that I should easily understand, which is the case here considering my educational background… Anyway. Just trying to be open about my challenges because how else to improve?
The paper discusses what cognitive linguistic critical discourse studies (CL-CDS) has to offer in combination with multimodal discourse analysis (MDA), how to explore connections between language, image and ideology, and how multimodal information is encoded by mental representations that are invoked by language use. Some of it is familiar to anyone who’s dealt with discourse studies before, but with suggested new uses and perspectives.
The paper gives a short introduction to MDA and how there’s been a need to develop a toolkit, like ones used in linguistics/grammatics, to describe the communication of ideas, attitudes and identities in non-linguistic forms. This is actually something I’ve had some methodological anxiety about, since I’m supposed to be analysing gestures, expressions, etc. in video material in the near future. It seems very difficult to find tools for describing what different non-linguistic means of expressing meaning might actually mean. If someone has a sarcastic smile on their face, am I allowed to suggest it’s a sarcastic smile, and if so, based on what reasoning? In linguistics, there are specific grammatical means and contextual information that we can use to support our arguments. I’m still struggling to understand how to do that credibly with non-linguistic communication. This paper, at least, helps orientate my thinking somewhat, for example, through the conceptualizations of image as co-text and context: how linked language usage and images match, and how previously encountered semiotic experiences reflect in simulated experiences.
One especially interesting part for me was the argument concerning how the encoding of orientational values, at the level of simulation, encourages us to experience an event as if we were in the shoes of the agent or patient (in a text). So for example, a person or group involved in an event (like being threatened by a shooter) can be positioned as the patient – as the one on the receiving end of an action – so that the viewer interprets the action as a personal threat rather than something neutrally reported. Basically, by deciding whom to portray as the agent or patient we’re also making decisions of who are to be perceived as ‘one of us’ or as ‘other’, and something like danger can be perceived as personal or impersonal. (At least that’s how I understand it.) Doing this kind of analysis in language is familiar to me, but in images, not so much. I see the benefits of using this kind of approach to the analysis of news media, in particular, but not necessarily the kind of data that I have currently collected, aside from acknowledging the positioning of participants as performers or audience and what that suggests about their perceived importance for the content. However, since we’re already speaking of simulation, I wonder if someone would one day do a close analysis of, for example, how different types of game characters are visually positioned during scenes and still images (when the player does not control the camera) and what this suggests about their ideological connotations.
I probably failed to discuss the main points that the article strove to make, but like I said, I’ve been going through some challenges and am still taking it all in. At least I managed to blog about it!