research methods - Sari Piittinen

Category: research methods

Reading papers: Cognitive linguistic and multimodal methods

Posted on February 21, 2020 by Sari Piittinen

The article I’ve read this time is “The visual basis of linguistic meaning and its implications for critical discourse studies: Integrating cognitive linguistic and multimodal methods” by Christopher Hart, published in Discourse & Society in 2016 (find it here). This is the first non-media studies article during this little article reading experiment of mine!

The disclaimer:
I don’t aim to write ‘academic reviews’ of these papers, but very informal and subjective thoughts about how these papers or chapters could influence my own work. I even avoid direct quotes of the text to also make it visually more apparent that this is not an academic text.

I was drawn to this paper because of my continued interest in multimodality and, well, the intriguing wording of ‘visual basis of linguistic meaning’. However, the ‘cognitive linguistic’ aspect of it intimidated me a little; the term ‘cognitive’ tends to make me think of all things psychological and things that happen inside a person’s mind, which is not really what I’ve been studying so far. Sure, I’ve analysed meanings produced in discourse, but I’ve tried to be careful not to step over the line to make suggestions about what people think when they are experiencing this or that. These are two different things.

I think partially because of the fear that I was stepping over into (to me) unexplored area of research it took me a lot longer to finish reading this paper than the previous ones. There’s nothing wrong with the paper or how it was written (on the contrary, it demonstrates its arguments and examples well). I’m just experiencing that good ol’ impostor syndrome and sometimes encountering something that isn’t immediately and easily understandable to me makes me question my intelligence, and that is destructive for my motivation to keep reading. Especially if I feel like it’s something that I should easily understand, which is the case here considering my educational background… Anyway. Just trying to be open about my challenges because how else to improve?

The paper discusses what cognitive linguistic critical discourse studies (CL-CDS) has to offer in combination with multimodal discourse analysis (MDA), how to explore connections between language, image and ideology, and how multimodal information is encoded by mental representations that are invoked by language use. Some of it is familiar to anyone who’s dealt with discourse studies before, but with suggested new uses and perspectives.

The paper gives a short introduction to MDA and how there’s been a need to develop a toolkit, like ones used in linguistics/grammatics, to describe the communication of ideas, attitudes and identities in non-linguistic forms. This is actually something I’ve had some methodological anxiety about, since I’m supposed to be analysing gestures, expressions, etc. in video material in the near future. It seems very difficult to find tools for describing what different non-linguistic means of expressing meaning might actually mean. If someone has a sarcastic smile on their face, am I allowed to suggest it’s a sarcastic smile, and if so, based on what reasoning? In linguistics, there are specific grammatical means and contextual information that we can use to support our arguments. I’m still struggling to understand how to do that credibly with non-linguistic communication. This paper, at least, helps orientate my thinking somewhat, for example, through the conceptualizations of image as co-text and context: how linked language usage and images match, and how previously encountered semiotic experiences reflect in simulated experiences.

One especially interesting part for me was the argument concerning how the encoding of orientational values, at the level of simulation, encourages us to experience an event as if we were in the shoes of the agent or patient (in a text). So for example, a person or group involved in an event (like being threatened by a shooter) can be positioned as the patient – as the one on the receiving end of an action – so that the viewer interprets the action as a personal threat rather than something neutrally reported. Basically, by deciding whom to portray as the agent or patient we’re also making decisions of who are to be perceived as ‘one of us’ or as ‘other’, and something like danger can be perceived as personal or impersonal. (At least that’s how I understand it.) Doing this kind of analysis in language is familiar to me, but in images, not so much. I see the benefits of using this kind of approach to the analysis of news media, in particular, but not necessarily the kind of data that I have currently collected, aside from acknowledging the positioning of participants as performers or audience and what that suggests about their perceived importance for the content. However, since we’re already speaking of simulation, I wonder if someone would one day do a close analysis of, for example, how different types of game characters are visually positioned during scenes and still images (when the player does not control the camera) and what this suggests about their ideological connotations.

I probably failed to discuss the main points that the article strove to make, but like I said, I’ve been going through some challenges and am still taking it all in. At least I managed to blog about it!

Reading papers: Processual approach to media, communication and social change theorization

Posted on February 3, 2020February 3, 2020 by Sari Piittinen

The article I read this time is “Theorizing media, communication and social change: towards a processual approach” by Sabina Mihelj and James Stanyer, published in Media, Culture & Society in 2019 (find it here). It seems the papers are numbered in such a way that I’ll be doing papers from one journal at a time, so I guess we’ll be continuing with media studies until an article from a different journal pops up!

This time I was interested in this paper, first, because I didn’t know what a ‘processual approach’ concretely means, and second, because ‘social change’ or change in general is a kind of a hot topic I’ve heard researchers mention a lot in the past five years or so, but I don’t really have any knowledge about how it’s studied and has been studied in the past. The paper by Mihelj and Stanyer both discusses how the topic has been approached in five research journals between 1951 and 2015, and suggests an approach for future use, so in a way it’s a rather nifty study to come across for someone with my gap in knowledge. We can say that this article gave me more information about research on media, communication and social change, but unlike the two papers I blogged about previously, it’s not something I could see myself applying to my work in the near future (just because I’m not working on a topic like this). So, it benefitted my general knowledge instead.

In the longitudinal look at research journals, Mihelj and Stanyer discovered two main approaches to theorizing social change (which could both also appear in the same study): media/communication as an agent of social change, and media/communication as an environment for social change. These approaches also had several subcategories; examples for the latter approach are transnationalization, commercialization and democratization. The paper identifies key differences between the two approaches – for example, the focus on micro-changes that affect individuals for the former, and changes on the macrolevel that may take decades or even centuries to complete for the latter.

What the two approaches have in common is that they privilege outcomes instead of processes – hence the authors’ interest in introducing a processual approach and typology. Basically, this approach perceives society as a process and change as natural, and suggests that any order or structures that exist are temporary and by-products of change. So, instead of highlighting the outcomes of structural changes, for example, the process of how this happens has received less attention. Mihelj and Stanyer point out that research that focuses on outcomes can’t help but become outdated quickly; in contrast, focus on processes especially in the contemporary unpredictable, complex changes, as I understand it, would produce information and discussions that can be continued and applied for a long time to come. The paper also suggests a focus on examining gradual shifts over a long period.

To someone reading about these approaches for the first time, even just the longitudinal (decades or even centuries long) research sounds very ambitious and overwhelming, although I’m aware that such tasks have been undertaken by many throughout history. Most of my studies have sought to examine closely rather specific and in-the-moment phenomena, although of course they connect to a larger picture, culture, society and a history of developments. I just haven’t explored those developments too much because I haven’t approached those topics from the viewpoint of social change. The shift to focusing on processes sounds intriguing to me. I can’t straight away imagine what the concrete steps and tools would be for doing this kind of research; how to identify the ways in which causes of change interact and combine to create change over time. This isn’t something that I need to figure out right now, either, but is certainly food for thought, and who knows, might influence the way in which I perceive phenomena – as something constantly in-process, which also goes along with the perception of how, for example, aspects of identity are continuously negotiated and (re)constructed in discourse. It’s interesting how papers that don’t seem to immediately benefit my own work still manage to poke my brain.

Method readings: Multimodal discourse analysis

Posted on January 17, 2020 by Sari Piittinen

A recent reading on research methodology that has turned out to be rather impactful to me is Norris’s new book, Systematically Working With Multimodal Data: Research Methods in Multimodal Discourse Analysis, published just 2019. For a good while now, I’ve been trying to find a toolkit for making sense of how meanings are communicated on videos – a systematic toolkit that would help me deal with the overwhelming material that one video can contain. While first reading it, I had somewhat mixed feelings about multimodal discourse analysis (MDA). On one hand, it was intimidating to read about the level of detail in transcription that noted someone’s hand going up and down three times when they scratched their nose – that is, I’m not sure whether the level of detail that MDA goes into in transcribing lower-level mediated actions (‘a mode’s smallest pragmatic meaning unit’) is what I’m looking for in my research. On the other hand, now that I know of such a systematic and detailed way of transcribing and noting actions in videos, it seems impossible not to want to use it for absolutely everything (although perhaps combined with some other approach). And it does help that MDA guides you to focus on multimodally transcribing only the parts that are relevant to answering your research question, since it would take too much time and might even be counter productive to transcribe the whole video. The book specifically warns you not to start immediately transcribing (especially speech because this puts the focus on spoken language), but to first to take notes, get an overall understanding of the present higher-level mediated actions (for example, Skyping is one), and then decide which parts are relevant for a detailed micro analysis.

The step-by-step guidelines offered by the book are clear and helpful, but also a bit overwhelming initially, since when the process is broken down to pieces, it seems there are endless steps to the analysis. Once one actually starts doing it, it may not turn out to be that bad, especially after some experience and having figured out, for example, which programs to use for transcription.

I’m almost certain that I’ll end up making use of MDA as suggested by Norris sooner or later; I’ve included it as part of the methodology in my recent chapter proposals and funding applications because although MDA alone doesn’t seem enough to answer the questions I aim to answer, it seems such a valuable tool for working with video data.