Common thematic analysis pitfalls – and how to avoid them

If you’re a qualitative researcher, you will be familiar with Braun and Clarke’s reflexive thematic analysis (RTA). Originally outlined in their 2006 methodological paper “Using thematic analysis in psychology”, it is probably the most common ‘first foray’ into qualitative research for psychologists. Since 2006, Braun and Clarke have refined and reworked their 6-step method, producing papers, books, YouTube videos (from both Clarke and Braun) and an entire website dedicated to supporting the conduct of quality RTA.

Despite this clear and helpful guidance, we regularly come across a handful of common errors in the conduct and write-up of RTA studies here at PGPR.

1. Themes do not emerge!

If you’ve ever used the term “the themes that emerged…” or similar in your RTA study, you’re in good company – it’s an error so commonly commented on that it’s spawned its own meme.

Pin badge (now discontinued, sadly) designed by Dr Heidi R Green, “Science On A Postcard”

But why does this seemingly innocent phrase cause so much uproar in the RTA community? It comes down to its positivist implications: saying that the themes emerged, were identified, or even were found in the data, suggests that, if we look hard enough, we can find objective themes which truly exist, regardless of the researcher’s analytic process.

Themes, in an RTA sense, are not real – they are constructed through the analytic process. Braun and Clarke, true to form, say it best: “In reflexive TA, themes are generated, created or constructed (for example), they are not identified, found or discovered, and they definitely don’t just ‘emerge’ from data like a fully-grown Venus arising from the sea and arriving at the shore in Botticelli’s famous painting” (Braun & Clarke, 2022). Is this semantic pedantry? Some might argue that it is, but this edict has become the shibboleth by which seasoned RTAers recognise whether or not their students have familiarised themselves with Braun and Clarke beyond 2006!

2. So where do themes come from..?

They are developed! You won’t know what your themes will be until you’ve engaged in the analytic process, so none of this “we expect the themes to be…” nonsense in your introduction, please. Depending on your research aims and specific approach (inductive, deductive – RTA is delightfully flexible), you may have specific areas of the data you want to focus on, but try to also allow for unexpected insights. And definitely steer clear of topic summaries as theme names – a theme named “how patients use online patient portals” doesn’t tell an interpretative story (and probably doesn’t go much beyond the initially stated research aim). But theme names such as “taking ownership of my healthcare” communicates a core message – a message that cannot be conceptualized prior to analysis.

To put it simply: themes come from a combination of the data, the analytic process, the sociocultural context in which the data was collected and analysed, and the specific context that you, as the analyst, bring to the analytic process. If, for example, Johanna and I were to analyse the same set of transcripts, we would very likely construct a different set of themes. If we were to analyse the data together, a third distinct set of themes would probably be developed. And that is because…

3. You are a tool of the analytic process

…not a contaminant to be contained. Again, this comes down to a question of philosophical frameworks – RTA is not constructed on a bedrock of positivist paradigms.

Photo by Lachlan Donald on Unsplash

Unlike in much quantitative research, the aim of RTA is not to control for or eliminate researcher bias – the reflexive aspect of RTA acknowledges that the researcher plays an active role in developing themes. As the analyst, your position, context, and yes, bias, bring something unique to the analytic process – so own it, don’t deny it. Engage reflexively throughout the analytic process to explain how and why you developed the themes as you did. This can be done as a group process, with multiple coders or analysts, but not in an effort to “control for bias”. Inter-rater reliability has no place here.

4. Leave the concept of saturation to the grounded theorists

In a similar vein to “inter-rater reliability”, we all too often read references to saturation in RTA studies. I wonder if this is in an effort to appease positivist editors or supervisors, or a desperate bid to cling to something concrete to guide sample sizes. You might be showing your positivist hand if you insist that “interviews will be conducted until data saturation is reached”. The concept of saturation is that there comes a point after which “no new information” is produced by further interviews (or focus groups, or whatever mode of data collection is being undertaken). This makes sense in a grounded theory study, where the analyst is interested in finding the solution to a specific problem and will use theoretical sampling to simultaneously collect data as they analyse, thus allowing them to narrow down further and further towards an understanding of their new theory.

However, in RTA, Braun and Clarke have been pretty clear on the topic: “…when it comes to reflexive TA, data saturation is not a particularly useful, or indeed theoretically coherent, concept” (Braun & Clarke, 2019). The more data you collect, the more possibilities for interpretation arise – the themes you develop after 10 interviews may look very different from the themes you might have developed if you conducted 20 interviews. You’ll just have to make a pragmatic, interpretative judgement (and possibly be guided by Braun & Clarke’s Thematic Analysis FAQ). Try to be comfortable with the uncertainty.

5. There isn’t just one approach to Thematic Analysis

…although you’d be forgiven for thinking so. Braun and Clarke’s 2006 methodological paper “Using thematic analysis in psychology” has several hundred thousand citations now, and their approach is used across a broad range of disciplines. However, theirs is not the only way, even if it is my favourite – clearly, I’m not alone in this! There are other modes of thematic analysis, some of which have more neo-positivist roots. Thematic analysis’ multiplicity is part of the reason why, post-2006, Braun and Clarke chose to differentiate by naming their method reflexive thematic analysis.

If you are undertaking an RTA study, be explicit about this by naming it as such – and try to cite sources beyond that 2006 paper, to demonstrate your reflexive chops. And don’t forget: be reflexive!

If you want help ensuring that your RTA is working as well as it can, just get in touch with us via the box below. We’ll be happy to help.

Brilliant resources for qualitative postgrad students

Despite their growing popularity, using qualitative methods as a postgrad student can be lonely. Perhaps you’re the only person using IPA in your department, or your supervisor doesn’t know the difference between classical and constructivist grounded theory.

Whether you’re feeling alone or just want more networks and resources to help you on your qualitative journey, the list of resources below will likely be helpful. Check it out!

Research is much easier with friends to help you out.

Photo by krakenimages on Unsplash

Interpretative phenomenological analysis

• The IPA groups.io forum is a fantastic place to chat with other students and academics using IPA. Sign up here to send and reply to emails from other group members. You can ask questions or help others with the dilemmas facing them. Forum regulars include many of the big names of IPA, including Jonathan Smith, Michael Larkin, Richard de Visser, Elena Gil-Rodriguez (more on her shortly!) and yours truly.

• Dr Elena GR, who I have mentioned above, runs online workshops designed to help IPA students. Her courses can help you with interviewing, analysis and situating your findings within the literature. You can book her workshops via her website, which is also a fab resource for all things IPA.

• Additionally, these are some of the best books and papers you can read to help you on your IPA journey. The original Smith, Flowers, and Larkin Bible has a new edition; check it out here. Smith and Nizza have written a fantastic short book on IPA Essentials. This paper from Smith and colleagues lays out how to produce excellent IPA, and this paper from Farr and Nizza reviews longitudinal IPA.

• Finally, the official IPA website from Birkbeck University, where Jonathan Smith teaches, includes any upcoming IPA events, exemplar papers and regional/international contacts for IPA discussions and networking.

Joining the IPA online forum can be very useful.

Photo by Chris Montgomery on Unsplash

Thematic analysis

• The best place for any TA student to start is with papers from Braun and Clarke, whose seminal 2006 paper on the methodology has, at the time of writing, been cited an incredible 22,3418 times! The pair have written many papers which are also essential reading for TA students since, particularly the paper which defines reflexive TA (RTA).

• Braun and Clarke have also recently written a paper offering useful reporting guidelines for anyone using RTA.

• If you’re struggling to understand the difference between thematic analysis and IPA, check out this paper I wrote with my colleague Ruth Riley in 2019.

Qualitative students have a lot of reading to do!

Photo by David Iskander on Unsplash

Grounded theory

• Whether you’re brand new to Grounded Theory or are mid-way through your project, do yourself a favour and get connected with Grounded Theory Online. Helen Scott and Tom Andrews, both GT experts, run excellent online troubleshooting and coffee morning sessions via the site. You can also book 1-2-1 mentoring sessions via this site. I was mentored by Helen whilst completing a GT study and can highly recommend her help.

• There’s an absolute wealth of writing about GT out there. Which books and papers you look at will largely depend on which of the GT variations you decide to use, but some great starting points are the Discovery of Grounded Theory by Glaser and Strauss, Constructing Grounded Theory by Kathy Charmaz and Doing Grounded Theory by UWE Flick.

Finding the right mentor can be beneficial.

Photo by Christina @ wocintechchat.com on Unsplash

General resources for qualitative students

• SAGE research methods. This is a huge site that contains examples of worked qualitative methods, including IPA, TA, GT, and discursive psychology, as well as sections on how methods are related and how to plan your project.

• ResearchGate and Academia are social networking sites for academics, where you can upload your papers, search for other people’s papers and message people whose work you admire. LinkedIn is also a handy social media site for connecting with other academics.

• The Qualitative Research in Education Facebook group is an active and friendly community that is well worth signing up for.

 

Here at PGPR, we offer feedback to students using IPA, TA, GT, and other qualitative methods. Just get in touch using the contact box below if you’d like to book our services.