Thematic analysis with ChatGPT | PART 2- Coding qualitative data with ChatGPT

[@qualitativeresearcher]

Visit my website and explore the different ways in which I can support you and your study! drkriukow.com/my-services/

[@yenxinng7924]

I will now paste "codes" (which are analytic units used in thematic analysis) here. I would like you to assign each of these codes to one of the following groups: "challenges" (if the code name suggests that it is something negative or something that may negatively influence a person's job satisfaction), "positive factors, coping strategies and positive experiences" (if the code name suggests that it is something in any way positive and may positively influence a person's job satisfaction), and "other" (for codes that do not match any of the initial two groups). Here are all codes, it is very important that you assign each and every one of these codes to the above-mentioned groups:

[@qualitativeresearcher]

thank you, you're a hero :)

[@yasmingatie3466]

Thank you Dr. for this. Before watching your video, I tried the sorting of codes through ChatGPT and I had luck with this prompt: You are a researcher. 7 interviews were conducted, and from each interview, codes were derived. A total of 125 codes were gathered. You need to group these codes into categories or themes of similar context. Use all the codes. Codes that fall into multiple themes, choose the best theme that it fits. Don't use codes more than once. Any codes that don't fit the categories or themes made, group them separately into 'ungrouped themes". Reference the interview and code number under each theme. Here are the codes: Very minor mistakes but it was great start for sure.

[@qualitativeresearcher]

Brilliant, thank you ! Glad that it managed, it seems like it depends on a day whether it will be very accurate or completely wrong , lol :) But I will give it a try!

[@pocketmoneyrecords]

I used NVivo to code interviews for my thesis, and ChatGPT to compare the results. ChatGPT is so good at this, thanks to your prompts. Obviously, ChatGPT misses some things, but other things that I didn't code were correctly coded by it. Fantastic assisting tool. I ordered all my codes in NVivo yesterday and was wondering how to do it on ChatGPT, and your video came right on time! Thanks

[@qualitativeresearcher]

Glad I could help, and yes this sounds like a nice tool to validate our own analysis (although I am still not 100% of the ethics of this in terms of data protection etc)

[@pocketmoneyrecords]

​@@qualitativeresearcher If you remove the identity of the subjects (people and organizations for example) under study before copy pasting interviews in chatGPT it should be fine? e.g. replacing the names with "person1" to "personN" (for N amount of people), and the same for organizations

[@nirmakhan6433]

Please give me part 3

[@nirmakhan6433]

Qualitative data analysis chat gpt part 3 . Please give me kindly

[@nazishislam]

How did you compare the codes in gpt and visualize the results in your thesis? Please help. I did coding in Nvivo but it's too much that I am confused now.

[@joatkhalid5974]

Thank you so much. This was very helpful and now with the new updates in chatgpt, it is even better.

[@qualitativeresearcher]

Great to hear! and yes, some of the options that used to be premium are now available to everyone

[@AsselStambekova]

Interesting! Thanks for posting part 2. I'm curious how chatgpt will analyse textual data which isn't that straightforward to code as it was in your research questions. I mean that "Positive, challenges, personal, external" are quite straightforward. I've tried to analyse my data with chatgpt to see whether it would match my coding decisions. Surprisingly, 80% of its codes were close to theory-driven codes, with some repetitions though.

[@qualitativeresearcher]

I believe it would do pretty well. Mine were admittedly a pretty simple dataset for the purpose of this video, but with more complex ones I actually expect it to be even better - it is more challenging to extract something from short interviews like these. And regarding codes and themes, it will depend, but I always prefer relatively straightforward themes rather than, for example, highly abstract theoretical concepts - in case of the latter, it could be more challenging to align my own coding with that of ChatGPT. There's definitely a long way, but it is still truly amazing what this tool can do. There are also many other ones, I will be reviewing another tool (this one specifically designed to do qual data analysis) in my next video

[@tixli8327]

Thank you so much for sharing this idea on how to use GPT. I think you really want to share the core thinking model for using AI-based tool for analysis, instead of the really simple way for only introducing how to do with the analysis. I love the way and steps to more a clear and academic codes and themes.

[@qualitativeresearcher]

Glad it was helpful!

[@kalyanipawar6547]

Thankyou for the video! How to form themes from these groups/sub-groups? Is there any video you recommend me to watch to understand it better?

[@qualitativeresearcher]

yes, I have a series called "from codes to themes" where I discuss the whole process. Not in ChatGPT specifically, but what I discuss there can be applied here

[@doricangelenge6807]

Hi. Instead of copying pasting each code (to separate from the quotes), I applied Heading 1 to the codes, made a table of contents, copied the table of contents an pasted onto a new sheet using the 'Keep text only' paste function so as to get rid of the hyperlinks. I was dealing with quiet a number of codes, so pasting them all individually was going to drain me of my much needed umph. LOL Thanks for the lesson.

[@qualitativeresearcher]

Love it! Yes, your way is much better than what I did here. I do have a newer version of this video (either the most or one of the most recent uploads), where I feel that I improved the process a little bit :)

[@doricangelenge6807]

@@qualitativeresearcher Oh lovely!! I'll watch it and improve my knowledge base!! Thanks for your time.

[@ayses3851]

Interesting use of chatgpt

[@素芬一分钟说基金]

Tq so much for your video. I’m wondering if I will need to cite ChatGPT in my methodology? Many thanks.

[@qualitativeresearcher]

This is still a difficult question, as I feel that many academics are still pretty sceptical of ChatGPT, so do it but at your own risk :)

[@素芬一分钟说基金]

@@qualitativeresearcherTq so much. Between I’ve just bought your course on “how to analyse qualitative data” and “from zero to nvivo-version 2020”. So excited to start 😂

[@Pdog439]

So good! Are you willing to share the documents with the prompts? If you did, I missed them. Thank you!

[@qualitativeresearcher]

it's been a while since I recorded this, so not sure but here are some prompts I could find: Prompt 1 You are a researcher. I will now upload an interview transcript, and you will do what is called qualitative coding - specifically, initial coding also known as open coding. The text is an interview transcript, I do not want you to code the questions asked by the interviewer. I want the codes to be detailed and descriptive. I want you to apply codes to sentences or parts of sentences, and later when you develop a list of codes, I want you to be able to tell me what sentences or parts of sentences these codes were applied to. In other words, when I ask you to provide me example quotes for the codes that you create, I would like you to be able to do it. Here is the text to be coded: Prompt 2 Please develop more detailed codes. I would also like the codes to be a bit more descriptive, and please separately list quotes that show all sentences or parts of sentences coded with each code Prompt 3 You are a researcher. I will now upload an interview transcript, and you will do what is called qualitative coding - specifically, initial coding also known as open coding. The text is an interview transcript, I do not want you to code the questions asked by the interviewer. I want the codes to be detailed and descriptive. I want you to apply codes to sentences or parts of sentences, and later when you develop a list of codes, I want you to be able to tell me what sentences or parts of sentences these codes were applied to. In other words, when I ask you to provide me example quotes for the codes that you create, I would like you to be able to do it. Here is the text to be coded. I want you to use exactly the same approach and the same format as you did above Prompt 4 Please show me all quotes - in other words, I would like to see each code and below each sentence that was coded with this code Prompt 5 (organizing initial codes into focused codes) I will now paste "codes" (which are analytic units used in thematic analysis) here. I would like you to assign each of these codes to one of the following groups: "challenges" (if the code name suggests that it is something negative or something that may negatively influence a person's job satisfaction), "positive factors, coping strategies and positive experiences" (if the code name suggests that it is something in any way positive and may positively influence a person's job satisfaction), and "other" (for codes that do not match any of the initial two groups). Here are all codes, it is very important that you assign each and every one of these codes to the above-mentioned groups: Prompt 6 (optional - for developing themes) you are a researcher. You are trying conducting thematic analysis to develop several main themes, and several sub-themes which will help answer the research question: "What are factors/practices/experiences that may negatively affect job satisfaction and what are factors/practices/experiences that may positively influence job satisfaction?" I would like you to try to develop themes and sub-themes based on the following codes that have been grouped into 3 groups. You can develop themes that are less descriptive and more abstract that these codes, and a theme may be created by combining several codes and generalizing about what they have in common (but if you merge several codes to create a theme, I would like you to indicate in brackets the names of the original codes that this theme involves). Here are the codes which you will turn into themes and sub-themes:

[@qualitativeresearcher]

thing is, chatGPT is so random, it may sometimes do these well and on another day it will struggle with following this. You really need to be careful and monitor everything it does. I recently asked it to translate a story I wrote for a children's book (in Polish), using a literary style of children's book - it did an absolute amazing job for most part, but then it just decided to randomly add a chapter "based on the context" that was not even in that story. It's a weird little tool :)

[@peterfazekas7213]

Very interesting, thanks for sharing these videos! I only have one question left. How should I start writing about the analysis? I'm not good at academic writing and I can't talk much about my researches, (tbh I feel it's unnecessary to talk so much about something I could tell you in half a page).

[@qualitativeresearcher]

I do have 2 videos on this topic, hope they will be helpful!

[@peterfazekas7213]

@@qualitativeresearcher Thank you, I'm new to your content, so haven't seen them yet. I'll make sure to check them!

[@drswapnajeetsahoo4891]

@@qualitativeresearcher can you mention the link here

[@rabiakhan2164]

I have to do coding of 20 transcription so it's helpful while doing other course work. The question I want to ask that If whole class use Chatgpt for coding then there codes would b same on same project so themes would be the same?

[@qualitativeresearcher]

most likely not, as ChatGPT does not have this sort of consistency. Having said this, there may be similarities of course

[@davidishola240]

Please how do we end up with the themes, using ChatGpt?

[@ardakkanmaz]

Thank you for posting! Sir also you promised Part 3 for today (Parts 2 and 3 of the video coming on Sunday)

[@qualitativeresearcher]

This is Part 2 and 3

[@mansoorahmad120]

Thank you sir, how themes will be derived after grouping codes. Kinsly upload part 3. I am eagerly waiting.

[@qualitativeresearcher]

I kind of explained why there is no part 3. I have separate videos (e.g. a series called "from codes to themes" ) in which I walk you through the process and explainhow themes are developed, hope this helps!

[@ruphinao7231]

Which ChatGPT software are you using?

[@qualitativeresearcher]

chat gpt 4 was used in this video, I believe

[@annamarijaskudra5018]

God bless you good man

[@qualitativeresearcher]

Thank you!

[@RB_Insights]

By “groups” do you means “categories” of the qualitative analysis?

[@qualitativeresearcher]

there are many terms for the same concepts. I am not talking about the final outcome, where you can call them categories or themes, sub-themes or codes, etc, depending on the approach you are using. I am simply talking about grouping codes, hence the word groups

[@atulhadap2176]

Fantastic

[@qualitativeresearcher]

Thank you so much 😀

[@joeglover8167]

how many interviews would you do before bringing all your data together with the focussed codes

[@qualitativeresearcher]

a good question Joe, and one to which there is no one straightforward response - as is often the case in qual research :) Namely, when you feel that you have lots of codes and it is becoming a bit overwhelming, that's probably a good time. Nobody said you cannot do All transcripts before moving to stage 2, as I do pretty often too. But this is if I have around 10 maybe. Of course if I had 30, I would prefer to organize them before continuing. So the answer is, it is up to you but you do need to generate a fair amount of codes before doing that

[@joeglover8167]

@@qualitativeresearcher Thanks for this, I am currently doing my MSc dissertation, and I am doing interviews on different days so I kind of have to do a few at a time. Found this guide really helpful, and so far it has saved me lots of time. Any other tips at all for this kind of study?

[@enrite]

Thank you for the tutorial and for sharing your brilliant ideas. I was wondering if ChatGPT applied/detected similar codes across both interviews. After all, we are interested to see how many times the same code appears throughout the data.

[@qualitativeresearcher]

There will be similarities, but I believe a lot of human input is needed too. I would never recommend using this as the primary tool for data analysis, more so for bouncing some ideas off it or comparing how "it" sees things compared to our own ideas

[@enrite]

@@qualitativeresearcher my thoughts exactly. I have done all the coding in NVivo. I just wanted to see what codes/themes chatgpt will produce. I was surprised to find out that three themes identified by chatgpt coincided in wording with the ones I came up with. I felt reassured in a way that there are two of us now who think alike 😂

[@austinefeak3794]

@@enrite in the end, A.I/ChatGPT is just a representation trained on the human mind. So, it's outputs would always be representative of the majority which it was trained on.

[@sonofpeace1930]

Thanks for this tutorial you're so amazing

[@qualitativeresearcher]

Glad it was helpful!

[@maha3287]

What are the world's I normally I need to begin my discussion with got with to invite him to make the codes for me.

[@michellemora5959]

Hi Sir, would like to see Prompt 6 for developing themes. Thank you!

[@qualitativeresearcher]

it gets tricky with this. You will need to experiment, there is another comment under this video where a subscriber shared some of her prompts

[@mariasch7351]

Thank you! :)

[@palashjyotiborah9888]

voice could be louder. but thanks for the wonderful video.

[@fritzhutabarat846]

Have you tried asking chat gpt to do the thematic analysis for you entirely?

[@qualitativeresearcher]

I would never trust it to do such complex task to be honest :)