Use this page to learn about what qualitative data is and how to analyse it.
Depending on what type of data collection method you’ve used in your evaluation work, you’ll then need to analyse it using either qualitative or quantitative data.
Qualitative data is data that is not numerical. It may include:
- open-ended responses to questionnaires
- data from interviews or focus groups
- creative responses such as photographs, pictures or videos.
Analysing qualitative data will:
- contribute to findings on changes that individuals or organisations have experienced
- help you to understand how the work you have done has contributed to this change
- help you answer questions such as have we achieved our intended outcomes, or have we reached the individuals we wanted to reach.
Analysing qualitative data involves finding patterns and themes in the data you have collected for your evaluation. Analysing your data will help you report on it effectively and use it to make decisions.
There are two basic ways of analysing qualitative data that we’re going to talk more about:
- Code and count approach
- Theme and explore approach
Code and count approach
This involves coming up with a system to put your data into different categories (coding your data) and counting how many responses are in each category. You can then use quantitative methods to analyse the data.
The code and count approach is often used to organise and analyse data from open-ended questions in surveys or when you have data that can be easily separated into distinct categories
Read more about using quantitative methods to analyse data.
Things to consider when using code and count
- This approach is helpful when you want to understand how many people gave a particular response.
- It is good for larger sample sizes.
- Depending on your sample size, you may not be able to generalise from the data you have collected.
- Keep in mind that how often something is mentioned may not be an indicator of its importance.
Theme and explore approach
This uses themes rather than codes. You review your data to see what main themes come up and then explore the different responses around each of these.
Things to consider when using theme and explore
- This approach is good for smaller sample sizes and more complex subjects.
- You can select key quotations to illustrate the themes you have found.
- It is particularly helpful when you want to compare respondents’ different understandings of the same issue.
- This approach can help you develop findings around how your work has contributed to the changes experienced by individuals or organisations you have worked with.
Once you have decided which approach you are taking, you can generate the codes or themes you will use to analyse your data.
Code and count
A ‘code’ is made up of three parts:
- The code itself – a number or letter that represents the code
- The category it represents
- What is included or excluded
The following example is a set of codes that were used to analyse data from interviews about why people moved into a care home.
Your codes should be clear and unambiguous. Ideally two people would code the same responses in the same ways.
Codes can be descriptive, analytical or both. The example codes for the care home interviews are descriptive. They categorise what people say, without reading between the lines. Analytical codes allow you to categorise how people say things. They might be as simple as coding ‘positive’ and ‘negative’ statements about an issue or event. Alternatively, they might be more complex interpretations.
You can decide your codes in advance (pre-coding), or decide on them once you have looked at your data (emergent coding), or use a combination of the two.
- Pre-coding is helpful if you know which answers you are likely to get. The outcomes and indicators in your evaluation framework may provide you with some pre-made codes.
- Emergent coding is helpful if you're unsure of what your data will say. Start by reading through 10-15% of your responses and deciding on a draft set of codes. Use these to code your responses and check if you need to change your codes after looking at a further 10-15% of responses. Remember to re-code the data you’ve already looked at.
Theme and explore
A theme is also a category but may not have such rigid inclusion and exclusion criteria. Themes are usually decided on after having read most or all responses. Then you can decide which themes best fit the data and what you want to understand from it.
For example, if you had interviewed people about their attitudes to food and read through your data, you might find the following themes emerging:
- Food as fuel
- Food as pleasure
- Moral aspects to food (‘good’ vs ‘naughty’)
- Emotional aspects such as comfort eating or expressing love through food
You can now use your codes or themes to sort your data before summarising what it says. The way you categorise your data depends on how much you have and what software is available to you.
- By hand: This is possible with a small amount of paper-based data and a small number of codes or themes. Read through your data and make a note of the codes or themes in the margin. You can then cut the transcripts and paste them onto larger sheets of paper, one for each code or theme. You may also want to highlight data in different colours.
- Using word processing software: If your data is in Microsoft Word, Google Documents or an equivalent, you can use a similar approach to paper-based data. Use the comments feature to make notes in the margin, or copy and paste sections of your transcripts into a new document under each code or theme.
- Using a spreadsheet: If you have a survey dataset that you can export to a spreadsheet, you can use this to categorise your responses. If you are using code and count, create a column for each code and put a ‘1’ in the column if that code is mentioned in the survey response. You can then use the ‘sum’ formula to count how many times the code is mentioned, and the ‘filter’ function to view all the responses for a particular code.
- Using specialist data analysis software: You can use a specialist software package to analyse qualitative data. Quirkos is an affordable option if you are working with text. Atlas.ti software enables you to work with text, images, audio and video data. MAXQDA and NVivo software are the market leaders for working with both qualitative and quantitative data. These packages allow you to code data more quickly, search for codes or groups of codes, and visualise your data in graphs or charts. They are more expensive but if you analyse qualitative data regularly then you may want to invest in them. Find out more information in our guidance on choosing new software
Things to consider when categorising your data
However you categorise your data, there are some key things to remember:
- Data can be categorised into more than one code or theme but try not to do this too often.
- If you are using code and count, you will need to make notes of how often each code appears. You may want to create a table or tally chart to do this.
- Whether you are using code and count, or theme and explore, you will also need a category for ‘don’t know,’ ‘no answer’ or ‘other’ responses. If ‘other’ responses make up more than 5% of your total, consider looking at the data again to identify possible additional codes or themes – this helps make sure you’re not missing something important.
- It can be very helpful to write notes to yourself of any key points as you go through your data and make a note of any particularly interesting quotes from respondents.
Once you have categorised your data, look at it again to draw out key findings – don’t assume the data speaks for itself!
Questions that you might want to ask of your categorised data include:
- Are there any links between codes? Are some things mentioned together frequently? If so, what does this mean?
- Are there any other patterns, themes or trends?
- Are there any deviations from these patterns? How can these be explained?
- Are outcomes different for different groups of people?
- Why were some outcomes achieved, and others not achieved? How does this link to the outputs?
- How do people understand their own journey or story? What do they think has caused or affected the outcomes that they have experienced? How does this relate to your theory of change?
- What has surprised you about the data?
- What has disturbed you or challenged your assumptions?
- What do you need to find out more about?
You can write short notes or memos about each of these which will help you to construct your evaluation report.
Make sure that your analysis can be verified and that you can justify the claims that you make based on your analysis.
- Keep a paper trail including copies of your notes, your coded data, any memos that you write to yourself. If someone asks how you reached a conclusion, you should be able to talk them through the process.
- Check your analysis with others. It can be helpful to have two people code some of the data and check whether their coding matches. You can also invite others to give feedback on your interpretations. You may also wish to check your analysis with your evaluation respondents to check that you are representing them accurately and to see if you have missed anything.
- Wherever possible, check data from different sources to see if the results are the same or different (this is called ‘triangulating’). Differences in data indicate something interesting that’s worth exploring further.
- Check your own biases. Human beings are prone to looking for evidence that confirms what we already think. Write down your initial views on the data and deliberately look for evidence that disagrees with your views.
- Coding your data can result in looking at statements out of context. Check back against the rest of the data provided by a respondent (for example, the whole transcript of their interview) to make sure you haven’t misinterpreted data. This is easier to do with the theme and explore approach as you usually have less data to work with.
Now you’re ready to bring together your data analysis into a report or other presentation format. Read our guidance on writing an evaluation report.