1. Output information
|Frequency||As and when data are available|
|How compiled||Based on third party data|
|Geographic coverage||United Kingdom (UK)|
2. About this Quality and Methodology Information report
This quality and methodology report contains information on the quality characteristics of the data (including the European Statistical System five dimensions of quality) as well as the methods used to create it.
The information in this report will help you to:
understand the strengths and limitations of the data
learn about existing uses and users of the data
understand the methods used to create the data
help you to decide suitable uses for the data
reduce the risk of misusing data
3. Important points
The Coronavirus and compliance with government guidance bulletins are derived from data collected during a UK qualitative research study by IFF Research from November 2020 to January 2021.
The qualitative research study was commissioned to explore certain demographic groups' compliance with the coronavirus official guidance in depth; it helps us better understand the attitudes and behaviours of these groups, and the issues they face in the pandemic.
The main research questions for the study were:
- Why do some groups comply less?
- How do different demographic groups understand the COVID-19 guidance?
- How do attitudes to compliance with COVID-19 guidance differ between demographic groups?
- Why do some groups comply less?
- What encourages or discourages compliance with COVID-19 guidance among different demographic groups?
- What barriers to compliance do different groups face?
180 adults were sampled for the study, with 30 across each of six demographic groups; the six demographic groups of interest were determined from a literature review and analysis of Opinions and Lifestyle Survey (OPN) data on compliance levels.
The six groups included in the study were:
parents with dependent children
people from an ethnic minority
Within these groups, there was a range of diversity in terms of age, gender, working status, education level, and geography (definitions for these groups can be found in Section 6). These groups were then split into non-compliant, low compliance, and high compliance in an equal 10:10:10 interview ratio.
Participant recruitment was conducted via specialist agencies, which operate their own online communities and put in place advanced searches ensuring that they can target respondents before contacting them for recruitment. In addition to this, they recruit using "free find" methods, which include blogs, online research and via community message boards.
A recruitment screener was used to ask questions on compliance status and demographic information; participants gave explicit informed consent through the screener and a consent form they completed before taking part in the interview and they were informed on the research purpose, sponsor, confidentiality, and that it was voluntary.
Each participant was invited to take part in a 90-minute in-depth interview online or via telephone.
Several approaches were used to maximise participation in the study, including:
offering flexibility in appointment times and rescheduling
sensitively discussing the topic of non-compliance
providing translation options
carefully wording recruitment materials
Participants were also thanked for their time and effort through vouchers.
Those in the young people and student groups were invited to take part in an online forum, which was open for five days during which a moderator set various tasks such as starting a conversation with friends and family members or making a note of any coronavirus-related messaging that they saw that day.
Participants from all other groups (ethnic minority participants, low-income workers, parents and high-income workers) were asked to complete an online diary (either in a Word document or an online platform) followed by a further 30-minute in-depth interview. They were asked to write down any instances when they were in public or had encountered someone from outside their household, what they did and how they felt.
The interview guide was informed by behavioural frameworks, principally COM-B1 and participants were asked about compliance capabilities and opportunities, then motivations; the interview guide remained the same for the whole period, except for new questions about the vaccine rollout, which were added on 22 December 2020.
Researchers manually transcribed and coded the interviews, diaries, and forum contributions. Coding was informed by the COM-B model. Thematic analysis was then carried out and quality assured. A steering group was established to oversee the design and implementation of the study, as well as final recommendations. The group consisted of individuals from the Office for National Statistics (ONS) research, methodological, statistical, behavioural science and qualitative experts; other government departments; the Prime Minister's Office; and academics.
There are no datasets to accompany this study because this is a qualitative study.
Notes for: Important points
- The COM-B model of behaviour is a framework used to analyse individuals' behaviour. The COM-B model proposes that behaviour is shaped by the following three components: "capability", which is an individual's own knowledge or attribute that enable a behaviour to be possible, "opportunity", which describes the qualities of an individual's physical environment that allows them to behave in a certain way, and "motivation", which is the individual's energy and desire to take a certain action.
4. Quality summary
This report relates to the standalone qualitative study: Compliance with coronavirus (COVID-19) guidance, interviewing participants in the UK from November 2020 to January 2021.
Uses and users
This qualitative research study was commissioned to explore certain demographic groups' compliance with the government coronavirus guidance across the UK in depth. This study helps us to better understand the attitudes and behaviours of these groups, and the unique issues they face in the pandemic.
Uses of the data include:
- to inform compliance-related policy
- to inform compliance-related communications
The main stakeholders are:
Scientific Advisory Group for Emergencies (SAGE)
Department for Health and Social Care (DHSC)
the Prime Minister's Office
Strengths and limitations
The main strengths of the qualitative research study include:
- It generates richer and more nuanced insight than other Office for National Statistics (ONS) surveys because it is an in-depth qualitative study.
- It meets user needs as the interview guide was developed with customer consultation and design expertise was applied in the development stages.
- It is flexible, allowing the interview to be participant-specific, with relevant prompts or probes to ensure important information is captured.
- It captures the personal circumstances of individual participants from within the main demographic groups with lower compliance; it also captures their thoughts and feelings towards compliance and any barriers they were experiencing.
The main limitations of the qualitative research study include:
- Quantification of the themes is not possible as sample size is limited to 30 participants per demographic group.
- Our findings are not statistically generalisable to other populations or the wider population because we have used a non-probabilistic sampling method - non-proportional quota sampling.
- It would also not be meaningful to compare the personal characteristics of our study population, or their levels of compliance with that of the general population (for example, through an ONS survey).
- The coronavirus (COVID-19) guidance changed throughout the fieldwork period so participants are not always talking about the same guidance as each other (particularly as fieldwork was staggered across the different demographic groups); interview guides were continuously updated to reflect the guidance at the time for the region of the participant, and the report also specifies which guidance is being referred to, where relevant.
- Findings relate to certain circumstances (for example, national lockdowns) that have since changed, and therefore behaviours may have changed.
- There is a degree of non-response bias: participants may present different attitudes and behaviours than those who are not participants because of their willingness and ability to take part (non-participants are those we either could not contact or have not contacted, and those who declined to participate or cancelled their interview).
- Because of the sample design, there is duplication of personal characteristics across each group (for example, one individual may be a student, a young person and from an ethnic minority group) and so comparisons across groups should be made with caution.
Accuracy and reliability
This is a qualitative study of 180 interviews, not quantitative. Therefore, quantification or estimates of accuracy are not possible, and not the purpose of this study. The reliability of this study can be assessed through comparing with similar research.
In terms of comparability, comparisons across groups should be treated with and carried out with caution. The reason for this is, because of the sample design, there is duplication of personal characteristics across each group.
Changes to coronavirus guidance
Comparisons cannot be made over time. The coronavirus guidance changed throughout the fieldwork period, so participants are not always talking about the same guidance as each other. In addition, fieldwork for each of the demographic groups was staggered.
During the fieldwork period, the guidance in England was as follows (there were minor differences to guidance in Scotland, Wales and Northern Ireland):
- Wash hands, avoid touching your face, wear a face covering indoors; the self-isolation period is 10 days when necessary and non-essential businesses are closed.
Other guidance changed during the fieldwork period:
At the start of the fieldwork period in November 2020, members of the public were required to stay at home, except for specific purposes, including essential activities, work that cannot be done from home, education, childcare, medical reasons or to provide care.
Guidance was to avoid meeting people you do not live with, except for specific purposes, including meeting one person outside of your household bubble for exercise or to meet in a public outdoors space.
From the 2 December 2020:
In Tier 1, guidance permitted to meet other people indoors and outdoors but socialising in groups of more than six people should be avoided.
In Tier 2, guidance permitted to meet people outdoors but not to socialise in groups of more than six people.
In Tier 3, guidance suggested avoiding meeting people who you did not live with or were not in your support bubble.
From 23 to 27 December 2020:
In Tiers 1 and 2, guidance permitted meeting in a bubble of up to three households indoors on Christmas Day, and existing support bubbles counted as one household; you could meet outdoors but should avoid socialising in groups of more than six people.
In tier 3, guidance permitted meeting in a bubble of up to three households indoors on Christmas Day and existing support bubbles counted as one household but meeting people who you did not live with or were not in your support bubble outdoors should be avoided.
In Tier 4, you should avoid meeting people who you do not live with or are not in your support bubble.
From 4 January 2021:
You should not leave home to meet socially with people you do not live with unless they are in your support bubble.
Colleges, primary and secondary schools are open only for vulnerable children and children of critical workers.
It is possible to compare across geographies, but this analysis was out of scope for this study. Participants were sampled from the four nations of the UK. The sample coverage was 90 participants from England, 36 from Scotland, 36 from Wales and 18 from Northern Ireland.
The data for the study were collected between November 2020 and January 2021. There was a three-month time lapse between the end of field work data collection and the publication of findings. During this time, transcription, analysis, quality assurance and report writing were carried out.Back to table of contents
6. Other information
Demographic group characteristics
A breakdown of the main characteristics and demographics for the 30 participants who took part in each of the six demographic groups is available to download. There was an even spread of compliance levels within each group (10 were mainly compliant, 10 were mixed and 10 were less compliant). Compliance levels were determined through a series of screener questions.
Those in the low-income workers group were defined as being someone who was working in: retail, wholesale, health and social work, transport, the arts or hospitality (for example, cafés, pubs, restaurants, hotels) and earning less than £18,000 a year, £1,250 a month or £290 a week, before tax.
Those in the students group were defined as being someone who was a student, currently studying at a UK university. The group included two mature students who lived with a partner and their children, and the remaining 28 included an even mix of those living in their family home and those living in student accommodation or with other students in private rented accommodation.
Those in the young people group were defined as being someone who was aged between 18 and 24 years.
Those in the parents group were defined as being someone who was a parent or guardian of one or more children aged under 16 years.
Ethnic minority participants
Those in the ethnic minority participants group were defined as being someone from a Black, African, Caribbean or Black British ethnic group or background; someone from an Asian or Asian British ethnic group or background; someone from a Mixed or Multiple ethnic group or background; or someone from another ethnic group or background.
Those in the high-income participants group were defined as being someone with an annual income last year of £75,000 or more, before tax.Back to table of contents
7. Concepts and definitions
(Concepts and definitions describe the legislation governing the output, and a description of the classifications used in the output.)
Coronavirus (COVID-19) specific definitions
Coronaviruses are a family of viruses that cause disease in people and animals. They can cause the common cold or more severe diseases, such as COVID-19. COVID-19 refers to the "coronavirus disease 2019" and is a disease that can affect the lungs and airways. It is caused by a type of coronavirus.
Support bubble or extended household
A support bubble is a term used in England and Northern Ireland to describe a close support network that can be formed between a household of any size and a household with either only one adult or one adult and one or more people who were under the age of 18 years on 12 June 2020 in the home (known as a single-adult household).
An "extended household" is a term used in Scotland and Wales to describe two separate households that have been able to join to form an extended household, meaning that they do not need to follow social distancing rules and can have close contact with each other.
For the purposes of this research, we use the term "support bubble" (extended household) as an umbrella term to refer to the joining of two households, as per the guidance in place for participants at the time of the interview and the country they lived in.
In England, a childcare bubble is where one household links with one other household to provide informal childcare to anyone under 14 years. A childcare bubble is different to a support bubble. Across the devolved nations, there are different rules for childcare (see guidance for Wales, Scotland and Northern Ireland).
Social distancing refers to the measures taken to prevent the spread of a contagious disease by maintaining a physical distance between people. Social distancing was introduced in March 2020 to slow the spread of the coronavirus (COVID-19) by reducing the number of times people come into close contact with each other. The general rule has been to stay two metres apart from those outside of your household, or where that is not possible, one metre with extra precautions such as wearing a face mask.
Lockdown is the shutting down of all non-essential activities to slow the spread of the coronavirus (COVID-19). The first national lockdown was introduced on 23 March 2020. There have been various national and local lockdowns applied across the devolved nations, with varying restrictions and for different time periods.
Guidance is a term which refers to advice given by the government to the public, to protect citizens from the coronavirus (COVID-19). An example of guidance is "wear a face mask". The guidance for each country of the UK is different and changed throughout the time this research was conducted. Participants in this research were asked about the guidance that was in place in the country they lived in at the time of their interview. In some cases, not adhering to specific guidance is punishable by law. This is specific to each nation's legislation.
Reference to "hands" in this study refers to the part of the "Hands, Face, Space" guidance to prevent the spread of the coronavirus (COVID-19). This advises individuals to maintain hand hygiene through regular and thorough handwashing and use of hand sanitiser.
Reference to "face" in this study refers to the part of the "Hands, Face, Space" guidance to prevent the spread of the coronavirus (COVID-19). This advises individuals to wear a face covering in all indoor public spaces (for example, supermarkets) unless exempt for medical reasons.
Reference to "space" in this study refers to the part of the "Hands, Face, Space" guidance to prevent the spread of the coronavirus (COVID-19). This advises individuals to maintain a two metre distance between themselves and anyone outside of their household and/or support bubble or extended household.
This refers to the guidance about socialising with others outside of their household and/or support bubble or extended household, to prevent the spread of the coronavirus (COVID-19). This includes how many people should meet together, and in which locations (for example, indoors and outdoors). This has changed throughout the pandemic dependent on local or national restrictions and differs across the devolved nations.
Self-isolation is a form of social distancing for people who have tested positive or have come into close contact with someone who has had a positive test for COVID-19. In these cases, individuals are required by law to self-isolate for 10 days or 14 days respectively when told to do so. This means staying at home and not having any contact with others outside of their household.
People returning from countries abroad may also be required to self-isolate for 14 days if the country they are travelling from is not on the list of exempt countries. This period of self-isolation is also sometimes called quarantine.
Quantitative research is the process of collecting and analysing numerical data. It can be used to find trends and averages, test relationships between variables, and generalise results to wider populations. For surveys, quantitative research often employs random probability sampling.
Qualitative research is the process of collecting and analysing non-numerical data, through methods such as in-depth interviews and focus groups. It is used to understand participants' beliefs, experiences, attitudes, behaviour, and interactions between them in breadth and depth. The data collected are non-numerical. It employs purposive sampling techniques; in this statistical inference is neither possible nor the intention.
Ethnography is the study of participants in their own environment, observing their behaviour or social interactions. It often uses ethnographic activities (see definition that follows).
Ethnographic activities are tasks that participants are asked to take part in for research purposes, where they are observed, recorded or asked to record details themselves. For example, observation, diaries, or online forums.
An online diary is one of the activities some of the participants were asked to take part in during this qualitative research study. Participants were asked to record their daily activities and experiences around compliance with the coronavirus (COVID-19) guidance.
An online forum is a message board and discussion site, where participants can have conversations or complete tasks set by a moderator. The conversation is posted for others to respond to, creating a dialogue or thread. A researcher moderated the forum and set daily activities, inviting participants to share their experiences of these activities. Participants could post and comment on each other's posts with the researcher moderating to keep all posts relevant and appropriate.
Screener questions are the questions asked during the recruitment process to ensure that potential participants fit the research criteria for the study and to help monitor the achievement of purposive sampling criteria targets.
A Steering group is set up to steer the work undertaken by others. The role of the steering group for this study was to advise on the development of the COVID-19 compliance study research activities conducted by the IFF and to act as a "critical friend". Their responsibilities included:
providing advice and guidance
identifying and helping mitigate risks
evaluating and prioritising the research
participating in discussions of the findings and their interpretation
guiding recommendations for further work
The group members were chosen to bring expertise from a range of different perspectives, and to ensure that advice provided was appropriate and balanced.
The coronavirus and compliance with government guidance, UK release also refers to data from the Opinion and Lifestyle Survey (OPN). For further information on this please refer to the latest OPN report or the OPN QMI.Back to table of contents
Contact details for this Methodology
Telephone: +44 (0)1633 455313