1. Executive summary October to December 2016

Summary of achieved sample size

The achieved sample size for the UK Labour Force Survey (LFS) during October to December 2016 (OD16) was 88,406 individuals in 37,342 households. Please note that there were no NHS households in this period. Compared with the previous quarter July to September 2016 (JS16) this represents a decrease of 0.2% in household interviews and a decrease of 0.1% in achieved person interviews.

Summary of response rates

Please note that historical reports can be accessed on the ONS website.

In OD16 main response rates were as follows:

  • the total response rate for Great Britain excluding imputed cases (Table 4.1) was 42%; this is up 0.5 percentage points on the previous quarter

  • the response rate excluding imputed cases (Fig 4.2) was 54.9% in wave 1 and 36.8% in wave 5; this compares with 54.8% and 36.8% respectively in the previous quarter

  • the total response rate for Great Britain including imputed cases (Table 4.3) was 49%, down 0.4 percentage points on the previous quarter

  • of non-response in OD16 (Fig 4.4), non-contacts comprised 16.4%, circumstantial refusals were 11.9%, (up 0.2 percentage points), outright refusals comprised 53.1% (down 0.1 percentage points on the previous quarter) and other refusals comprised the remainder

  • the region with the highest accumulated response rate across the 5 waves (Table 4.7, page 8) was “Rest of Yorkshire and Humberside” (53.6%); the lowest was “Outer London” (44.6%)

  • the overall proxy response rate (Table 4.8) is 33.8%; the highest proxy response rates occur in the 16 to 17 age group (88%), in males (38.5%) and in the non-white ethnicity group (42.7%)

  • the average income response rate (Table 4.9) was 86%

  • the data on attrition rates are shown in Table 4.10; these data reveal in percentage change terms that those who drop out of the survey between waves 1 and 5, tend to be distributed fairly evenly by main characteristics, but are over-represented in the 20 to 29 age bands, in households with 6 or more people and amongst those living in Inner London

Note:

Methodological changes in January to March 2011 (JM11) and July to September 2010 (JS10) have impacted response rates. From JM11 a proportion of initial interviews have been conducted by the telephone unit rather than face-to-face as an efficiency measure. Telephone interviews generally have higher levels of non-response. The removal of households with residents aged 75 and older after their initial interview from JS10 also impacts response as these households generally have high response rates. See the 'Questionnaire changes' section for more detail.

Questionnaire changes

Changes to State Pension age were introduced in 2010, which affected labour market and LFS publications, as well as other social surveys. Under the Pensions Act 2011, women's State Pension age will increase more quickly (than originally planned) to 65 between April 2016 and November 2018. From December 2018, the State Pension age for both men and women will start to increase to reach 66 by October 2020.

From JS10, households that only contain respondents aged 75 and older are removed from the sample after their wave 1 interview. This change was introduced to reduce the cost of the survey and reduce the burden on respondents. Households only containing individuals aged 75 or older are largely economically inactive and therefore the value of interviewing these households is greatly reduced when considering the main aims of the LFS. The wave 1 interviews from 75 and older households will receive a larger weight to make them representative of the UK population. This change results in around a 10% reduction in the household sample size and a 7% reduction in the individual sample size.

From JS10, the treatment of “concealed multi-households” on the LFS has also changed. Previously if one sampled address turned out on inspection to be, for example, not one house but 6 flats, all 6 flats would be recorded as households and interviews would be attempted with each household. The number of households encountered could be in the hundreds. This was not a practical approach. We decided to harmonise the approach to multi-households across all our social surveys. From JS10, if a concealed multi-household is recorded only one household will be randomly selected to be interviewed.

Following a pilot run in JS10, from JM11 onwards a proportion of wave 1 cases (around 15 to 20%) have been interviewed by the Telephone Unit (TU) as opposed to the traditional face-to-face method (FtF). Sampled addresses are matched to telephone numbers in order to do this. Potential concerns associated with this approach are twofold; that response rates will fall as sampled respondents may be more likely to refuse a telephone survey and that mode effects may be observed in the data collected. This situation will be monitored.

Details of fieldwork issues and new, amended and deleted questions can be found in Section 7.

Back to table of contents

2. Summary of quality

2.1 Relevance

The degree to which the statistical product meets user needs for both coverage and content.

Primary purpose

The primary purpose of the Labour Force Survey (LFS) is "the prompt publication of key aggregate, whole economy, indicators, for the integrated assessment of labour market conditions" (Review of the Labour Force Survey, ONS, 2002). The “labour market” covers all aspects of people's work, including the education and training needed to equip them for work, the jobs themselves, job-search for those out of work and income from work and benefits.

Users and uses

Users of LFS data often combine it with related data from other sources to provide an overall view of the state of the labour market. One of the most important users of this sort of assessment is the Bank of England's Monetary Policy Committee, which sets interest rates in order to meet the government's inflation target.

Other important users of LFS data are HM Treasury and the Department for Work and Pensions, because they are responsible for UK economic and labour market policy. They are interested in a variety of indicators of the state of the labour market, including the number of people in employment, the number of hours worked and the number of unemployed people (defined according to the International Labour Organisation - ILO). They often analyse these series by age groups, by regions and by sex. Other government users include the Department for Business, Energy and Industrial Strategy (BEIS), the Home Office, the Health and Safety Executive, the Scottish government, and the Welsh government.

At the international level, LFS data are used by the European Parliament, Council and Commission, the European Central Bank and DG Employment (Directorate-General for Employment, Social Affairs and Equal Opportunities). It is also used by the Organisation for Economic Co-operation and Development (OECD) and the International Labour Organisation.

Other users include local authorities, the Trades Union Congress (TUC), the Employer's Association, the Confederation of British Industry, the Institute of Employment Studies, the Institute for Public Policy Research, the National Institute of Economic and Social Research, the Policy Studies Institute, the Institute for Fiscal Studies, academic researchers, the media and the general public.

Strengths and limitations

The strengths of the LFS are that it has the largest coverage of any household survey in the UK and can thus generate statistics for small geographical areas. In addition, the sampling errors are relatively small, as a result of the wave structure and the size of the survey. The survey covers a large range of employment-related variables and non-employment-related variables, allowing cross-linking analyses to be undertaken (for example, earnings against educational attainment).

One of the limitations of the LFS is that the sample design provides no guarantee of adequate coverage of any industry, as the survey is not industrially stratified. The LFS coverage also omits communal establishments, except NHS housing, students in halls of residence and at boarding schools. Members of the armed forces are only included if they live in private accommodation. Also, workers under 16 are not covered.

Main definitions

The definitions of the 3 economic activity groups - employed, unemployed and economically inactive - that are used in the LFS are the standard International Labour Organisation (ILO) definitions. It should be noted that although the LFS uses ILO definitions, these definitions are not interpreted and applied in exactly the same way in different countries. For example, although “working age” is a common term, different countries have different statutory school leaving and retirement ages. However, Eurostat collects data from member states and adjusts them to produce comparable estimates.

2.2 Summary of quality

The closeness between an estimated result and the (unknown) true value.

The main threats to accuracy are sources of error, namely sampling error and non-sampling error, where non-sampling error includes: coverage error, non-response error, measurement error, processing error and model assumption error.

Many of the sources of non-sampling error are difficult to measure. However, the LFS publishes detailed response rates for all waves of the survey and an overall response rate, including time-series (Tables 4.1 to 4.6). Response rates are also published by government region for each wave during the particular quarter (Table 4.7). The LFS also publishes proxy response rates (Table 4.8), response rates for income questions by National Statistics (NS) Socio-Economic Classification (Table 4.9) and attrition rates (Table 4.10).

Surveys, such as the LFS, provide estimates of population characteristics rather than exact measures. In principle, many random samples could be drawn and each would give different results, due to the fact that each sample would be made up of different people, who would give different answers to the questions asked. The spread of these results is the sampling variability, which generally reduces with increasing sample size. A confidence interval is a range of values, defined by a lower and upper bound, which indicates the variability of an estimate. Statistical methods are used to calculate the sampling variability from which the confidence interval can be determined. For example, with a 95% confidence interval, it is expected that in 95% of the survey samples, the resulting confidence interval will contain the true value that would be obtained by surveying the whole population.

The LFS routinely publishes details of achieved sample sizes in terms of achieved number of household and person interviews (Tables 3.1, 3.2 and 3.3) and sampling variability for estimates of main variables. Sampling variability (95% confidence intervals) can be found in the ‘Sampling variability' section (Table A11) of the Labour Market Statistics Bulletin.

Back to table of contents

3. Achieved sample

Back to table of contents

4. Response rates

Back to table of contents

5. Timeliness and punctuality

Timeliness refers to the lapse of time between publication and the period to which the data refer. Punctuality refers to the time lag between the actual and planned dates of publication.

Back to table of contents

6. Accessibility and clarity

Accessibility is the ease with which users are able to access the data, also reflecting the format(s) in which the data are available and the availability of supporting information. Clarity refers to the quality and sufficiency of the metadata, illustrations and accompanying advice.

The UK Data Archive at Essex University provides free access to the various LFS datasets.

A highly disaggregated dataset, which covers a wealth of data for local areas, is available free from NOMIS.

The Social Surveys Team provide LFS data for a fee, and can be contacted by phone (+44 (0)1633 455678) or email: socialsurveys@ons.gov.uk

Labour market data, including data from the LFS, are published every month through statistical bulletins These include text, tables and charts. Data contained within the bulletins are available to download, free of charge, from the ONS website.

For questions relating to labour market statistics, please contact:
labour.market@ons.gov.uk

For general queries about the LFS, please contact:
lfs@ons.gov.uk

Back to table of contents

7. Comparability

The degree to which data can be compared over time and domain.

Background

The Labour Force Survey (LFS) began in 1973 and was carried out every 2 years until 1983. Between 1984 and 1991, data were collected annually and the survey has been running in its present form, with quarterly sampling, since spring 1992. It is carried out under European Union regulations, which specify the way in which the survey should be conducted, the quality of the results that member states supply to Eurostat and the timetable for supplying results. Although the LFS began as a survey designed to meet international obligations, its primary purpose is now (as stated in section 1, Relevance), "the prompt publication of key aggregate, whole economy, indicators, for the integrated assessment of labour market conditions" (Review of the Labour Force Survey, ONS, 2002).

Definitions

The definitions of the 3 economic activity groups – employed, unemployed and economically inactive – which are used in the LFS are the standard International Labour Organisation (ILO) definitions.

Economically active – those aged 16 or over, who are either employed or unemployed in the survey reference week.

Employed – those aged 16 or over, who are regarded as in employment if they did at least one hour of work in the reference week (as an employee, self-employed, unpaid workers in a family business or participants in government-supported training schemes) and those who had a job that they were temporarily away from (for example, if they are on holiday).

Unemployed – those aged 16 or over, who are without work, want a job, have actively sought work in the last 4 weeks and are available to start work in the next 2 weeks; or are out of work but have found a job and are waiting to start it within the next 2 weeks.

Economically inactive – those who are neither in employment nor unemployed. This group includes, for example, all those who are looking after a home or family, have a long-term illness or disability which prevents them working or are retired.

Unpaid family workers – those who are doing unpaid work in a family business.

Questionnaire changes

New questions for July to September 2016 (JS16): Social mobility question added: SMERESE. Veteran question added: VETCURR. Agency worker question addded: AGPYWRK. Follow up questions added: YOTH, YSOTH, FUNDOTH.

Amended questions for April to June 2016 (AJ16): Amendents have been made to the wording of the introduction in the Social mobility section, to make it easier for proxy interviews. Amendments have been made to the Religion questions, as they are now only asked to wave 1 or first contact interviews.

Deleted questions for AJ16: NOLOTH removed.

Fieldwork issues

No field work issues for this period.

Methodology

See Section 1 for full details of methodological changes; in January and March 2011 (JM11) a change was implemented to move some wave 1 interviews into the telephone unit, rather than being face-to-face interviews as would normally be the case.

Back to table of contents

8. Coherence

The degree to which data that are derived from different sources or methods, but which refer to the same phenomenon, are similar.

Data sources

The LFS is one of a number of sources of data about the labour market. Some sources provide data that overlap with LFS data on employment, unemployment and earnings. The Office for National Statistics (ONS) has published guidance about the strengths and limitations of each source in relation to these topics and has indicated which source is the most appropriate for different purposes. Details can be found in the Labour Market Guide.

Employment, unemployment and economic inactivity

The LFS is the source recommended by ONS for certain employment-related statistics (for example, estimates of the number of people in employment or unemployed). The LFS is also a unique source of comprehensive, coherent information about economic inactivity, where it provides information separately about people who want a job and those who do not.

Number and industrial composition of jobs

The workforce jobs (WFJ) series provides estimates of the number of jobs in the UK economy and is the source recommended by ONS for both the number of jobs and the industrial composition of jobs. Workforce jobs consist of the sum of employee jobs, self-employment jobs, jobs in the armed forces and government-supported trainees. Civilian workforce jobs are available by geographical region, sex and broad industry. Total workforce jobs are available by sex and broad industry.

Earnings

For estimates of change in earnings (for example, pay growth in the economy), a non-LFS source, the Average Weekly Earnings (AWE) (formerly the Average Earnings Index (AEI)) is the most suitable source. It provides industry and whole-economy information, but excludes small employers, the self-employed and government-supported trainees. Pay, commission, bonuses, overtime and pay award arrears are included, but redundancy payments and benefits in kind are excluded. The Annual Survey of Hours and Earnings (ASHE) includes information about the levels, distribution and make-up of earnings and hours worked for employees in different occupations, industries, ages and regions. It should be used when the information required is not available from the AWE (such as for occupational groups, or regional analyses), and is the preferred source of the earnings of full-time employees, and of the average hourly earnings of all employees. The LFS should be used when the information is not available from the AWE or from ASHE, and is the preferred source of data about the earnings of part-time and low-paid employees. There is an ONS guide to sources of data on earnings and income.

Summary of methods

The LFS covers private households, including persons who are temporarily absent. The resident population comprises persons who regard the sample address as their main address, and also those who have lived in the dwelling for more than 6 consecutive months, even if they do not regard this as their principal dwelling. Persons absent for more than 6 months are not regarded as members of the resident population. A private household comprises one or more persons whose main residence is the same dwelling and/or who share at least one meal per day. Students living in halls of residence and pupils at boarding school are sampled via the private households of their parents. In Great Britain, an additional sample is drawn from persons living in National Health Service accommodation.

The year is divided into quarters of 13 weeks. Prior to January 2006, these were seasonal quarters: winter (December to February), spring (March to May), summer (June to August) and autumn (September to November). From January 2006, the LFS has been conducted on the basis of calendar quarters: Quarter 1 - January to March, Quarter 2 - April to June, Quarter 3 - July to September and Quarter 4 - October to December.

For most of Great Britain, the survey base is the Royal Mail's PAF (Postcode Address File), a database of all addresses receiving mail. The list is limited to addresses receiving fewer than 25 items of post per day, so as to exclude businesses. Because of the very low population density in the far north of Scotland (north of the Caledonian Canal), telephone directories are used as sampling frames, and interviews are carried out by telephone because face-to-face interviews would be too expensive. In Northern Ireland POINTER, which is the government's central register of domestic properties, is used.

In Great Britain, a systematic sample is drawn each quarter from the 3 sampling bases, yielding 16,640 PAF addresses, 75 telephone numbers for the north of Scotland and 36 units of National Health Service housing. As the PAF is broken down geographically, the systematic sampling ensures that the sample is representative at regional level. In Northern Ireland, a simple random sample is drawn, each quarter, from each of 3 strata, giving 650 addresses in all.

A rotation system comprising 5 waves is used. Respondents are interviewed 5 times at 13-week intervals and one-fifth of the sample is replaced each quarter. Interviews are carried out on a face-to-face (CAPI) or telephone (CATI) basis with the help of portable computers for the interviews in the first wave. In the far north of Scotland (north of the Caledonian Canal) and for interviews in the second to fifth waves, wherever possible, interviews are carried out by telephone.

Technical definitions

Imputation

If a household (or someone within a household) is unavailable for interview, but was interviewed in the previous wave, responses from the previous wave are rolled forward. This is referred to as “imputation”. Imputation is carried out to minimise non-response bias in estimates, while simultaneously improving precision by boosting the sample size. The rationale is that most LFS variables do not change from one quarter to another for most people. Responses are rolled forward for one wave only. Data are not rolled forward after a second consecutive non-response. Tables and charts (at person or household level) containing responses that have been rolled forward from the previous wave are denoted by the term “including imputed”. Tables and charts which do not contain responses that have been rolled forward from the previous wave are denoted by the term “excluding imputed”.

Method of calculating sampling variability

The sampling variability is the spread of results that would be obtained if different samples were drawn. A confidence interval is a range of values, defined by a lower and upper bound, which indicates the variability of an estimate. Statistical methods are used to calculate the sampling variability from which the confidence interval can be determined. For example, with a 95% confidence interval, it is expected that in 95% of the survey samples, the resulting confidence interval will contain the true value that would be obtained by surveying the whole population.

Method of calculating response rates

The response rate indicates how many interviews were achieved as a proportion of those eligible for the survey. The formula used is as follows:

RR = (FR + PR)/(FR + PR + OR + CR + RHQ + NC + RRI*)

where RR = response rate, FR = full response, PR = partial response, OR = outright refusal, CR = circumstantial refusal, RHQ = refusal to HQ, NC = non contact, RRI = refusal to re-interview, *applies to waves 2 to 5 only.

Definitions of response outcome categories

A full response denotes a household in which each household member has answered all applicable questions.
A partial response denotes a household in which questions were not completed because someone refused to be interviewed, refused part way through the questionnaire or refused to let someone else answer on his or her behalf. However, at least one question block must have been completed. If only part information has been collected for a one-person household, it is coded as a refusal or non-contact.
An outright refusal is a household that refuses to respond to the survey and the interviewer feels that there is no chance of an interview at the current or in any future wave.
A circumstantial refusal is a household where the respondent refuses to respond because of a temporary circumstance (for example, going on holiday, too busy during the field period). A circumstantial refusal enables an interviewer to call back at the next wave.
A refusal to HQ is a household that contacts headquarters to refuse to participate in the survey in response to the advance letter.
A non-contact arises when an address is occupied, but where it has not been possible to contact any member of the household in the field period.
A refusal to re-interview is a household that takes part in the survey (at one or more of waves 1 to 4) but which, when asked to take part in the next wave (waves 2 to 5), refuses.

Method of calculating income response rates

The income question is asked at wave 1 and wave 5 only. Individuals aged 16 to 69 who are in employment in the reference week, form the sub-set of respondents who are eligible for these questions. The percentage response rates for the income questions are based on all eligible, in-scope respondents at wave 1 and all eligible, in-scope respondents at wave 5. The total response rate is the aggregate response rate for income for the quarter (wave 1 and wave 5), based on all eligible, in-scope respondents.

NS-SEC

NS-SEC is the National Statistics Socio-Economic Classification, which replaces previous classifications which were based on social class and social and economic group.

Proxy response

The LFS has to complete fieldwork to a tight timetable and interview as many of the sampled households as possible, which leaves limited time for recalls. LFS interviewers try to interview every adult (aged 16 and over) in each sampled household. However, when a household member is unavailable for interview, interviewers accept information by proxy from another responsible adult in the household. The proxy respondents are normally people living with a partner on behalf of their partner, and parents on behalf of their adult offspring who live with them.

Attrition

Attrition is the term applied to respondents who begin the survey but subsequently drop out. It has been known for some time that these respondents tend to have different characteristics to those who remain in all waves of the survey, which can, therefore, result in attrition bias. For example, if respondents in a particular age band have a higher tendency to drop out (attrition rate) than respondents in other age bands, then they will be under-represented in subsequent waves of the survey and in estimates.

Website references

Labour Force Survey User Guides

Labour Market Statistics Statistical Bulletin

Labour Force Survey QMI (Quality and Methodology Information)

Methodology for the Calculation of Sampling Variability in the Labour Force Survey

NOMIS

Summary Quality Report for Labour Market Data Releases

UK Data Archive, University of Essex

Back to table of contents