FOI reference: FOI-2025-3061
You asked
I require a complete overview of the ‘extensive user testing’ process for the TLFS, the governing diversity, equality, and inclusion (DEI) principles and information regarding how the voices of people minoritised by sex or gender were included in the process of eradicating gender diverse people in favour of gendered language only in outward facing surveys.
We said
Thank you for your request.
The Transformed Labour Force Survey (TLFS, also known publicly as the Shape Tomorrow Survey) does not include a gender identity question. Evidence presented beyond this point refers to sex-based language. Sex-based language is present within the TLFS in the household section of the questionnaire. This is restricted to the sex and relationship questions. The household section of the questionnaire was developed during 2016 to 2019. This development utilised a Respondent Centred Design approach, which is explained in detail within the User-centred design approach to surveys publication. A blog detailing the high-level transformational approach can also be found on the ONS website.
With the sex and relationship questions specifically, development involved a series of public facing qualitative testing methods. Several rounds of cognitive testing were undertaken. Testing involved recruitment of members of the public to a 60-90 minute-long one-to-one research session. The question designs were presented to participants who responded to them as if they were a live questionnaire. Subsequently, participants were asked questions on how they found the process, why they answered as they did, and how they felt about their experience. This allowed researchers to establish the acceptability and understanding of each question. Further information about the design and testing of these questions can be found on the UK Data Service YouTube channel. Please note that the design has changed in places since the recording of this webinar in 2019.
Since 2019, the questions have been monitored alongside all other TLFS variables. To do so we collect feedback from our survey enquiry line, our telephone operators, the feedback boxes within the questionnaire, and complaints via generic channels. Based on this feedback, we review and update content when and where necessary. The survey is currently in the Public Beta phase, which means it is still in development, and we are testing it to collect feedback and make further improvements before we roll it out fully in the ‘live’ phase. More information about the Beta phase is available on the GOV.UK website.