Integrated Data Service (IDS)

The Integrated Data Service (IDS) will close in mid-2026 as part of the programme’s planned transition. While IDS will no longer operate as a standalone service, Office for National Statistics (ONS) will continue to use the underlying Google Cloud Platform (GCP) Analytical Platform internally to support the organisations analytical and data processing needs. As a result, the information on this webpage has begun to shift, and will continue to evolve, from describing the IDS service to explaining the GCP Analytic Platform and its role within ONS.

The GCP Analytic Platform is a secure Trusted Research Environment operated by the ONS. It offers cloud‑based analytical tools and access to de‑identified datasets to enable research supporting ONS prioritisation work. The platform also facilitates approved collaborative projects carried out within its secure environment.

Who can use GCP AP 

Although both operate within the ONS estate, the GCP Analytic Platform is separate from the Secure Research Service (SRS). The platform is primarily for internal ONS use, with access extended only in cases of approved ONS‑led collaborative projects that meet both ONS corporate objectives and those of the partnering department. External researchers should continue to use the SRS.

See SRS webpages and information on becoming an accredited researcher.  

Before you start 

To run a project on GCP Analytic Platform you should be able to write basic Structured Query Language (SQL) and work in either R or Python. Training materials and tutorials on how to use the platform are available inside the service. 

Apply for a project 

You and your team must: 

• be internal to ONS or working on a project that is an approved collaboration with ONS 

• in the first instance, email Customer Support. You will then be referred to colleagues in Outreach for an initial discussion. Subject to that discussion, and provided your project meets the required criteria, approval to use the platform will be issued  

• specify, at application, which tools each user requires for the project (for example Vertex AI Workbench, RStudio, Code OSS) 

• specify which datasets the project will require, including any data linkage needs 

• be confident that your proposed analysis aligns with ONS corporate objectives and the priority work of your directorate 

Sign-in and security 

IDS uses Remote Browser Isolation (RBI) to protect data. When you sign in, you will see a blue address bar indicating the remote browser session. The following applies: 

• IDS features open within the remote browser, other websites will not open inside it 

• copy and paste into or out of the remote browser is disabled. Copy and paste between remote browser windows is allowed, but you will need to activate the remote clipboard by copying text outside the remote browser first 

• you may be asked to sign in a second time

Workspaces and tools 

Once approved and added to a project, you will have access to one or more workspaces: 

• Vertex AI Workbench: JupyterLab Integrated Development Environment (IDE) for Python 

• RStudio: IDE for working in R 

• Code OSS: IDE for Python, similar to VS Code 

You can mix code with explanatory text using notebooks in Vertex AI Workbench, or R Notebooks and R Markdown files in RStudio. Tools are provisioned on a per-person, per-project basis and may vary depending on project needs. Guidance is available after approval.

Data access 

GCP AP provides access to more than 100 datasets. Deidentified datasets are listed in the IDS Data Catalogue. You can search by date, theme and keyword. Access to datasets is restricted to those approved for your project, even if they appear in the catalogue.

Data are stored in BigQuery. You can view dataset metadata in BigQuery Studio and query data directly from your workspace.  

Work with data 

Use SQL to query and manipulate data in BigQuery. Queries can filter, aggregate and link data to produce processed outputs efficiently. You should be able to access, process and link data using SQL.

For analysis and visualisation, use R or Python in your chosen workspace.  

Manage code and packages 

Store and share code in the private GitHub server. Git provides version control so you can track changes, restore earlier versions and collaborate. Code stored in workspaces is temporary, GitHub is the only area for permanent storage. Use Artifactory to manage packages used by your code.

External projects should use other TRE, such as the SRS. See how to become an accredited researcher.

Email: IDS.customer.support@ons.gov.uk

Support hours:
Monday to Thursday, 9am to 5pm
Friday, 9am to 4pm

We will reply as soon as possible during these hours.