1. What are Experimental Statistics?

These are series of statistics that are in the testing phase and not yet fully developed.

Back to table of contents

2. How should users interpret such series?

Users should be aware of the status and cautions of these series, which will vary for each statistic. The particular limitations of each series are explained in the accompanying information for each.

Back to table of contents

3. Why is the number of experimental series increasing?

We regularly consult the users of our statistics during methodological reviews and the development stage of methodological changes. We recognise that making experimental series available during a development period assists in the quality assurance process and helps familiarise potential users with any changes. There have also been initiatives to increase the scope of our economic statistics, particularly within the service sector.

Back to table of contents

4. When are statistics defined as experimental?

Defining what is experimental and non-experimental is largely a matter of statistical judgement, but typically experimental series are created when:

  • they are being produced part way through a well-defined development programme, whether these statistics are new or changed versions of existing statistics
  • the statistics are new but still subject to testing in terms of their volatility and ability to meet customer needs
  • the statistics do not meet the rigorous quality standards of National Statistics yet
  • a rich variety of new measures is available from a new set of statistics, with components that have considerable immediate value to users; these users are aware of the statistics' theoretical quality and can use them before we have completed all operational testing – the testing is designed to fully validate the measures to the standard expected of National Statistics
Back to table of contents

5. What are the features of Experimental Statistics?

The experimental nature of such statistics may reflect:

  • new methods, which are being tested and still subject to modification
  • partial coverage (for example, of industries) at that stage of the development programme
  • potential modification following user feedback about their usefulness and credibility compared with other available statistical sources
Back to table of contents

6. Why publish Experimental Statistics?

The reasons include:

  • consultation: we would like to get informed feedback from potential users
  • acclimatisation: where the experimental series are alternative versions of the format of existing series, we may wish to help users become used to new presentations
  • use: experimental series can provide useful information for users as long as their nature is well-explained and understood
Back to table of contents

7. When do Experimental Statistics become non-experimental?

This will be a matter of statistical judgement, but will typically take into account factors such as:

  • when it is judged that statistical methods have settled down
  • when coverage reaches a good level
  • when user feedback indicates that these statistics are useful and credible
  • when the defined development phase has ended
  • when it is judged that the statistics meet the rigorous quality standards of National Statistics
Back to table of contents

8. What is the procedure for removing experimental status?

Statistics classified as “Experimental Statistics” are only made National Statistics following assessment by the Office for Statistics Regulation.

For this to happen, there are four stages that must be followed:

  • stage 1: self-assessment by business area
  • stage 2: methodological review by our Strategy and Standards Directorate methodologists and/or business area methodologist
  • stage 3: recommendation by the Strategy and Standards Directorate, ONS Director General's office and the Statistical Policy Committee (SPC)
  • stage 4: assessment by the Office for Statistics Regulation

For official statistics, removing the Experimental Statistics label does not require Office for Statistics Regulation involvement.

Back to table of contents