Business reporter and statistics leader at BBC News
Sir Ian Diamond, head of the Office for National Statistics (ONS), resigned immediately for health reasons, when ONS faced a crisis of confidence in its work.
"Due to ongoing health issues, Sir Ian decided that he could not give him the full commitment he hoped to move the organization forward," ONS said.
Last month, a report by the Bureau of Statistics Regulation (OSR) raised its concerns about the quality of ONS data.
These concerns focus on but are not limited to the widely recognized issue in the labour force survey, which is used to measure unemployment in the UK.
Dr Sarah Cumbers, CEO of the Royal Statistical Society, said: “Sir Ian Diamond demonstrated outstanding leadership over ONS and the broader statistical system during the pandemic, which helped make the UK a world leader in delivering timely data in a rapidly changing environment.”
Dr. Cambers also acknowledged the OSR report.
She said: “In view of the recent review of the system, we look forward to interacting with the Cabinet Office and the UK Statistics Office to consider how the role of national statisticians should develop and to work with Sir Ian’s successor to address the ongoing challenges.”
The report examines concerns about business investigations and finds that INS employees are not always listening when asking emerging questions to senior executives.
The lack of confidence in data quality makes it harder for governments and companies to make completely informed decisions.
Statistical agencies around the world have been working to get a good enough response rate since the pandemic to ensure their data has the required quality.
The regulator said there is more need to ensure that ONS has sufficient steps to regularly review and improve sample design and representation, respond to bias, investigative methods and imputation.
Sir Ian served in the National Bureau of Statistics in October 2019.
This means he soon became the focus of attention in early 2020, as a key member of Sage, the government’s emergency scientific advisory group.
However, the challenges have been even harder to navigate in some ways due to the pandemic. ONS has been under fire as the quality of official data declines.
ONS's flagship work survey has been working hard to gather enough responses as fewer people increasingly complete the questionnaire.
Its data became so unreliable that UK statistical regulators removed its quality and the Kite markers of MPs, and the Bank of England feared they would not be able to use its numbers.
Online alternative employment surveys have been repeatedly delayed.
A highly critical internal report then brings tremendous experience to those working in alternative projects that “affect well-being and confidence at all levels.”
The alternative employment investigation was scheduled to take place in September 2024, at least next year to next year, Sir Ian warned MPs that it may not be fully ready by 2027.
This is not the only problem that ONS faces in 2024.
ONS statisticians strike a strike against the reversal of one of the most generous family policies among civil servants.
The regulator’s Office of Statistics and Regulations criticized the ONS’s “defensiveness” in response to questions about new analysis of gender identity.
Repeated revisions undermine the credibility of ONS' estimates of migration levels.
In April, the Cabinet Office announced a swift review, led by retired British civil servant Sir Robert Devereux.
The review will examine ONS's core statistics and main programs, its organizational culture, structure and leadership and its relationship with the Cabinet Office and the HM Treasury Department.