ODS are implementing a Data Quality Assessment Framework (guided by the principles of the Government Data Quality Framework: The Government Data Quality Framework - GOV.UK (www.gov.uk)) that we wish to share with all consumers of our data.
Aims
To implement and maintain a framework that allows ODS to assess the quality of our data and share that on an ongoing basis with data consumers, and data suppliers. ODS aim to be transparent regarding data quality and any issues we identify with our data, and we want to share our plans and achievement regarding data quality improvements.
Objectives
| ACCESSIBLE | An accessible framework of data quality assessment that ODS will share with data consumers |
|---|---|
| SIMPLE | A simple framework that can be easily understood by ODS data consumers |
| FLEXIBLE | A flexible framework that we can adapt following feedback from data consumers |
| SUSTAINABLE | A framework that is sustainable; ODS will have the resource required to maintain the framework |
Overview
The ODS Data Quality Assessment Framework currently contains 9 dimensions against which we will assess our data:
| 1 | Frequency of Update | How frequently the source data is updated. For 3rd party data this can be daily. Weekly, monthly etc, but for ODS mastered data a 'green' standard would be ad hoc / as required or requested. |
| 2 | Data Collection Method | The means by which source data is sent to ODS. As part of our Data Strategy we aim to work with 3rd party data providers to modernise ingestions methods as far as possible, establishing API data feeds. |
| 3 | Fit for Purpose | Is the source data fit for purpose in terms of how closely it represents organisation data. A lower assessment will be for contract data or prescribing driven data for example, which is repurposed to meet the requirement for organisation data. |
| 4 | Coverage / Completeness | Confidence level that the data represents a definitive list of organisations of that type and that each organisation record is comprehensive (no missing data items). Some codes are issued on the basis of downstream need for a code, so coverage is therefore inconsistent. |
| 5 | Reliability / Accuracy | ODS assessment of how accurate and reliable the data is - a lower assessment will be due to general data quality issues (i.e. double spaces, special characters, referential integrity issues), and/or where data does not comply with business rules/has had to be manipulated by ODS prior to publication to ensure data conformance. |
| 6 | 3rd Party Data Agreements | For 3rd party data supply only, assessing whether ODS have a current written agreement in place with the data supplier. |
| 7 | 3rd Party Escalation Routes | For 3rd party data supply only, do ODS have establish routes for escalating and resolving issues with source data |
| 8 | System Application / Downstream System Feedback | Level of feedback received from ODS data consumers that indicates issues with the data. |
| 9 | Future Refinement / Improvement Plan | Data quality improvement plans can be developed by ODS for subsets of data causing issues / highlighted by this DQ assessment as requiring improvement. A 'red' assessment could be due to lack of resources or prioritisation within ODS but also, may be dependent on 3rd party co-operation. |
ODS Data Quality Assessment Dimensions and Overall Scoring
DQ Dimensions
Each DQ dimension will be RAG rated on the following basis:
| DIMENSION | RED | AMBER | GREEN | |
| 1 | Frequency of Update | >Weekly | Weekly | Daily or Ad Hoc |
| 2 | Data Collection Method | csv/xlsx files via email | FTP / data download from website | API / Customer Requests via Service Desk |
| 3 | Fit for Purpose | Does not meet org data definition and causes significant issues | Does not meet org data definition but is acceptable | Purely for the purpose of org identification |
| 4 | Coverage / Completeness | Significant gaps | Good but not complete as some codes issued on basis of need only | Comprehensive coverage |
| 5 | Reliability / Accuracy | Significant data quality issues | Minor data quality issues | No data quality issues |
| 6 | 3rd Party Data Agreements | Agreement does not exist | Agreement in place but requires update | Current Agreement in place |
| 7 | 3rd Party Escalation Routes | No reliable escalation route, difficult for ODS to obtain support/feedback | Escalation routes exist but improvements could be made | Robust escalation routes in place and effective |
| 8 | System Application / Downstream System Feedback | Regular and complex helpdesk calls raised regarding data / org type | Helpdesk calls sometimes raised but issues fairly easily resolved | Helpdesk calls (raising issues) regarding data / org type are rare |
| 9 | Future Refinement / Improvement Plan | Improvements required but no plan in place | Improvement plan in progress | Work completed or not required |
Overall Scoring / Assessment
A simple scoring mechanism has been applied - each dimension assessed as RED scores 1, AMBER scores 2 and GREEN 3. These are then combined into an overall score. The optimum score is therefore 27.
The overall score thresholds are currently:-
| RED | AMBER | GREEN | |
| Overall Score | <15 | >=15<20 | >=20 |
ODS Data Quality Assessment Dashboard
This dashboard summarises the DQ assessment for each organisation type. To view the written details that support the RAG rating for each dimension, please refer to the Reference Data Catalogue page for the organisation type in question.
| Data Quality Dimension | |||||||||||||
| Last updated: |
| 1 | 2 | 3 | 4 | 5 | ODS mastered, 3rd party data or mixed | 6 | 7 | 8 | 9 | ||
| Type | OVERALL | Frequency of update | Data Collection Method | Fit for Purpose | Coverage / completeness | Reliability / Accuracy | Data Agreement | 3rd party Escalation Routes | System Application / Downstream System Feedback | Future refinement / improvement plan | |||
| Health and Social Care Authorities and Agencies | NHS England and Regions | Org | GREEN | Green | Green | Green | Green | Green | ODS | n/a | n/a | Green | Green |
| Special Health Authorities and sites | Org | GREEN | Green | Green | Green | Green | Green | ODS | n/a | n/a | Green | Green | |
| Strategic Partnership - Integrated Care Boards | Org | GREEN | Green | Green | Green | Green | Green | ODS | n/a | n/a | Green | Green | |
| Sub ICB Locations and Sites | Org | GREEN | Green | Green | Green | Green | Green | ODS | n/a | n/a | Green | Green | |
| Commissioning Support Units (CSU) and Sites (including DSCROs) | Org | GREEN | Green | Green | Green | Green | Amber | ODS | n/a | n/a | Green | Amber | |
| NHS Support Agencies and Shared Services | Org | GREEN | Green | Green | Green | Green | Amber | ODS | n/a | n/a | Green | Amber | |
| Welsh Local Health Boards and Welsh LHB Sites | Org | GREEN | Green | Green | Green | Green | Green | ODS | n/a | n/a | Green | Green | |
| Local Authorities and Local Authority Sites | Org | GREEN | Green | Green | Green | Green | Green | ODS | n/a | n/a | Green | Green | |
| Other Statutory Authorities, Government Bodies and Executive Agencies | Org | GREEN | Green | Green | Green | Green | Green | ODS | n/a | n/a | Green | Green | |
| Type | OVERALL | Frequency of update | Data Collection Method | Fit for Purpose | Coverage / completeness | Reliability / Accuracy | ODS, 3rd party data or mixed | Data Agreement | 3rd party Escalation Routes | Downstream System Feedback | Future refinement / improvement plan | ||
| Primary Care | Prescribing Cost Centre (GP Practice) - England and Wales | Org | GREEN | Amber | Red | Amber | Green | Amber | Mix | Green | Green | Amber | Amber |
| Prescribing Cost Centre (GP Practice) - Northern Ireland | Org | AMBER | Red | Red | Amber | Amber | Red | 3rd party | Green | Green | Green | Red | |
| Branch Surgeries | Org | GREEN | Green | Green | Green | Amber | Green | ODS | n/a | n/a | Green | Green | |
| Primary Care Networks | Org | GREEN | Green | Green | Green | Green | Green | ODS | n/a | n/a | Green | Amber | |
| Pharmacy Headquarters | Org | GREEN | Amber | Red | Green | Green | Amber | ODS | n/a | n/a | Green | Amber | |
| Pharmacy / Dispensary | Org | GREEN | Amber | Red | Green | Green | Amber | 3rd party | Green | Green | Green | Green | |
| Pharmacy Sites | Org | GREEN | Green | Amber | Green | Green | Green | ODS | n/a | n/a | Green | Green | |
| Abeyance & Dispersal | Org | GREEN | Green | Green | Green | Green | Green | ODS | n/a | n/a | Green | Green | |
| General Practitioner | Practitioner | GREEN | Amber | Red | Amber | Green | Amber | 3rd party | Green | Green | Green | Green | |
| Nurse Prescriber | Practitioner | AMBER | Red | Red | Amber | Amber | Red | 3rd party | Green | Green | Amber | Red | |
| Private Controlled Drug Prescriber | Practitioner | GREEN | Amber | Red | Green | Green | Green | 3rd party | Green | Green | Amber | Green | |
| Type | OVERALL | Frequency of update | Data Collection Method | Fit for Purpose | Coverage / completeness | Reliability / Accuracy | ODS, 3rd party data or mixed | Data Agreement | 3rd party Escalation Routes | Downstream System Feedback | Future refinement / improvement plan | ||
| Secondary Care | NHS Trusts and NHS Trust Sites | Org | GREEN | Green | Green | Amber | Green | Green | ODS | n/a | n/a | Green | Green |
| Care Trusts and Care Trust Sites | Org | GREEN | Green | Green | Amber | Green | Green | ODS | n/a | n/a | Green | Green | |
| Pathology Laboratories | Org | GREEN | Green | Green | Green | Amber | Green | ODS | n/a | n/a | Green | Green | |
| Networks, Registries and Military Hospital | Org | GREEN | Green | Amber | Green | Amber | Amber | ODS | n/a | n/a | Green | Amber | |
| Northern Ireland Trusts and Non HPSS Provider Organisations | Org | GREEN | Red | Red | Green | Green | Green | 3rd party | Green | Green | Green | Green | |
| Hospital Consultants | Practitioner | AMBER | Red | Red | Green | Red | Amber | 3rd party | Green | Green | Green | Red | |
| Dental Consultants | Practitioner | AMBER | Red | Red | Green | Red | Amber | 3rd party | Green | Green | Green | Red | |
| Type | OVERALL | Frequency of update | Data Collection Method | Fit for Purpose | Coverage / completeness | Reliability / Accuracy | ODS, 3rd party data or mixed | Data Agreement | 3rd party Escalation Routes | Downstream System Feedback | Future refinement / improvement plan | ||
| Independent Sector / Other | Independent Sector Healthcare Providers and Sites | Org | GREEN | Green | Green | Green | Green | Amber | ODS | n/a | n/a | Green | Green |
| Non- NHS Organisation | Org | GREEN | Green | Green | Amber | Amber | Amber | ODS | n/a | n/a | Green | Green | |
| Optical Headquarters and Sites | Org | AMBER | Green | Amber | Amber | Amber | Amber | ODS | n/a | n/a | Green | Amber | |
| Dental Practice | Org | RED | Red | Amber | Amber | Red | Red | Mix | Green | Amber | Red | Red | |
| Schools | Org | GREEN | Red | Amber | Green | Green | Amber | 3rd party | Green | Green | Amber | Green | |
| Education Establishments | Org | GREEN | Green | Green | Green | Green | Green | ODS | n/a | n/a | Green | Green | |
| Social Care Providers and Sites | Org | GREEN | Red | Green | Green | Green | Green | 3rd party | Amber | Green | Green | Green | |
| Health and Justice Organisation | Org | GREEN | Green | Green | Green | Green | Amber | ODS | n/a | n/a | Green | Green | |
| Other Application / System / Service Providers | Org | GREEN | Green | Green | Green | Green | Green | ODS | n/a | n/a | Green | Green | |
ODS Data Quality Assessment - Review Cycle
There is a 'Last Updated' data at the top left of the DQ Assessment Dashboard that indicates when the scoring was last reviewed by ODS.
ODS will review the assessments on an ANNUAL basis minimum.
If there is a data quality incident, or data source change in the interim, an ad hoc update may be applied, but the Last Updated date will reflect this.