Creating Greater Value from Open Data

David Mitton davidmitton@liberata.com 07770 442931

Reference data (Code Lists)

County Codes (Local Gov Standard) Kent Essex Hertfordshire Bedfordshire Cambridgeshire KT101 EX101 HT101 BD101 CB101 County Codes (Central Gov Standard) Essex Herts Beds Cambridgeshire Kent ESX HFD BD1 CB KNT

Mapping competing codes together creates a data translation layer

Federated data is made interoperable without redefining data standards

Fly Tipping

Picture: Kevin Rothwell, Creative Commons

Wasteful Drain on resources Costly

Dumping

European Union, 1995-2012

Fees generated from commercial tippers Sales of electricity from gas generated

Recycling

Social and economic benefits

Reduction in pollution Creation of 4 :1 extra jobs versus traditional incineration Eases demand for natural resources

Fly Tipping
Local Authority Barnsley Borough Council Doncaster Metropolitan Borough Council Knowsley Metropolitan Borough Newcastle upon Tyne City Council Oldham Metropolitan Borough Council Sunderland City Council North Tyneside Council St Helens Borough Council Homeless Spending 396,000 489,000 547,000 1,239,000 395,000 876,000 248,000 399,000 B&B Temp Accom Hostels Leasehold Dwellings Admin 396,000 489,000 547,000 1,239,000 395,000 876,000 0 0 % Admin

100% 100% 100% 100% 100% 100% 0% 0%

"from OpenlyLocal"

Wasteful
Resource to publish and high cost to interrogate Where to start?

Dumping
Local Authority Bradford Metropolitan Council South Tyneside Metropolitan Borough Council Sefton Metropolitan Borough Council Sheffield Council Coventry City Council Salford City Council Leeds City Council Wigan Metropolitan Borough Rotherham Metropolitan Borough Council

Homeless Spending
1,459,000 344,000 257,000 5,141,000 676,000 1,695,000 9,489,000 820,000 785,000

B&B

Temp Accom

Hostels 472,000

Leasehold Dwellings

Admin 987,000 215,000

% Admin

68% 63% 62% 59% 49% 48% 45% 43% 15%

129,000 33,000 2,109,000 345,000 239,000 2,937,000 69,000 507,000 527,000 1,723,000 399,000 25,000 501,000 140,000 137,000 65,000 0

160,000 3,032,000 331,000 812,000 4,302,000 352,000 119,000

"from OpenlyLocal"

Organising

The standards against which they report

Bed & Breakfast Hotels Administration Temporary Accommodation

The reference data to classify it

Ability to map reference data A means to make sense of diverse data sets

Outcomes
Improved quality and reusability of data

Data.gov.uk

How important is being organised?

The Soham Murders Holly Wells & Jessica Chapman Data was not interoperable Information existed to prevent this tragedy

The challenge of interoperability

M = Male, F = Female, U = Unkown.or does it?

Try to enforce standards and you get resistance Solution is to manage diversity, not try to impose uniformity Good standards emerge by embracing all standards and collaborating

The Police National Database

PND Outcomes National View of Criminal Intelligence 2,500,000 savings on data integration

Police National Dbase 300 code list standards 4. Translation layer (XML)
CRASH PentiP

5. Quality Control

6. Re-use of standards

HOLMES 3 HODH

Alerts

Web Services

MoJ

3. Map to PND

Police.uk

2. Application Context
1. Validate Local Codes

300 ICT systems and 43 police forces = 12000 competing code lists Gender Classifications Male = M, Male = M1, Male = 001, Male = M101

EC2A 4JE

The value of one data standard

Vehicle Make Model Code List

Government Police SAFETY VOSA CRASH statistics DVA NI

Private Sector Insurance Companies QUALITY Trade e.g. RAC, Tracker MOT Failure Codes Rental & Leasing

VALUE Aftermarket parts

VRM Lookup companies Department for Transport 40 x Motor Manufacturers

1000s Parts suppliers

It seems obvious. So why is data dumped and savings missed?

Only 35% of UK civil servants know that using data standards can reduce IT implementation costs Only 40% know that data standards make data interoperable 78% do not know what benefits will flow from the open data agenda

Source: Listpoint/ Dods civil service research into understanding of open data agenda and benefits December 2012. More information at www.listpoint.co.uk

What can the OD community do to give data more value?

Government Open Data is not Open Data without the reference data sat alongside it Champion the cause
Raise awareness of the role classifications play

Re-use the tools available Outcomes

Reduce costs, improve services, innovation Greater value in Open Data

655 Million in savings if code lists are organising and reused

GOVERNMENT SPEND ON IT PROJECTS (RENEWING) Department Attorney Generals Office Cabinet Office Department for Business, Innovation and Skills Department for Communities and Local Government Department for Culture, Media and Sport Department for Education Department for Environment, Food and Rural Affairs Department for Health Department for Transport Department for Work and Pensions Department of Health Foreign and Commonwealth Office Greater London Authority HM Revenue and Customs HM Treasury Home Office Local Authority Ministry of Defence Ministry of Justice Police Transport for London Welsh Assembly Other Grand Total Average spend on data integration = 12.5% of total Savings by adopting Listpoint (as per PND) Savings over 4 Years on ICT projects 2013 ICT Value No. 2014 ICT Value No. 2015 ICT Value No. 2016 ICT Value No. 240,000 5,000,000 15,000,000 15,000,000 106,700,000 153,700,000 135,000,000 149,000,000 270,000,000 1,610,000,000 122,000,000 687,396,347 23,500,000 501,410,000 4,800,000 10,500,000 9,000,000 3,869,246,347 483,655,793 96,731,159 1 1 2 1 4 3 1 2 1 2 1 30 3 3 1 1 3 63 100,154,000 30,500,000 351,397,244 173,000,000 62,000,000 0 274,000,000 8,744,551,244 1,093,068,906 218,613,781 3 1 22 2 2 1 2 56 12,000,000 9,575,455,000 1,242,460,000 248,492,000 1 64 4,052,500,000 506,562,500 101,312,500 665,149,440 30 260,000,000 14,000,000 90,000,000 11,500,000 3 1 2 1 125,000,000 800,000,000 25,000,000 2 2 1 500,000,000 48,200,000 82,000,000 300,000,000 82,000,000 12,000,000 1 1 1 1 1 1

687,000,000 6,680,000,000

3 12

946,200,000 100,000,000

5 1

38,000,000 56,000,000 80,000,000 10,000,000 364,225,000 6,895,000,000 8,430,000

2 1 2 2 33 6 4

1,328,100,000 896,200,000 80,000,000 600,000,000

4 14 1 2

Appendix

Listpoint Background Listpoint Features Reference data mapping

Listpoint Background

16,000 Government reference data sets published Classified as a re-usable asset on the ICT ASK register
ICT Asset and Services Knowledgebase Part of the ERG process (Cabinet office review of planned 5m+ government projects to ensure re-use and not re-invention)

A member of the European Commission CESAR programme

Community of European Semantic Asset Repositories Largest contributor of semantic assets

Award winning application

Emergency Services Awards 2011

A free to use platform to find, load, validate and collaborate around reference data standards

Listpoint in practice

Code List quality

Browser-based editing/publishing and integrated validation rules

Context management
Group relevant code lists together Recognise in which context a data standard is being used

Context Mapping
Listpoint approach to semantic interoperability Join competing standards together with auto mapping)

Quality maintenance
Alerts (e-mail and web services) when standards are updated

Translation
Output includes XML and SKOS XML mappings used to translate data across multiple applications for efficient data integration