Open Data Processes – Taps, Query Paths/Audit Trails and Round Tripping
A few quick thoughts on open data processes and how we might start to put some of all this open public data to work, maybe via transparent data processes, not least in the institutions that are publishing it all…
Data Taps
The idea behind a data tap is simple – just tap off a view of the data as one institution provides it to another:
Tapping data is part of the motivation behind using FOI requests to identify standard reporting forms that may be used as part of a white box (open and transparent) data exchange process.
Query Paths/Audit Trails
Query paths describe a process in which is it possible to see how a particular data view or set of summary data was obtained from a one or more data sources:
For an example use case, see So Where Do the Numbers in Government Reports Come From?.
Round Trips
Round tripping refers to the ability to regenerate a data source from a data report, as for example taking data out of an HTML table and popping it into a spreadsheet or database):
If common data fields are used across datasets, it may be possible to populate fields in one data “source” automatically from another:
Round tripping means that we can reuse data, once entered, to populate other reporting forms.
[See also: Open Data Handbook]
[...] the request and then refer the person making the request to the open data site (see also: Open Data Processes – Taps, Query Paths/Audit Trails and Round Tripping). Southampton have part of this process already – the course data is in a PDF on the their [...]
Getting Access to University Course Code Data (or not… (yet…)) « OUseful.Info, the blog…
April 26, 2011 at 3:52 pm
[...] One of the Good Things about open data is that with the data being open, there’s less pressure to lock down or restrict access to any of the apps that might build on top it. Whilst some open data initiatives are based around dumping partial, broken or unmaintained datasets “just because”, other open data initiatives are actually using open data as part of a workflow, where the publication of the open data can be seen as opening up a window onto, and tap into, a working data pipeline (e.g. Putting Public Open Data to Work…?, Open Data Processes – Taps, Query Paths/Audit Trails and Round Tripping). [...]
Open Data Powered Location Based Services in UK Higher Education « OUseful.Info, the blog…
June 7, 2011 at 9:35 am
[...] cleanliness and quality of data sets, (for example, see Putting Public Open Data to Work…? and Open Data Processes – Taps, Query Paths/Audit Trails and Round Tripping; Library Location Data on data.gov.uk gives examples of how the same data can be released in [...]
So What’s Open Government Data Good For? Government, maybe? « OUseful.Info, the blog…
July 7, 2011 at 2:44 pm
[...] at least as much as, if not more so, than the data. (I referred to this as a query path in Open Data Processes – Taps, Query Paths/Audit Trails and Round Tripping; see also So Where Do the Numbers in Government Reports Come [...]
Why Open Data Dumps On Their Own Add Little to Transparency… « OUseful.Info, the blog…
January 5, 2012 at 6:15 pm