Longitudinal Spine - March 2019

Video thumbnail (Frame 0) Video thumbnail (Frame 4480) Video thumbnail (Frame 5175) Video thumbnail (Frame 6507) Video thumbnail (Frame 7415) Video thumbnail (Frame 8520) Video thumbnail (Frame 10591) Video thumbnail (Frame 18422) Video thumbnail (Frame 22256) Video thumbnail (Frame 29092) Video thumbnail (Frame 29652) Video thumbnail (Frame 30299) Video thumbnail (Frame 32165) Video thumbnail (Frame 33919) Video thumbnail (Frame 36095) Video thumbnail (Frame 37110) Video thumbnail (Frame 37900) Video thumbnail (Frame 39566) Video thumbnail (Frame 40331) Video thumbnail (Frame 40905) Video thumbnail (Frame 41537) Video thumbnail (Frame 42595)
Video in TIB AV-Portal: Longitudinal Spine - March 2019

Formal Metadata

Longitudinal Spine - March 2019
Linking Functional Classifications of Government
Title of Series
CC Attribution 3.0 Unported:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Release Date

Content Metadata

Subject Area
Texture mapping System administrator View (database) Execution unit Source code Instance (computer science) Open set Client (computing) Computer font Semantics (computer science) Mathematics Different (Kate Ryan album) Query language Series (mathematics) Physical system Source code Computer font Mapping Electronic mailing list Bit Open set Frequency Series (mathematics) System programming Quicksort Functional (mathematics) Arithmetic progression Data structure Resultant Row (database) Slide rule Functional (mathematics) Disintegration Student's t-test Local Group Frequency Term (mathematics) Data structure Computing platform Addition Multiplication Dependent and independent variables Projective plane Water vapor Client (computing) Computer reservations system Semantic Web Query language Function (mathematics) File archiver Computing platform
Source code Functional (mathematics) Information Multiplication sign System administrator Projective plane Execution unit Range (statistics) Set (mathematics) Database Frame problem Order (biology) Word Mathematics Function (mathematics) Order (biology) Core dump Self-organization Series (mathematics) Data structure Row (database)
Web page Functional (mathematics) Game controller Statistics Linked data Interactive television Source code Virtual machine 1 (number) Set (mathematics) Computer reservations system Revision control Derivation (linguistics) Profil (magazine) Core dump Cuboid Physical system Self-organization Source code Information Expert system Interactive television Directory service Instance (computer science) Function (mathematics) Right angle Quicksort Data structure
Slide rule Presentation of a group Touchscreen File archiver Computer reservations system Cuboid Diagram Right angle Reading (process) Fundamental theorem of algebra Physical system 2 (number)
Suite (music) Presentation of a group Greatest element Information management State of matter Multiplication sign System administrator Equaliser (mathematics) Execution unit Source code Computer reservations system Set (mathematics) Mereology Formal language Mathematics Tower Row (database) Diagram Datenverknüpfung Series (mathematics) Office suite Drum memory Arc (geometry) Descriptive statistics Physical system Touchscreen Electronic mailing list Bit Flow separation Latent heat Process (computing) Internet service provider Self-organization Convex hull Right angle Information security Physical system Fundamental theorem of algebra Row (database) Web page Slide rule Trail Functional (mathematics) Link (knot theory) Computer file Maxima and minima Perturbation theory Numeral (linguistics) Number Latent heat Term (mathematics) Natural number Authorization Boundary value problem Data structure Normal (geometry) Form (programming) Execution unit Shift operator Information Quark Computer reservations system Software maintenance Moment of inertia Search engine (computing) Function (mathematics) File archiver Object (grammar)
Ocean current Principal ideal Presentation of a group Functional (mathematics) Service (economics) Link (knot theory) State of matter Multiplication sign Range (statistics) Source code Virtual machine Set (mathematics) Computer reservations system Shape (magazine) Mereology Wave packet Element (mathematics) Product (business) Number Mathematics Term (mathematics) Different (Kate Ryan album) Authorization Extension (kinesiology) Physical system Form (programming) Standard deviation File format Structural load Prisoner's dilemma Projective plane Moment (mathematics) Electronic Government Uniform resource locator Arithmetic mean Hydraulic motor output Local ring Spacetime Library (computing)
Presentation of a group Normed vector space Arrow of time Water vapor Functional (mathematics) Game theory Fingerprint Asynchronous Transfer Mode Local Group
Texture mapping Disintegration Mereology Food energy Element (mathematics) Power (physics) Order (biology) Term (mathematics) Finitary relation Energy level Form (programming) Identity management Source code Theory of relativity Matching (graph theory) Mapping File format Client (computing) Open set Equivalence relation 10 (number) Category of being Function (mathematics) Computing platform Self-organization Data structure
Functional (mathematics) Link (knot theory) Texture mapping Multiplication sign Source code Set (mathematics) Mathematical analysis Replication (computing) Neuroinformatik Term (mathematics) Different (Kate Ryan album) Finitary relation Set (mathematics) Authorization Energy level Series (mathematics) Multiplication Physical system Source code Multiplication Link (knot theory) Mapping Projective plane Mathematical analysis Planning Total S.A. Bit Price index Statistics Query language Personal digital assistant Self-organization Quicksort Physical system Row (database)
Linked data Service (economics) Functional (mathematics) Link (knot theory) Link (knot theory) Mapping Information Key (cryptography) Projective plane Electronic mailing list Set (mathematics) Element (mathematics) Data model Type theory Word Ontology Oval Different (Kate Ryan album) Series (mathematics) Autoregressive conditional heteroskedasticity Social class Statement (computer science) Series (mathematics) Error message
Probability density function Link (knot theory) Addition Mapping Link (knot theory) Computer file Projective plane MIDI Set (mathematics) Number Oval Set (mathematics) Musical ensemble Information Descriptive statistics
Point (geometry) Slide rule Presentation of a group Computer file Open source Graph (mathematics) Multiplication sign File format Computer reservations system Semantics (computer science) Product (business) Revision control Well-formed formula Different (Kate Ryan album) Single-precision floating-point format Query language Series (mathematics) Graph (mathematics) Information Relational database Projective plane Data storage device Bit Database Line (geometry) Translation (relic) Process modeling Product (business) Well-formed formula System programming Table (information)
Graph (mathematics) Information Graph (mathematics) Interface (computing) Graph (mathematics) Computer reservations system Database Database Product (business) Query language Series (mathematics) Graph (mathematics) System programming Query language Information Series (mathematics)
Slide rule Building Graph (mathematics) Graph (mathematics) Maxima and minima Client (computing) Drop (liquid) Client (computing) Area Visualization (computer graphics) Query language Visualization (computer graphics) Query language Interface (computing) System programming Software testing Queue (abstract data type) Information Summierbarkeit
Building Functional (mathematics) Link (knot theory) Graph (mathematics) Multiplication sign Software developer Execution unit Set (mathematics) Database Client (computing) Client (computing) Data mining Query language Visualization (computer graphics) System programming Query language Data mining Cuboid Self-organization Information
Presentation of a group Personal digital assistant Water vapor Integrated development environment Information
okay so yeah look at them I'll get into the project and so on and in just a second but it's it's the longitudinal spine of government functions that's the project name and essentially we're linking functional classifications of government for a few purposes okay I'm gonna progress there we go okay
so they're very quick outline I'm going to talk about the goals of the project the sources of data and that's when I'll bring David in because the National Archives is one of the sources approaches to concept mapping and in just a little a couple of other interesting bits about mapping governance and some technical systems that we're using I've got a bunch of additional slides sort of at the end of the project if anybody is interested in more detail about in particular term versioning and how to actually create an idea from non RDF sources oh and I should mention they're with me in the room here in Brisbane not that you can perhaps see him is that Jake who is a student from Griffith University doing all things Semantic Web okay so very quickly the longitudinal spine projects goal is to really improve queries about federal government structure and the functions of government structural units and some of the example kinds of queries that are possible now but that we want to enhance so make them more effective acquisitive and so on are views like this after particular change in government lists all the methods each matter and they're responsible portfolios so matter is a functional replacement government accordance with administrative arrangements which are a government and issued kind of obscure government instruction and so second query might be find all the portfolio say government portfolios responsible for a particular matter over a 10-year period so again this is entirely possible now but it's a very difficult lot of manual work and then finally another kind of example queriers find the National Archives of Australia's record series or multiple series for agencies carrying out the function veterans entitlements which might also be called war pensions in a different vocabulary or perhaps a narrower term seaman's war pensions so there's different ways of referring to that same term we want to get all the results so who's involved so currently currently the project is a platforms for open data depor projects and all these acronyms were there spilled out their partner in the lead of the project and then the clients and partners are Department of Finance and National Archives both are interested in the results of the project both sources of data that have been dealt with in the project and why is this about Cadbury's project and semantics project well some of the functions in government are already listed as semantic vocabularies and there's a lot of term differe overlaps and definitions that need alignments and so on okay so the the
framing of the data used in this project we've got government entities so these are agencies they have different words into the data sets but you know units of government and their assigned government functions and the functions can come be legal functions they can be policy you know there's a whole range of ways you might establish these functions and describe them and both the government entities and the government functions change over time and that just makes things difficult but that's where it is now the datasets that we're using in
particular in this project it's the Australian government organisations register a core that's about in finance the collection of administrative arrangement orders over time so that's that's really I guess issued by primary certain cabinets not quite sure who owns a per se but the National iPads have got them all listed as PDF documents and then we've text minders and the Commonwealth records series database that's a database that contains information about Commonwealth persons and agencies and their changes over time and the records that they've produced so you can find things like you know all of the documents of John Howard paper and also all the documents and pertain to particular functions and over time as well and then finally budget papers which include instructions on how government spends money in functional units okay so that's what many of the data
sources that we're using already themselves public so for instance the a core information comes out and is publicly available in directory governor you and on the left that you see just a landing a web page or CSIRO as described in the director dr. Denis system and on the right to be the purple text box you can actually get a machine readable export of that information from data.gov delay you so that's the there are other ways to access other data sets but most of the information we didn't with this publicly now the vocabularies of government
functions and there's things like the explaining government control interactive functions of thesaurus again from the National Archives there's a couple of international ones that Co fog is an international government functions classification vocabulary some internal ones like the Bureau statistics as government purposes classification and in the National Archives also have additional systems such as the CRS thesaurus and then there are things which are not always thought of as both habits of functions but sort of are for our purposes such as expert government expenses and listed by purpose and then there's some derivative ones like profile a which is an Australian government version of Co fault okay now
I'm gonna hand over to David at national archives and I'm the way I'm going to do this is I'm gonna bring up his presentation and I'm gonna see if I can click on the next slide for him as he tells me to wait one second David I'll let you know when we're on read I think we're getting it is now so Richard also another to Dan Rowan can you just tell me if you can see David's presentation on the screen yes okay great all right David we're looking at the first slide and far away okay so before you you should see a slide with the CRS system sitting on it with a very basic box diagram just the one you've got there it is now yes excellent okay so one of National Archives fundamental David in the Kenya because we're just seeing the first slide all right let me be reshare that's I know I've seen this issue before okay stop and reshare yes
we can see a record search screen now the CRS system Thanks excellent okay good all right so one of the National Archives fundamental roles is to make the National Archives accessible to the public and to support that we Chronicle the structure and functions of the comic was player by documenting the government at a snapshot in time and then the changes of those structures and functions over time and then link it all together by recording the entities of creation that's in the diagram and then you'll see agencies organizations and Commonwealth persons and literally these to the records that they create in accumulations of what we call series they're effectively information management units so that series and they they're made up of individual items they can be digital objects that can be records they can be files pretty much everything really this under pending is one of our fundamental archival practices and there is the documentation of Providence to authenticate the information we look out there in the public interest the CRS system which is more broadly known as the Australian series system is able to cope with frequent and lots of administrative change by keeping these entities as you see in the diagram separate so the entities of Korea separate from the units of the information that they create and then linking those entities together over time this Alexa quite different to how archives and public record offices operate elsewhere across the globe and we're actually slowly bringing the globe with us so peniston's 58 and making so family and we're still getting there so this means we can both the agencies and any records can be linked across time and accurately document the changing relationships between the agencies between the information management units series in the items and between the agencies in series so that's a very broad and brief description of the entire system there's a couple of links there that are provided in the presentation and some more information if you're interested so one of the simplified components as you've seen that box-like and is functions of government this is being represented at number of ways by National Archives with each evolving for quite different reasons okay so onto the next slide Nick Ceratosaurus okay cool right so we at the source is pretty much a standard the source which describes government functions it was developed to aid searching methodologies and tools for these provenance and Records linkages first introduced in 1991 as part of the forty-ninth suite that we had at the time it was last updated in 1999 it's a list of what was then contemporary so mid nineties broaden our terms that reflect the major functions and activities carried out by the common government agencies from 1901 to the mid nineties oh why are you jealous always going to say that serious you'll see on the slide there that's that's how it's accessible to the public through our search engine called record search you can search on terms there and they link to agencies when you click on the relevant terms and from there you can link to their records themselves and where you go there is also a list of these functions in summary form I'll provide a link to that available on their website that's pretty much it really so it's it's a the the main strength of that source is that it actually provides some historicity to what it's describing so it goes all the way back to 1901 as we found later and I'll get to that when I get there are number terms in a which typically no longer used in government but that's valuable because of government once you get language shift linguistic shifts and the boundaries of what functions actually are a shift as well so even though it's faded it's still very useful okay on the next one wrinkles equality
agency specific functions okay and so part of our work at National Archives is regulating the archives and permissions that allow government agencies to obtain and destroy government information we call these permissions records of bogeys and they include the retention of maintenance of National Archives records as well functions there the on the slide there you'll see an example of one records authority at the the bottom of that page you'll see records covered that's practically a functions list for the agency at the time it was issued to that agency the functions have been used to classify agency business from around 1999 and we revised that methodology from around 2007 by effectively simplifying it but we still have these functions for each of these records of our Commission's these functions are tied to the agency that the regulatory gets issued to at the time of the issue and so whenever there's a machinery government change over time with more changes in government we tend to lose a bit of track as to which agency is responsible for what this is the nature of how we do the Commission's under the archives in the business relevance of SEC records authorities is dictated by the state of change of the agency business and caused significant change triggers that review process to update the permissions that are embedded in the records Authority they also have seen on that slide there's some links to a gift terms this is the place where we link records authority functions to top-level active terms so that's that's a useful linkage between node in terms of what I get this for but I'll get there in a second so the third data set that we have is a gift itself that's on the next slide next yeah okay so I'm assuming
some of you will be more or less across what ain't if it actually is I provided some links to provide some more explanation about of that but this is one of our more recent products it was a initially developed in 1999 and for those of you that was around many that was part of the government's initiative to make everything digitally available for government services so there was a thing called a this trained government locator service which is now Australians David was made as trans then in 2010 and that had classified elements for subjects and functions that wasn't made any particular difference between those two that they were separate entities a gift is the the functions part of that for those who were familiar in the library world they developed at the time something called tags the source of Australian government subjects being like there's pretty much as old as the sirasa source so getting back to a gift it describes a high-level business functions carry across common state and local governments in Australia provides standard terms for government agencies to use and part of the idealist system so it's a resource locator aid in prison discovery visibility and accessibility of online government resources and was significantly revised in 2005 and we provided it in much more consumable form online a couple years ago National Archives joined the longitudinal spine projects as a means of lots of much keeping these vocabularies current but being able to link these together and across other government vocabularies to enhance our existing young accessibility roles across time in this space in terms of changes over time National Archives have realized we're pretty much the only government agency that actually pays attention to the changes over time then it kind of actually documented in some shape or form that's that's particularly the crs system these they can't believes that hang off that to a certain extent what we have we know they are limited and we want to be able absurdly in the press government and this spine project is providing very exciting means of enabling that across big data systems right across camera and we're starting with the finance data sets but there's many more out there our principal source of authority for most of this stuff starts with the AOS that's the initiative range motors and again not being manually analyzed because there was now the load doing it and the spine project is starting with iOS to get them more machine consumable and make them more accessible this is really good and licking our vocabularies across spine is going to help us in our work and and across government as well what we would like to do is maintain these data sets that this bone project is generating to continue to make them available for reuse in in the machine visible form which was the not at present because they're perfectly seeing on our website apart from a gift which is available a number of different formats and you'll see when you follow the linkages that's pretty much all I wanted to say at this stage so back to Nick thanks David ok now I'm gonna do the switcheroo back to my presentation folks and let's see I have to stop fearing and reshare very
quickly but it should be back in just a moment ok so they're only yell scream
and otherwise you can see my own
yeah we can see that we can see it but not in presentation mode we cool right
that will be kicking in about now
hopefully yeah ok so we not assume that
to where we were
okay okay so it's oh that's so you've got an overview of an organization there that got a lot of vocabulary some of which are in the forms that we can that we like to use and others which are not but before we get into some technical details very briefly about fiddling around with formats let's talk about
approaches to concept mapping generally okay so the vocabularies that are stored in a semantic form and in the particular semantic form that we mean is its Casas I think it's a format really to wall and when I say semantic form I mean a form where the individual elements of the vocabularies have an identity and have named relations between parts so if we've got two but you know Scots or more similar form we can assert you get called deliberate mapping and we can ascertain that things just between them so we can say you know difference in one functional vocab really is equivalent or is an exact match of Defense in another one or something like that and when we do that we get inferred mappings as well where you know some terms of Defense in one becomes up terms of whatever the defense equivalencies and the other and so for the for those kinds of power companies we're dealing with in longitudinal spine this is the main where we get to do mapping because at the high level I should say because you know we're only talking half a dozen it doesn't read categories of tens to hundreds of terms it's not not like they're not very calories of many thousands of terms so we have or we will make deliberate mappings between these vocabularies so the second way we might
do this and vocab remapping noticeable interesting way in a way long spines set up to operate which is where we have deserts such as collections of government organisations that classification classification why are mapped to and then we can start informatics between these vocabulary terms and David showed a little bit of that before those deliberate mapping between the the lower level records disposal authority functions and the higher level a gift and terms that's a deliberate mapping but the data set that contains the total collection of agencies and their record series and so on kind of contains all of the above deliberate mappings and this these these sort of indirect mappings between where different systems have been used different classification systems have been used to classify the same data set at a time and so you can see how we would just say that you know 80% of the time when you see defense and the blue-collar men equates to you know defense and other things in the red column and and that kind of mapping is emergent and from their data when we've collected in the way we're planning on doing okay now
mapping governance all right so the sources of the dates that we're using them cab reads themselves are fairly uncontroversial as I'll indicated before most are already published most have single owners so the National Archives that this data said financed at this bit cetera but the mappings between these data sets are potentially conventions because people can have different replications of how terms met and these are necessarily multi owner things when you're doing a mapping because you've got well not necessarily often there are where you've got two data sets you're doing a mapping between them and each data set has a different owner so what we're doing and we're doing this in many projects but we're publishing mappings between standalone data sets as individual data sets themselves and we call those link sets and so they're specialized data sets of just do mappings and then link sets are used instead of mappings within a vocab so we don't have a vocabulary of terms and then within there you see mappings like you know another that's not always the case someone already contained mappings that's fine but when we're creating new mappings we put them as separate link vocabularies and then the user projects data are able to include or exclude individual link sets from analysis and as they go so they can say I want to do such-and-such a query oh and by the way you know I prefer to use these link sets rather than those want something like that now just a small indication as to
where these link sets and things come from so the low key project another link data project which is not specifically vocabulary based it has a concept of link sense to that link spatial data sets together and here you see the low keys and over arching model that if you could be bothered to follow all the errors you can see that it's quite Dennis Setzer Scott link said sling sets the kinds of data sets and doesn't say it in words but the link sets are for a mapping between other data sets and we're reusing that same link set concept we have different types of information that we're linking between compared to the Loki project but the the function the functional place of the link sets the same and what's inside a link set so I'm
not going to explain this in great depth but you see a series here of for evil chunks of information each of those is the link expressed in an odd way between two items with qualifications in those in that linking and that's what the link sets contain long lists of these kinds of mappings now this is from anarchy
project this particular example but this is what a link set looks like there's a written description of what it is and there's a bunch of files which we've published which actually contain those mappings and the locally projects
published nine or so links that's a set of them that you can see there and the longitudinal spine project is going to publish a certain number of links it's not quite sure how many yet but it's it's where we've got an assertion of mappings between either to functional vocabulary the vocabulary or and a data sets yeah okay now I'm gonna live
through this very quickly and if people are interested I can stay on the line and just go to town on the technical information and I've got a series of slides after the end of this presentation that contain more technical goodies so for the quick note on for vocabularies that are not themselves already in idea for semantic point just done this with the crs thesaurus that David mentioned where we've taken the concepts now they are available online but they're also available in the relational database table and we've got them into Excel we've used formula to fiddle around with limit and and to extract bits and pieces and we've dumped that to a file and then we've validated and normalized that file
again if you want to see the actual steps laid out I can show them at the end and we're using a single day triple store database which is an RDF database to contain all the databases and mentioned in the project this makes peering easy and we're using the graph DB product there's many different open source and commercial triple stores out there graph DBS is initially a free one and it also has a commercial version and we just try different products from time to time and in this project we using graph DB that's what it looks like it's
an interface to manipulate or to manage the data and what you see there is a series of individual graphs of information that are stored within the database and so you can think of the graph as a database schema like a individual schema will have been a total database and if you look carefully you can see things like a gift CRS etc in there and we're making a
queryable UI sorry a query UI to grant technical access to all the information that long spine generates it'll look
something like this you can drop sparkle queries in there and access all the data in all the graphs that we just saw in the last couple of slide and we're developing example queries now so that people can know the kinds of queries we think they might want to run and of course they can innovate on top of that and make their own and finally we're now
entering into building specialized clients for exploration and visualization of the data this is just
one out of the box we've grabbed you be but it's the kind of thing that Richard spent a lot of time building for aidc to let people click through complex structured data future work
data mining across our data sets and vocabularies to try and establish some of those statistical links that will will emerge making you have example queries client developments and then ultimately tools for our other people to create lean sets across government functions in organizations units so that we don't have to do them every time that they might want to do them themselves ok
- that's the one will end of my presentation