We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

ODVIS.AT - Visualization Of Austrian Open Government Data

00:00

Formal Metadata

Title
ODVIS.AT - Visualization Of Austrian Open Government Data
Title of Series
Number of Parts
95
Author
License
CC Attribution - NonCommercial - ShareAlike 3.0 Unported:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal and non-commercial purpose as long as the work is attributed to the author in the manner specified by the author or licensor and the work or content is shared also in adapted form only under the conditions of this
Identifiers
Publisher
Release Date
Language
Production PlaceNottingham

Content Metadata

Subject Area
Genre
Abstract
ODVIS-AT is a project funded by the Internet Foundation Austria and Salzburg University of Applied Science. The goal is to display open data (demographic, open government data) in a quick and easy way to end users. In 2011 the Austrian cities Linz and Vienna launched two Open Government Data services where information was published in textform (csv, pdf, json, etc.), other public authorities joined soon (find a current list at data.gov.at). In an attempt to make this data visible we started the development of a visualization service in 2013 where published data is linked to geodata and the result is put on a map. The project consists of an internet portal (odvis.at) and an api to query the data and allow personalization and combination of information. At the moment the project is still in development phase but scheduled to be finished in September 2013. The project adresses a public audience as well as researchers, journalists, students and developers. Data can be accessed from a central service that provides a snapshot of currently available government data. On thehe backend the visualisation is rendered as a graphic layer to be used with Open Street Map, using Mapnik and a postGIS module. Rendering on demand allows filtering, combination of data sets, mathematical computation (via the api) and hence the personalisation of the information display. In the presentation at FOSS4G we would like to show the project status (finished version should be ready) and experiences with the project.
Projective planeQuicksortNeuroinformatikWebsitePhysical lawVisualization (computer graphics)Computer animation
Set (mathematics)Set (mathematics)AuthorizationState of matterObservational studyOpen set
Maxima and minimaStatisticsState of matterInternetworkingOpen setInterior (topology)Physical lawColor managementRange (statistics)Codierung <Programmierung>Different (Kate Ryan album)Level (video gaming)Data conversion3 (number)Finitary relationExecution unitMetropolitan area networkInfinityWide area networkHill differential equationLipschitz-StetigkeitEmulationVisualization (computer graphics)View (database)Table (information)ParsingLink (knot theory)InformationMeta elementQuery languageSoftware developerWeb serviceWorld Wide Web ConsortiumFeedbackSet (mathematics)Computer iconPhysical systemClient (computing)Online helpBasis <Mathematik>Standard deviationLocal ringVirtual machineSet (mathematics)Moment (mathematics)PlanningAdditionWhiteboardPoint (geometry)Basis <Mathematik>Data miningProgrammer (hardware)Level (video gaming)Execution unitOpen setComputer simulationPhysical lawRadical (chemistry)Term (mathematics)State of matterDatabaseInternetworkingNumbering schemePerturbation theoryWeightMereologyConstraint (mathematics)Multiplication signArchaeological field surveyMenu (computing)Group actionCore dumpTheory of relativityStandard deviationQueue (abstract data type)CASE <Informatik>Computer programmingWeb serviceWorkstation <Musikinstrument>Key (cryptography)Image resolutionAuthorizationNumberCross-correlationProjective planeView (database)BitFerry CorstenInformationMathematical optimizationMappingUniverse (mathematics)Server (computing)Student's t-testInformation systemsOrder (biology)Physical systemData conversionWave packetCommutatorVideo gameCodePower (physics)System administratorFeedbackWage labourCodeVolumenvisualisierungParsingComputer fileStatisticsSoftware developerFile formatEquivalence relationGeometryVirtual machineSelf-organizationVisualization (computer graphics)Process (computing)WordComputer animation
Transcript: English(auto-generated)
Hello, yeah Good Okay
And it's Marius Schabler who's here to talk to you today about visualization of Australian Austrian Thank you So I'm going to talk about the project we were working on at the
Salzburg University of Applied Science, which is in Austria It's a project that's also funded by Austrian Internet Foundation and And It deals with open government data, so in 2012
some authorities in Austria started to publish data sets This is a picture of the city of Linz who was the first city in Austria who published data government data right now They published 127
data sets This is in Vienna. Vienna was the second city At the moment they published around 182 data sets so in Austria all data sets that have a creative common license and deal with demographic or
Government data are collected in this web service called data GV 80 It's based on secan and as you see There are cities there are federal states, then there are also
national Organizations and also communities who share data to the public There are 20 different publishers which makes The the dealing with the data difficult here you can see the
Authorities that publish the most data sets which is Vienna and Linz then there's a small community also in Upper Austria, and then there is the federal state of low upper Austria and also cities and so on
We have six cities that publish data we have Six of nine federal states at the moment that publish data Including Vienna, which is at the same time a federal state and a city there are two communities, and there are seven national organizations like
Publishing financial data or stuff like that So when this happened in 2012 in the summer I came up with this project idea to visualize all the data on the map I Wrote a small proposal for a grant that's
funded by internet foundation of Austria and The project started in January We have three people working on it Which is me a colleague of mine and a student actually we have two students working on it and the plan was to visualize open government data and
My personal intention was to go with with the visualizations to all the authorities and tell them hey look this is Population data everyone else published, but you did not can you put your stuff online? Can you put it under under a license that will allow us to share it and to allow people to use it?
So we are working on this Web service which I think at the moment is not Accessible because it's still a work in progress, but the idea is that you go through a navigation menu you choose your data set and You can find
The data that's there Visualized on a map combined either with OpenStreetMap or Even Google, but we are producing only the red parts of them So the one example was from Tyrol this is
Stereo if you go closer you see that We look at data on the granularity of communities The data sets come as CSV files also as some other in other data formats, but
For us it was the easiest to use CSV files. This is an example of what we get And I want to say this is a good example because it contains More or less official terms which is
NUT nuts code and also allow code la you to code Which is pretty standard and we can work with that. There are other data sets That have a labor called with sick, which is a district and it's a number it's Number just with one two three four five so we have to make some correlation with a real
Community so that we can put it on a map. The other problem is that the data sets are Some of the data is not encoded correctly. We have to deal with a lot and stuff like that The biggest problem at the moment was that there was no official release of
communities and of Austrian border data There is an official place where you can access or buy that data, which is Statistic Austria But even if you buy a data set in a high resolution, you're still not allowed to
publish it and to give it away so We Had to find a solution for that then Since I'm a newbie to geo information systems I really had to learn everything from nuts codes to law codes their equivalents in open street map
and Then in Austria, there's also specially a special case, which is Vienna Which is different because Vienna is labeled under one Law code, but it has almost two million
People living there. So the granularity is totally missed if you want to compare a community with Vienna So in Vienna, there is a community code with which I think is special for Austria That's that labels or that stands for the districts the city districts of Vienna
Um Yes, we we filtered from open street map all the communities and federal states and From the cities we got two maps from Linz and from Vienna and we had to deal with conversions since they are in different projection
Coordinates and then we were so proud when we had our first map But the problem was there were still holes in it and that's that the reason for that was that The relations in open street maps were not always correct. So we tried to fix that and
We used Yes, basically we use these OSM relations We also committed some of the fixes, but I saw that people already fixed our fixes. So probably we're doing something wrong
At least we got something to show on the map Then there is another problem in Austria that's in the year 2013 three districts were combined so that they Six districts were combined so that they formed three new districts of the borders changed
We also had to find a solution to deal with that and there are also joins of Communities so the problem with the open street map data for us is that it's too current. We actually would like to have a good Dataset of 2012, but we are
Creating the data set of 2012 So Let me talk a little bit about the specs We're parsing the original CSV files into a postgres database
As you saw before a lot of hand a lot of manual work has to be done. We have to look at every single Dataset try to understand what it means My hope is that in the future If we have new releases of the same data sets like from 2013 or 2014
Our parses will still work and we can just run them again with new data Not sure about that We yes we have Datasets for every year for example 2012 2013 and we are combining them in
Postgres interviews so that they are accessible for For the renderers and also for for developers We are working on a developer API so that all the data is available through some JSON format
which is not possible at the moment because You can only grab the CSV files from this data GV portal but not the data itself and Our plan is to have a web service where all the data is visualized for People that's just who are just interested in in
An overview but on the same side have a developer API where you can adjust The the data and the styles of how you want to render your your data on an individual basis We are also we also learned that
With some data sets. It doesn't make sense to just publish them. So you need background information and we also want to give The people the possibility to write feedback or to write comments on what the data actually means what Might be notable about the data we are running on our school infrastructure, so
We will see If this will still be enough when more people will access the service That's an Ubuntu system with Postgres database and
mappinik and Then also for a newbie to of to do information render us We it was difficult for us to choose which technology technology we really should use We have the University of Salzburg who has a big
This department they are using geo server, but we Thought we would go with mappinik and also windshot because might look better Please help us improve this deck if you if you have ideas Yeah, we promised to be online by September 2013, obviously, this is not the case
We will extend the first release By Probably two months. We're still passing and uploading data Since We have to look at every data set and there are a couple of hundreds right now. This takes some time
But as long as we are funded we can do that work and I think it will help public We are also trying to find funding for the upcoming years that's clear we have to we want to maintain the service We want to publish information on a yearly basis because that's how data sets are
Actually released or a lot of them are released on an annually basis We also have problems with the naming of all the all the data columns You can think of data of life births that will give you a clue for a column
How many children are born in a community or in a Community in the district, but then there are also things like Children per 100 working people and I wonder if there is a thesaurus or some standard demographic
Term terminology that we can use And if not, then we are trying to suggest one also to our Administration to be more consistent in naming their their data
Yeah, we also would like we are already in contact with the local authorities to Work on that naming scheme and also to work on a process how They Could publish their data in the machine readable format so that's
That we can grab it more easily than just parsing CSV files Okay
You
Yes You can always have the dump of the database maybe we will have an API that has one button that says download everything or
You can contact us and grab it dump of it It's Look in October, but the whole data will probably not be there until end of November
But thank you very much. It's no, I don't know the abbreviation. It's it's an international standard to to label administrative borders, so the la
It starts with nuts and UTS which is a State for example, and then if you're going down The administrative levels at some point you are at the LA you codes and in Austria
This is a community commander Which is approximately between I don't know 1,000 and 10,000 people Living in in such a community In Austria, we have different words for that which is commander cancer and commander code, which are two different