GeoDataStore; governmental open data cloud storage and easy metadata creation

Video thumbnail (Frame 0) Video thumbnail (Frame 660) Video thumbnail (Frame 1314) Video thumbnail (Frame 2437) Video thumbnail (Frame 4150) Video thumbnail (Frame 4952) Video thumbnail (Frame 5342) Video thumbnail (Frame 8327) Video thumbnail (Frame 9769) Video thumbnail (Frame 10850) Video thumbnail (Frame 11914) Video thumbnail (Frame 13406) Video thumbnail (Frame 14655) Video thumbnail (Frame 15291) Video thumbnail (Frame 17821) Video thumbnail (Frame 21228) Video thumbnail (Frame 22029) Video thumbnail (Frame 22498) Video thumbnail (Frame 23834) Video thumbnail (Frame 28559)
Video in TIB AV-Portal: GeoDataStore; governmental open data cloud storage and easy metadata creation

Formal Metadata

GeoDataStore; governmental open data cloud storage and easy metadata creation
Title of Series
Part Number
Number of Parts
CC Attribution 3.0 Germany:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Release Date

Content Metadata

Subject Area
At the beginning of 2016 the Dutch SDI organisation ‘PDOK’ has released a cloud service to facilitate spatial open data publishing. PDOK is a cooperation of several public bodies: Kadaster, Rijkswaterstaat, Ministry of Infrastructure and Environment, Ministry of Economic Affairs, the four big cities Amsterdam, The Hague, Rotterdam and Utrecht, the Open Data project, the collaborating provinces unified in IPO and Geonovum. Each governmental organisation in the Netherlands can use the service to publish spatial open data sets. The goal of the project is to make data publishing as easy as possible, while being in accordance with the applicable open data standards (iso19139). The developments are based on GeoNetwork opensource and made available on Github. Metadata is automatically extracted from any uploaded dataset or taken with default values, so an user has to supply up to only 10 properties of the metadata in an easy to use form. In the presentation we’ll demonstrate the application, we introduce you to the policy aspects that led to these developments, explain the choice for Open Source Software and future steps of the project.
Web page Presentation of a group Inheritance (object-oriented programming) Entropie <Informationstheorie> Simulation
Digital photography Presentation of a group Standard deviation Open source Regulator gene State of matter Open set Endliche Modelltheorie Information privacy Element (mathematics)
Dataflow Web portal Standard deviation Group action Web portal Projective plane Open set Line (geometry) Limit (category theory) Open set Particle system Process (computing) Self-organization Data conversion
Mobile app Identifiability Computer file Connectivity (graph theory) 1 (number) Open set Data quality Metadata Element (mathematics) Formal language Profil (magazine) Extension (kinesiology) Form (programming) Standard deviation Information Software developer Interface (computing) Electronic mailing list Metadata Library catalog Cartesian coordinate system Category of being Type theory Integrated development environment Self-organization
Area Domain name Ocean current Presentation of a group Identifiability Copyright infringement Code Projective plane Electronic mailing list Numbering scheme Bit Library catalog Open set Instance (computer science) Dimensional analysis MiniDisc Data conversion Extension (kinesiology) Computer-assisted translation
Metre Software Computer file Software developer Phase transition Projective plane Mathematical analysis Library catalog Metadata Geometry Attribute grammar Product (business)
Revision control Presentation of a group Expression Video game Open set Cartesian coordinate system Perspective (visual)
Functional (mathematics) Presentation of a group Computer file Code Open set Metadata Element (mathematics) Formal language Natural number Cuboid Descriptive statistics Area Link (knot theory) Touchscreen Scaling (geometry) Matching (graph theory) Information Electronic mailing list Mathematical analysis Set (mathematics) Cartesian coordinate system Limit (category theory) Open set Type theory Category of being Arithmetic mean Uniform resource locator Software Personal digital assistant Data center Text editor Bus (computing)
View (database) Interface (computing) Menu (computing) Library catalog Gamma function Pressure Maß <Mathematik> Field (computer science)
Axiom of choice 12 (number) Execution unit Presentation of a group Matching (graph theory) Information MIDI Function (mathematics) Set (mathematics) Metadata Field (computer science) Text editor Gamma function Window
Computer virus Service (economics) Computer file Open source Link (knot theory) Rule of inference Metadata Field (computer science) Web 2.0 Mathematics Office suite Form (programming) Physical system Mapping Copyright infringement Validity (statistics) Block (periodic table) Projective plane Content (media) Sampling (statistics) Bit Lattice (order) Library catalog Cartesian coordinate system Data management
hey if the so the web pages
presentation together with their parent follows from the Dutch could answer and i'm ball from Japan and so disorders Larger data stored and maybe it's so
using the presentation just now from Don governments but also the public is struggling with open data which open it is available uh to solve our problems or even if they have a problem with that in the identified it they need data to solve the problem but gasses and in the photos you and technical issues is 1 of the issues but also policy issues and
In elements we have quite some regulations on open data and open standards and open source duration of the regulation of states OK everything that you have should be opened a and unless there is some reason it's not to be open data and mostly privacy issues open standards you can also models have to comply with open standards and this is really the as you have to explain why you are not using open standards maybe there is no open standard for 2 things an open source is a recommendation the we have a lot of
open data portals in the Netherlands and which is not bad all the but it is really important that all of them are connected in a way so if you go to 1 of those portals you're able to find all the data which may and maybe would 1 of the regional portals and and there's no use like harvesting particles and so on the top you have the kind of induced spatial portals and below you have Open Data portals in then this is also where you see kind of did the data flow going and the lines I only draw this 1 so from the national geoportal there's all open data is harvested to the National Open Data Portal 1st this summer conversion here because this what users get which is an open data kind of standard and that 1 uses the eyes that we all know
have so the and you start a project to facilitate the the 1st step in Open Data publication it was identified that did a lot of but the government's organizations have difficulties to publish open data because they have technical limitations so that was a very big group of organizations joined up to say OK how can we better facilitate them in this process of Open Data publication and they they
decided to create a self-service upload applications which should be very easy to use but still it should conform to standards
as so we need some requirements were defined and reuse of existing components and is only an upload applications that has no search interface the search interface is in the catalog and the ones that already existed so it's just as and uploads applications also they decided that maybe costs thing to do and not do any and data quality assurance that's that's left to do publisher and and having in that an an easy-to-use API was 1 of the requirements to so people are dare developers are could easily build apps that uh published Open Data using our API the so what what do you need for easy metadata creation of we all know it's data and you can be cumbersome to to to create it because that especially ISO as all these extensions and in big big forms and all we did here we we said OK let's let's only focus on on what DD Dutch profile animated profile requires a fill in and escape all the optional elements and hence it is the 1st step so so and then make that publication as easy as possible then use standard values for all these properties like language is Dutch because we're all Dutch organizations and don't don't and don't ask people to language and then use the values from the environment so who is allowed in user what it what type of file is uploading those information and you can use to identify contact information automatically so he doesn't answer provided and what possible use pick lists
this was it was another requirement which complicated bits but city it necessary Amadís this disk scheme of all these open data catalogs so we have the open it again logs and we have the spatial catalogs we wanted to facilitate both so we also wanted to and a facilitator did you get convergence this is possible if you filling your eyes emitted a dinosaur way it facilitates get convergence so for example instead of giving you the books for your extent of your data and use a geographic geographic identifier and like it's it's it's not in this area but it's in the area of dimension and user code lists which I used in the Open Data Domain and you say your else and instead of neuron
so it's appearance stages of the project and there they did that needed the due date is so was was published last November I think in the 1st instance so they hired a pirate to make a big presentation and fun of deduction and it J. has conferences the gasses so we're a bit disappointed on current usage there I think there for 40 years datasets now but we we identified at that a governments are quite slow in adopting new technology and there's so so we still have very uh high expectations of of the usage that I don't want to go into
this is this is is is bears that you did it so as Messenger network we made a couple of customizations and we're still discussing with the community how we gun emergent upstream and which is always an account of a jealous if you make big steps in the development and then and after I could have said would be good if we had communicate communicate with that community in an earlier phase and this 1 is good to in the bears this afternoon to discuss at the bar so what's
next so currently we don't analyze a file which I think is a shame because we should have is a valid file and does ever develop projection and is it in and doesn't have valid geometries and this would really help that the consumption of the file by by end users and but all of the DNA product uh wanted to keep it low thing but is so if you do server-side analysis which could be in except in the project then again you could also get more metadata from the files like what are the you the future attributes and then converge into an ISO 1 9 1 1 0 meter data so did feature catalog metadata or you could even set up a WMS WFS automatically on top of that uploaded file the
yes this is it is it is a good question I think is seen in and others we this expression is a year and a something and an electron and over the wall and never think about it just just leave it there and which from Open Data perspective is going away because you want to you want to add data to be engaged in a in a in a discussion that within the data is a life of there she just put it there and never look at it again and is even and so this is a rather get a relevant question is simple good enough for them so the answer should be no I think but is the 1st step so so now we are at least there is data and then from here we can start a discussion well that this is an old
version of the presentation because I haven't shown you the application itself I will now how many minutes 7 looking the emittance changes I'm gonna try demand the you the the the for for all
so we see here this is the skin on on top of network can and and so we we kind of deactivated all the search functionality just straight go into the log-in screen and to the editor and editor has as 2 tabs which is still unpublished metadata and the published metadata and it since it's it's an upload application you start by uploading the data file so you can select the file mean take this nice presentation by a by adding the is uploaded and then I can click it here and
again uh had to make the data so so we're gonna this limitation which is from the original should only contain at most 10 fields and and we can succeeded so title this description there's subject of data and today isotopic category there's a keywords and the language information so how was the dataset collected and this is the the identifier and geographic identify we we choose usually in metadata editors you have this you have to draw box to to in some areas you have a look at the data center to see where it is In this case we we choose that from a code list some locations so for example Amsterdam what should you should look this and yes this is so always receive who the you will so so a if you have a dataset which doesn't match any of these areas you and then then there's a problem you you probably best off to take a higher and things like a province or as a so so when you do things on a simple way you have to make choices but but we have like in nature areas in years so we have a wide range of of uh areas area types we have cities we have the streets but also in regional names for 4 areas the license is very important because this 1 is used as a filter for the Open Data Portal so so we have a fixed set the analysis of a fixed set of licenses that we should use to to make sure laughs harvest by the Open Data Portal and In the scale is is a required element in the Netherlands and then you can select the picture and that's it that that there was all the information we we had to and the rest is derived from the logged in user the file itself and you publish it
and you get to the things that you previously published you can
Click on here and see how it looks here but you can also look at it in the national
catalog this pressure due to the search interface of the national catalog and and you get like the full view here I'll still pretty TD in so that this is the eyes a document was created from from the the fields so you see there that the
contact info is here that was taken from the logged in user
and so on so where the Arab output this presentation is that Metadata Creation need not be difficult but just to make choices and what when you do simple things again a label yes you have to to skip a complicated things would again be a 1st step for for people to start publishing metadata because now there is no metadata and this this is better than nothing and from here you can start a discussion that people can comment on this like hate this does doesn't match and and people can always go to the advanced editor to to add or change other fields OK questions I'm I'm familiar with the data set with a lot the questions I have is and how
do you manage to content that is quite easy to end pure holiday pictures or something like that and they say any kind of content management and it is a good question and personally I I was a bit hesitant on the fact that they were that they hired a pirates as as the 1 2 presented the thing because pirate are associated with the illegal movies being uploaded as we as be OK don't do any and validation of files but you as an uploader and will know that it will be published in national catalog you should be aware of that when you upload your holiday pictures and yeah it it wouldn't and it is indeed a kind of the the other thing too would is again let's put it out there if we see that issues were work on it no change in the rules so things are always a bloated under a name you cannot upload anonymously here so we can always call you like he wanted to put all the pictures any questions yes please go on people who have to do with this 1 ball yes yes so the 2 data 1 step further is there any moderation and know is there we let the community more moderated however if you like it 1 of bloated viruses or something that does not possible that's blocks on the final kept OK meeting 1 more more question am I saw examples all files so as he presence of like asking also in upload services like web mapping services to to the office of Mr. this and note this is a voluntary and this is a sample of blood application um from it but from here we can we can create a WMS or WFs from it yes and the same also if you look at that the and and this is an open source project as you could continue and this 1 is alive and will will grow and show and next step could be dead instead of a file we give a disservice and actually I think is is really useful because then you can create to service metadata and the dataset may metadata from just 1 simple form and you and all these uh UUID links between the service in the dataset will be maintained by the system is set of somebody copy-pasting ideas in in different fields s and go please give a big hand tools