GeoPackage and how open source is changing the way governments think about standards

Video in TIB AV-Portal: GeoPackage and how open source is changing the way governments think about standards

Formal Metadata

GeoPackage and how open source is changing the way governments think about standards
Title of Series
CC Attribution - NonCommercial - ShareAlike 3.0 Germany:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal and non-commercial purpose as long as the work is attributed to the author in the manner specified by the author or licensor and the work or content is shared also in adapted form only under the conditions of this license.
Release Date
Production Year
Production Place
Seoul, South Korea

Content Metadata

Subject Area
Government is a great sector in which to use geospatial technology to solve problems at scale. This geospatial technology typically has varying degrees of quality and cost as you would expect in any market. Combine the two with the fact that the ecosystem of systems, large and small, is very diverse, creating varying challenges. With this in mind, governments are now realizing how their decisions impact their future capabilities. In this talk, we will discuss GeoPackage, an OGC encoding standard and the challenges it was created to solve. We were encountering a problem with how data was being created, disseminated, and used. With the rise of mobile computing devices raster images in various native formats were being disseminated to a wider audience to use and visualize information. These raster images were typically enormous and uncompressed in some cases and compressed but painfully slow in other cases. Computing resource availability varied across computing environments. Some end users were converting these large raster images to more friendly or optimized formats to do their daily jobs. This leads to massive data reprocessing efforts across many different areas, all of which are mostly avoidable if the source would simply produce relevant, fast-performing data in a format that satisfies the broadest audience. Many vendors have tried to solve this problem with their own custom or proprietary solutions. Full stack vendor solutions come with hefty price tags in the form of licenses, support contracts, or sometimes both. These solutions can and often do solve the immediate problem however they have side effects that reach far beyond the immediate. Vendor-specific technology islands therefore appear, beholden to a certain proprietary implementation simply because it would be too expensive or too involved to do otherwise. Proprietary data created for one system did not necessarily work in another system. Tools needed to be created, re-created, or modified to handle formats that did not work on their target platform. Data interoperability between geospatial groups is the first casualty. Glue code is then created to bridge the gap between the offending incompatible data and the desired data format of the new end-user. Government entities are quickly realizing that this makes no sense. Extra processing causes bottlenecks in downstream workflows and can quickly cause untenable requirements in areas like disaster recovery. Incompatibility in data makes it even harder to share crucial information between government organizations and non-government organizations alike. It is with these types of open standards that governments can maintain the control of their data creation and management. GeoPackage was created to free data from the constrictions of proprietary formats and is already paying dividends to government groups. Current GeoPackage development tools will be discussed as well as how early adopters are leveraging this new data specification and subsequent tools to push geospatial products to the end user.
Slide rule Greatest element Service (economics) Open source Observational study Insertion loss Mereology Theory Estimator Goodness of fit Different (Kate Ryan album) Reduction of order Information security Mobile Web Collaborationism Dependent and independent variables Standard deviation Software developer Projective plane Data storage device Analytic set Bit Instance (computer science) Line (geometry) Cartesian coordinate system Category of being Data management Word Process (computing) Computer animation Software Integrated development environment Personal digital assistant Linearization output Game theory Window
Group action Service (economics) Computer file Sequel Open source Divisor Multiplication sign Decision theory Numbering scheme Client (computing) Open set Mereology Product (business) Wave packet Goodness of fit Strategy game Different (Kate Ryan album) Single-precision floating-point format Database Cuboid Energy level Extension (kinesiology) Information security Skalarproduktraum Form (programming) Collaborationism Standard deviation Multiplication Mapping Tesselation File format Projective plane Data storage device Mathematical analysis Electronic mailing list Planning Bit Cartesian coordinate system Vector potential Residual (numerical analysis) Word Message passing Computer animation Vector space Telecommunication Quicksort Library (computing)
Android (robot) Presentation of a group Context awareness Mobile app Service (economics) Open source Link (knot theory) Divisor Multiplication sign Connectivity (graph theory) Combinational logic Graph coloring Number Product (business) Medical imaging Goodness of fit Root Different (Kate Ryan album) Single-precision floating-point format Database Energy level Data conversion Physical system Multiplication Standard deviation Tesselation Closed set Software developer Projective plane Cartesian coordinate system Process (computing) Computer animation Software Personal digital assistant Quicksort Library (computing)
Web page Ocean current Server (computing) Mapping Divisor Link (knot theory) Open source Information Sequel View (database) Sampling (statistics) Modulare Programmierung Cartesian coordinate system Word Process (computing) Computer animation Different (Kate Ryan album) Database Metropolitan area network Library (computing)
Context awareness Building Server (computing) Service (economics) Open source Multiplication sign Online help Mathematics Latent heat Velocity Forest Conservation law Selectivity (electronic) Extension (kinesiology) Area Standard deviation Key (cryptography) Forcing (mathematics) Mathematical analysis Analytic set Hand fan Uniform resource locator Computer animation Vector space Right angle Figurate number
and in
a few I will go morning and I thank you for coming and even France and I am a project manager of the problem more portly research geographer with the US Army Corps of Engineers and I'm gonna be joined by Dr. bent on rejecting all in traditions of mourning gets the disappeared from this but for the most part what can I tell a story about how germinating seeds a strike to adopt this idea of open source software and and and obviously it should be noted it's slowly and it's for security purposes but what what we're finding is obviously the games that we have by actually doing so it's it's only you know what we're getting out of course what we put back into it of anything it's that the government funds of course this is Lisa hot already kind of older property of US citizens so it's not that big a leap to say well it's the sensors and when I get back the community so that we're trying to do and we play this game of of where that line is so obviously we have security issues on the talk about those today and then we have the ability to actually contribute back to community get all this information and and all this data and all this software back we can then leverage it really is driving innovation and that that innovation that we've seen has been the Milano community mostly which is why I wanna talk about your path of so before we do that we let me give you quick background seduce this research lab at 12 7 labs with linear ICs parts the work of engineers and Indian Research and Development Center which of course is the R&D study on recorded it's being the Army Corps of Engineers we do a lot of humanitarian assistance and disaster response work and I just want to kind of put that plug-in because that's a big reason why we use a lot of mobile handheld technology of so whatever you hear me can give examples think of that that humanitarian responses that's response and that's that's where we use a lot of our technologies for him and if you wanna find out more about us of course the of the bottom so the jump in and you know I I tell the slide wide you back releases kind of why did standards of being a governing the and the new estimate of the big with a lot of people lot of players and a lot of customers and and so we have tremendous issues of trying to provide technologies and even data and software to this large community and so you know especially in the US military's we have this this loss large-scale collaboration issue and and having so many different government agencies of 70 different customers on it's very difficult for us actually communicate and for all that technology together and so what we've also found is that actually using the open-source community we actually communicate a little bit better in some instances because reaction of a single place to do it I'm so it's that on the things we've seen and again this is kind of based around this this idea of disaster management Reznik you bring that up is because we actually have to operate along the differ with a lot of commercial the commercial side does and that's because typically what we deal with are disconnected environments so if you think of mobile handheld they are connected devices they Ronald services that's what they do that's how they were designed so intuitive design so Apple builders is software the Ronald services and Windows go away the device and can cover the work release they did nearly getting a lot better so what we wanna do would you package and and what we wanna do with data standards was to create a way that we can actually have data at rest to start with but then actually have come services at rest and so what we wanna do is not to store data so we can realize data device which you won a run analytics on device which is where a lot of this got started and also of course as we just heard obviously the explosion of mobile and held in the application development process so in the early days back into doesn't understand when then I 1st met on the application of this this whole idea of application development for 1st formal and devices was really taking off everybody that had ties to the US government was thrown out status left and right in the army in 20 tentatively can actually army competition even from available as open to all government agencies and terrific opinion in that and so what happened was cut the good idea theory came and sprinkle all these different data sources and software applications on honest and none of them communicated none of them use the same data and that was a big problem was the 1st thing we noticed and that's kind word you package got started was this idea of to reduce data input data duplication and increased interoperability really that simple so
GeoPackage then was designed for the mobile handheld device so the client Mitsuko libraries and in its new really designed initially fertile we're really interested tiles and of course we also want to bring this vector data for the most part you baggage is a single file people like based it stores Rasta filed maps vector data a manifest itself self-described manifested through knows the sovereign of what's in that it also has the ability to have extensions which again is key to the for what we're trying to do here because we didn't we just wanna put the data on the device this idea of the rest will have our services at rest as well we wanna be able to do analysis on the box so this extensions of the plane will talk about some of that later so brief
history I to us a bit nicer working at about 5 years ago but in the early days were bigger the tiles offer for a while the rest child products will be more forms of people like spatial light of spatial light of course used the ability to actually do some analysis sequel calls on only at the database itself for vector data here we have some initial tools that would allow us to do some analysis with device and that was all well and good but again it goes back to our problem within the US Army list of this idea of duplication was just storing the data especially tiles on the device multiple times it was this idea of also duplicating the production of that data I cannot tell you how many times we piled the same product and in different formats were different timing schemes and that was a tremendous problem for any different projection of knowing and projections to much but you'd be amazed which is changing a projection does to the US military it slow step so after that what we did is we actually start we need we need to figure this out of and I can keep this off in the early days we toss it over to to my sister in the army geospatial sentence that you guys coming you take this wrong with that and they got together a group and a working group and they creates a new words as well so most of 1st look at actually putting this out in the open community look you come way of what what a what a potential of a data the rest I would look like for mobile and and from there we quickly realized the need to be some sort of official standard to do this because everybody against a had you know this is my idea this is what works in the tiles what have you and certainly nothing all the details it's a fantastic product problems in the necessary work for us at the top and so you know we together understand working group we toss it over the fence to the Open Geospatial Consortium they actually made this official suspect in 2014 such a couple years will slow but but now it is we can actually go back and fall on this and say this is a standard blessed body of community and it's something that we is the US Army can actually get now in use so the past it was well In the tiles really good it's kind of factors standards is sending cheap optimal and so that's over do that were use and that's what's going to happen and the problem is is not a everybody's make the that same decision on every agencies and make the same decision again we go back to this idea of having of nothing that communicates and or applications so we are actually talking to each other or looking at the same data source training data this data twice 3 times on the same so so so really what led to in those early days with this idea of collaboration and start something were always the best static again a lot of residues security issues but but I just want through this up and this is just a short list them anymore but industry and government agencies they're working on you package a lot of this work was done and to the to the advantage of each individual company each individual agents was a whole lot of money pass strategy of package developed and or push through AGC a lot of it was done and on the individual died defeated the agency or the government the government itself and to me that was unprecedented from within but they know how we typically had had that typically is a government we pay a commercial vendor to those products inner product comes a standard they developed with and so this is very different from and we're trying to to to kind of replicate that is new for because of course you package is just a mobile handheld 1 expand on that services on all the way up to to kind of you know the national level of actually creating data storage geospatial work and
I so where we work so let's go back to Canada 2010 we 1st started a lot of different applications lows applications did the same exact thing the good news muscles obligations directly developed on bring open-source software and so that was good so you is modified and and and that means the code around but the problem was there are a lot on the the different databases and even if they use the same database and say 2 application using the beach house database and we could still have projection is used for tasking issues and everything fell apart so again we're storing the data multiple times on the device and again we're also creating the data multiple times the and and that's that's a big no-no just because of the size of the data that we have to to the government this and so what we're doing in the early days was this have glucose we have blue color that would be the due date exchange between the applications working would actually help the applications communicate with each other of course the data right so this glucose and was the big problem in the early days so that's what we can relate to this whole idea you package starting pushing the idea of on the back side because it does take a lot of standard to reduce the but we also know try to reduce even just the number of data stands that were using outside of the package and as a moving all all and so where we want be where we want to take this what we wanna do is ideally is we have a combination of open source and proprietary applications obviously applications are away from the use single data that the ideal situation for in my case the US or right so it's a difficult process is a long road but what again what we found is that we can leverage the open source community we can actually get ground support and push this as opposed to the army said not using the tiles upshot used package the problem is whatever the tiles makes a new product it's innovative we were any is right have and and so what we're trying to do is to try to be innovative at the data level with the open source community in trying to be innovative at the application level with the closed software proprietary software as well as open source software and I think that that's something that we get to go with this model versus just going and paying vendors to build this application for and then bring their ideas solutions I OK so with
that of accident then using that about some the ongoing R&D which you package and some humans were for the David I thanks that so special thanks that and for learning the jump in on his presentation there of so it's kind of silence to awareness and then going with this whole story I so then GA in the last few years we started to convince people right there just using open source is not really supporting services so we sort of shifted the conversation now to doing things were actually funding some of the companies that are working on the open source factors that contribute in that way and then more recently realizing that a lot of this stuff that we're developing in-house oftentimes we can modularize our components that that reusable and we've got into the whole process now where we got our own get the we can bring stuff up on there we have to go through all sorts of crazy people review with our lawyers and things to do it but it's all doable our and so we get a number of things out there and you can see the root of our account and you have up there and the links if you want affected out there's a whole bunch of things such just mobile stuff on but so 1 of the things we've done recently is that we were looking at how to give you a package that now that it's out there it's a standard to start building it into some of mobile apps that we have and how to get other people to make it easier for them to build into their mobile apps out so we had a guy from the systems that we were working with you start going through this in wrote this set of libraries that we put out uh earlier this year to make it so you can be read write of GeoPackage on Android I it's all these job so there's our solution some components that are not really specifically can just pull out in the image of that and then he's wrapping up i West as well right now so that'll come out and there are probably a few weeks it may be 6 weeks that depends on again that that lawyer discussion I brought up the but that'll be out there it's all MIT license so anybody who wants to grab and reuse it so that's that's kind what we want to get at is is putting that out in really right that fold thing of were not just not just using it anymore but we're giving back through trying to find things and then also try and use our developers of affected community as well and
so if anybody does 1 sec that out there is a sample application but on a different page that puts all those libraries together so you can see how they work and so those of just some screenshots about sample up where you can browse through the GeoPackage packages that right advice and then render those on a map and these are some of factors that are available on the affected . org so using those protesting so that's the big thing right there no Nathan I've been looking at is is the starting created by many different software packages making sure that that that's all supportable and react so please do check out our our conifer anybody's interested wants afford it wants to do a pull request for and what to see that happen that all let the thanks that
so that a good directed geospatial research lab some of things were of the biggest thing for us is this can be very difficult for us to be able to push lover application about how to you so again a lot of these issues what and so we know off the bat that's in the very difficult does anyone trying it does mean that were not leveraging current open source technologies because we are or all but what we what we see is quick wins of actually getting a lot of of are our technologies to actually on the data side view so a lot of our data is proprietary to us or experience not releasable on however the we we store the data will be accessed data the way we manage that data all those process can pretty easily be actually pushed out you source communities personnel you package is NOT suspect and so what we're doing is we're developing and some tools for creation and its dissemination or religious man you pack i'm because that's that's tremendous issue for us right now and policy of this you packages start flowing around the sequel database server floating around what's in the how do you manage them in in words that they go with it was it live and so what you know what we do with it if you want to find out more about what we're going that and that information is also get every now and you can go again of links and you can also actually had to read you package discussion about tomorrow by Mr. landed on this and talk about some of those capabilities 1 actually and so
I mentioned extensions early on this is big justice is really key again getting data out to the end user is is critical right so that's kind the situation awareness these however again it doesn't do we still have a a we can leverage services so how we do things like analysis on the device working on extensions so just like spatial light and the big fan of spatial like selection use lava capabilities what we want is 1 takes in the same key of work on capabilities within special light and move them over to you and so the idea is it necessary duplicate spatial light but the idea is actually dynasty of business analysis capabilities and build from there and hopefully we can work back at work with special like community as we do that because I'm sure you know or structure changes in the big thing for us is routing so how you riding how we get from the you know the location to this potential area where I need to go server with my DuPont around at right to have a wide navigate to that location again no services right so how do I do it I I have all the data on the device that Jose analytics on the facts that have means to do that so actually working on that and bring out you package is two-dimensional so we wanna bring television they will use if this thing to where we could have 3 data for vector and Rasta data but there's also a of casket through a couple users also those involved your styling which I know is a big problem so work on that as well and and we're trying to yet again my hope is this community can help us with that because it's not something that were particularly good at or perhaps the same so we are working on that the so
hi how you know how we move forward and and pretty much time instants differently in but the thing with your package that thing with the open source community but With GeoPackage the for GeoPackage excuse me we're very reactive to emerging technologies so any innovation that occurred with them with an army with the military from current internally it stated and so a lot of times reactive to emerging technologies from the commercial world the force that is where a lot of technology comes from right so we're reactive to whatever they're they're doing it we gotta figure out a way to incorporate because a true planet are so there's lot of what we do right and we have to fix it what we're trying to do is be more proactive like it through love this open source community but also to help China drive standards were not just you package but with standard help drive for help say piece and that's what I'm ask you guys to packages an open standard right through to see so if there's something you don't like and and you package passed to have changed tell us if we don't know and where I can change and tell you the work of a big players as you package work its way through OGC that were very loud voices and of course the squeaky wheel gets the grease right so if you're not saying something if you're saying added is really work for me lesson of told you see delta us a lot of work on and hopefully we can can move forward with that this is definitely community-driven after and that and a friend over time so the questions quickly and then from of the vectors yeah the and yeah so I'm not the best answer the question of the velocity I fell in my world I ahead and yeah it's it's it's true that in my world if you did you fags that work and even with all the time is evolving with your package and there's lot of simplification they're out there you see at has been the player and skyline is developing stuff I mean the geospatial the biggest work with that of developed a lot of stuff for a lot of and on the you and website in GA and it's been slow moving to be fully us I'm not particularly happy with where it is 0 so when will be further along this forest community involvement in the adoption of geographic but Wernicke pushing I mean right now because it is official OGC spec and it's something or you can hang their hat on because of that specification Wernicke pushing it would keep using it for a while suddenly in our world and we hope that we can taken leverage anything we do which was adopted conservatives have no questions yeah but that I appreciate thank you fumes