Integrating FOSS4G into an enterprise system for Disaster Management

Video in TIB AV-Portal: Integrating FOSS4G into an enterprise system for Disaster Management

Formal Metadata

Integrating FOSS4G into an enterprise system for Disaster Management
Title of Series
CC Attribution 3.0 Germany:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Release Date
Open Source Geospatial Foundation (OSGeo)
Production Year
Production Place
Portland, Oregon, United States of America

Content Metadata

Subject Area
ROGUE (Rapid Open Geospatial User-Driven Enterprise) was a project funded under the Joint Capability Technology Demonstration (JCTD) Program from the U.S. Department of Defense. Boundless and LMN Solutions, LLC implemented the project, with the Pacific Disaster Center (PDC) serving in the role of project Transition Manager. The project's goal was to improve the abilities of the OpenGeo Suite to ingest, update, and distribute non-proprietary feature data in a distributed, collaborative, and occasionally disconnected environment. Under this project, PDC integrated the following technologies into its decision support system for emergency managers named DisasterAWARE:- GeoGit: Versioned replication of spatial data across multiple sites, supports disconnected editing and conflict resolution. - Arbiter: Android app for field data collection, syncs to GeoNode.- MapLoom: GeoNode GUI for spatial data editing and management. - KML Uploader: Functionality to upload KML for storage in PostGIS and served via GeoServer. - GeoServices REST (GSR): Extends GeoServer to publish data using the REST methodology of ArcGIS Server. This presentation will cover the integration of these components into DisasterAWARE, along with the security framework implemented for all components.
Keywords GeoGit Arbiter replication data sharing humanitarian assistance disaster response MapLoom GeoServer GeoNode security KML KML uploader OpenGeo Suite
Point (geometry) Slide rule Enterprise architecture Presentation of a group Information management Open source INTEGRAL Software developer Projective plane Latent heat Component-based software engineering Thermodynamisches System Authorization
Enterprise architecture Context awareness Word Information Open source Projective plane Range (statistics) Real-time operating system Open set
Group action Dependent and independent variables Information management Hazard (2005 film) Information Mapping Range (statistics) Shared memory Real-time operating system Database Bit Element (mathematics) Fluid statics Process (computing) Software Personal digital assistant Operator (mathematics) Business model
Thermodynamisches System Open source Different (Kate Ryan album) Projective plane Shape (magazine) Product (business) Geometry
Scripting language Trail Functional (mathematics) Mobile app Server (computing) Mapping Software developer Image resolution Source code 1 (number) Branch (computer science) Revision control Mathematics Thermodynamisches System Different (Kate Ryan album) Internetworking Computer programming Energy level Self-organization Data conversion Bounded variation Directed graph
Laptop Server (computing) Mobile app Code Set (mathematics) Online help Real-time operating system Shape (magazine) Web browser Drop (liquid) Rule of inference Field (computer science) Normal operator Power (physics) Number Revision control Thermodynamisches System Internetworking Condition number Mobile Web Mapping Validity (statistics) Cellular automaton Electronic mailing list Connected space Tablet computer Repository (publishing) Personal digital assistant Tower Text editor Quicksort Geometry
Point (geometry) Group action Demo (music) Interface (computing) Multiplication sign Digitizing Drop (liquid) Event horizon Computer icon Field (computer science) Attribute grammar Tablet computer Digital photography Process (computing) Semiconductor memory Repository (publishing) Internetworking Table (information) Directed graph
Point (geometry) Digital photography Mapping Interface (computing) Moment (mathematics)
Point (geometry) Goodness of fit Server (computing) Process (computing) Mapping Software developer Element (mathematics)
Point (geometry) Medical imaging Server (computing) Uniform resource locator Demo (music) Multiplication sign Password Connected space Directed graph
Scripting language Server (computing) Repository (publishing) Multiplication sign Decision support system Boom (sailing) Sampling (statistics) Field (computer science) Directed graph
Point (geometry) Server (computing) Group action Information management Information Computer file Execution unit Projective plane Real-time operating system Database Bit Shape (magazine) Field (computer science) Revision control Synchronization Decision support system Text editor
Point (geometry) Revision control Programmer (hardware) Code Multiplication sign
Revision control Server (computing) Mathematics Mapping Information Code Line (geometry)
Point (geometry) Type theory Mathematics Different (Kate Ryan album) Right angle
Point (geometry) Uniform resource locator Decision support system Bit Power (physics)
Server (computing) Mobile app Latent heat Standard deviation Validity (statistics) Multiplication sign Projective plane Representational state transfer Cartesian coordinate system Mereology Plug-in (computing)
Server (computing) Mobile app Dependent and independent variables Representational state transfer Cartesian coordinate system Formal language
Web 2.0 Point (geometry) Open source Demo (music) Multiplication sign Projective plane Mereology
Demo (music) Tesselation Multiplication sign Projective plane Line (geometry) Mereology
Tesselation Internetworking Software testing Connected space
Point (geometry) Server (computing) Implementation Open source Multiplication sign Firewall (computing) View (database) 1 (number) Software industry Open set Client (computing) Mereology Revision control Goodness of fit Mathematics Thermodynamisches System Information security Plug-in (computing) Stability theory Standard deviation Mapping Tesselation Software developer Projective plane Bit Software Phase transition Quicksort Virtual reality
Presentation of a group Process (computing) Streaming media Element (mathematics)
Moment (mathematics)
Representational state transfer Communications protocol
Open source Extension (kinesiology)
Videoconferencing Extension (kinesiology)
heard so I guess we will go ahead and get started and my name is David ask of and I'm with specific disaster center and I'll be giving this presentation on behalf of my co authors like riskiest who's the Deputy Executive Director and Jeff Smith who is 1 of our open-source developers and I did a lot of work on this but the talk today is this is actually an hour presentation that I'm trying to call them about 20 minutes and then we 5 minutes for questions so some of the slides i'm gonna skip through pretty quickly that there will be a guess video display of them so if you're interested in reading all the bullet points to go back and see them later on the basically the talk today will be about integrating the various free and open source software components into our enterprise system for disaster management our system is called a disaster where and so will show you some of those integration points a little later so the project
that we're working on is called rogue and road is named a rapid Open Geospatial user-driven and to enterprise and that's just kind of the information on the project this was funded by US Department of Defense and it's basically a demonstration of building new technology and showing its operational utility of
the 1 of the main goals of this project was to be able to have shared situational awareness which you know is basically a big buzz word in the DOD but basically what it means is we're all looking at the same data were sharing data in real time we have another disaster we have a wide range of partners may come in and try to participate and help gather data think about you know the Haiti earthquake or the Philippines tropical cyclone for example have a lot of people coming in and contributing data trying to get all replicated synced up and shared with everybody in real time of and 1 of the other goals of the project was that everything bill would be completely open source everything that I'm going to show from the project is available for download so this is the
a team here a whole lot you read the on around are basically PDCs role as we were the transition managers so um elements solutions which is now noblest atmosphere soon will become that of and boundless were building the software and our job was to take it and had implemented in years make sure it sees the light of day and is useful and so here's
a little bit of background about PDC we work in a wide range of emergency management you mention assistance and disaster-relief operations not everything we do is technical but you know the things were and we talking about today and really our related to our information sharing we do a lot of work with static data base map data responsibility kinds of data and then also real-time data whether that's hazard information or it maybe you like impactor exposure modeling and information sharing so
and as I mentioned you know our goal is really to I implement all of this technology into our production systems and that was our role on this project so for
salmon talk about is due gig and it started out being called Road which was the name of the project and then they decided that sounded to shifty and so they renamed it all to GEO shape which is what we're calling it under the project as an open source project it took on the name and you get hits based after a loosely modeled off of get get and of I guess they decided that would maybe not pass a trademark review or whatever so they change the name to dupe gig so we've had the distinct pleasure of working with 4 different names of technology under this 1 projects if you hear any of those names there kind of all the same thing so as 1st year
gig what is it so Have any of you works with get hub for your source data you know that it can branch your data you conversion it you can roll it back you can replicate it you can copy it out to another branch you can merge it back in and basically imagine doing all of those things you do with your source code imagine doing that with your GIS data and that's you know the very the simplest way of thinking about is what this does and it does allow for dispersed data contributors you can contribute from all over the world just like that the you know you do with that you get or with get up and accept reject edits you can roll back changes and you can also vary intergranular granular level track who made what changes and then the other thing is it allows you to replicate and synchronize your data so if you have different organizations you wanna pull it into their own environment you know they're able to do that very rapidly so this is a really exciting development for GIS data the
the In short how it works it's runs Linux program it's pretty easy to script and automate you know we when they showed us how to use it they said you know hey here's the program here's how you use it you know and you can automate a great how do we automated this I just write a script so how about you guys have ones that none of the it's easy to do in turn of 1 of our developers went in and about 2 hours he had script working to do it and it is based off of some work that have been previously done and so it really was pretty simple imagine there will be probably and get help scripts coming to to do that to keep these different servers St. it's exposed over the Internet through a GeoServer and then there's a canonical map loom which will be showing you which is custom functionality built into GeoNode for the manually doing so the sinking in conflict resolutions and then there's an Android app as well that will be shown the so
map loom as I mentioned is based on geo node and when it's when you build you a node with the Jewish shape technology it comes in with a web client for editing geospatial data and synchronizing as you can edit delete add features in your Duguid repository and has user-friendly tools which I'll show you just click a button and it'll sink up between different servers and then if any conflicts occur there'll be sort of side up side-by-side editor of what you have what the other 1 has and if you think about sort of you know if you work with code and get help and maybe have like you know my local code is this the other code is that you have a comparative the it's just like that but with the map and actually the the so arbiter
has an Android app of the the uh it works on tablets or phones and I can work with any devices connected by 3 G for g or Wi-Fi and so what you do is you start out by basically caching I'm a set of layers and and background and into the arbiter device the edits of are stored in device then you can take it offline so even if your device is 3 G 4 G compatible imagine in Haiti after the earthquake imagine a lot of the cell towers were not operational or they're completely what case really even if your device has internet connectivity you have to be able to take it offline and do disconnected work and then be able to sink it back up so in normal operations you might go out in the field with the cell device and be able to talk to the server which is available over the Internet and as your collecting data collect data in real time so imagine a damage assessment or something like that but really an austere conditions you know so immediately following a disaster you know commons down your connection of the servers down in the souls a showdown powers down who knows you can go out there and just connect the you work in a disconnected environment basically imagine maybe get back to a mobile command center there's why final laptop running the stuff you connect up and get your data off of the tablet what does have some basic enforcement of rules like drop down list you can enforce that the dates numbers added for the act itself you know hopefully start to get some data validation going are so uh given that we
have a very short time here and I get started with the demo so the 1st thing that I want all of you to do His and start collecting a point and I'm going to attach a photo to that OK and so what I would like for all of you to do and hang on 1 2nd and think that here the someone at a point in and it's a very simple interface I mean you basically just get our some background I no problem and you can see that and you just click on the pencil icon the edit drop point on there and then what you can do is go in and enter some attributes so for this event I'm going to say that this is a all Spanish and by the way you can internationalize this castle more tell which we did this down in Honduras and Dominican Republic and that means of of basically uh fatalities and so on use attach photo to this and so your job right now it's all looked dead there's everybody slump over our digit the groups I guess it took us of the desk here but that doesn't matter the so I took it memory you know which 1 like that but that's OK now I'm not rated for my photography skills hopefully so and so for place I will enter of Portland here which my spellchecker SOS Orlando which is close enough I'll save that return to map the again trying to fit a lot of demo and 20 minutes here so will was just what the tables go and then there's a little button down here that is your sink and so while you're disconnected that button turns red this soon as your connected up to Y fire internet or whatever but it will turn green and then news press that and whatever features you have collected on your tablet wire out field editing are then sink that to your due gig repository so then if I come over here
I the
what's this is the map
alone interface here and so this is built into GeoNode the and I this says you know very simple editing tools here and as you can see here at that point that I entered just a moment ago as already synchronized to here and you can see my very fuzzy photo of me lowering the camera while it was taking a picture and so terrible
photography I apologize that you all look really dead so that's good so the job acting around
so you can see actually you know without me even clicking anything it already had that point on the map Novati recognize that it had it there so I had seen that that you and so this server here is actually running at element solutions which was the developer of this and thus we use that to simulate of US Department offense of server that would be you know kind of aggregating the data for us and so here is our Pacific Disaster
center server as you can see that point does not exist here yet so we haven't seen this and this is just a kind of a demo server that we stood up and there's a but you know there's a couple menus you can go through all take the time to do it but basically just enter a URL the server you give it a name at a username and password it really could not be simpler set up a connection to another server and then once you've done that you get 1 of these entries here and there's a sink button here she just press that and it has a little animated
image that runs and says OK great expense Inc and now we have the feature in
our Duguid repository so that is really honestly as difficult as it is to go from field data collection to 1 server to another server so you know just in that short time I was replicating data from a field device to 1 server and that server's running a Scott is that in Virginia it's running in Virginia ours is running in Hawaii and just boom or sentence and Y so this is just kind of a sample server here that were running but we actually have 0 this is our the
this is our our decision decision support system the tall disaster where OK and we're running this this 1 is actually what is running the sink script that
runs in real time and so basically what it does is it runs it does a synchronizing and whenever it finishes at sleep for 1 minute and then it runs again so basically there's no more than 1 minute of latency and that this 1 here this was not effect but the synchronize that I did manually this is just automatically sinking and you can see we've already got our point over here into our decision support system and this has all kinds of other information for emergency managers at real-time added information about a tropical cyclones earthquakes volcanoes it has meteorological information risk ability information so there's all kinds of things here that emergency managers can use and now all of a sudden we found a way that thanks to this project to automatically get field data collection and to get the latest status on the ground after a disaster in there that's really not even just after a disaster you could use this technology just to build your database and it's so much easier to to use to share data then you know honestly what we did after the Haiti earthquake was that we would get shapefiles e-mail to us every nite by a Marine unit that was embedded in Port-au-Prince it was a nightmare in every day we come and we have a new shape file would have to load for server and you know restart or services so this makes it just so much easier to do 1 of the things I'm going to demonstrate really quickly about this is the ability to
have multiple editors and to resolve conflicts and so what I'm gonna do here has OneScanner click on this point and understand that the geometry and move it a little bit it in go ahead and say that and then I'll come to our server here in Hawaii I'm also
gonna click on the point here and I'm going to move it so we have 2 different people making edits to the same feature at the same time so I move 1 eastern move 1 kind of southwest OK and so we now have 2 people who edited the same feature at the same time so imagine a programmer working with code and somebody else said it's the same 1 that you're fixing lawyer and have conflicts so if I think these up it says you
got a conflict so what's go resolve those and
if I click on this button here it will show me and it
shows me side by side so imagine these are lines of code that urban change in you're trying to resolve those conflicts will this is the same thing but it's GIS features such as here's your local feature you moved it the merged features this because it's really this is running on our local server so that's the 1 that's gonna win if I do nothing and in the remote 1 has been moved over here so maybe I'd have some reason to believe that they had better information I just click on this button and all a sudden it's maps to their and I click Save and I said done and done
merging everything the and say
yes the and so now the point has been moved over there and then I can just think this change back to the other server so that they have basically all they know at
that point is yes I've accepted that change so really very easy it does the same exact thing that should be data in on the left is yours on the right is somebody else's you choose which 1 you want it doesn't allow you to just type in a new value to kind of you know you you would have to go do something else but at least allows you to see the differences between those and so if we
go back in here to power of decision support system you can actually see that that point has already moved to the new location so and we do refresh every couple of minutes just to Redrock as he stated to move around quite a bit so moving along so so
this is how we've implemented this technology
of 1 of the ways in which we did that was we are application is very much wired to get feature data from archaea server from mastery and so at the time as a actually had published their rest specification as a proposed standard of the UGC it eventually was not adopted and they decided this stop working on that but in the meantime as part of this project we built this plugin to GeoServer are called you services rest GSR and basically what it does is it mimics archaea server so if you have an app that is wired to talk to archaea server you can actually get this plug GeoServer and it thinks it's talking dark server and so this application here that I
talk to you it's actually sending requests that are valid server-requester they're actually going to GeoServer and it's answering them in the chair server a
language and so if any of you works with archaea server oldest quickly pull this up here no again
the so this is the uh the rest I you know if you work with archaea server you might recognize this this would be like the rest response from an server except this is actually coming out of a GeoServer so that's kind a cool so if you have apps that are already talking archaea server you're interested in adopting ducer you don't necessarily have to rewrite your whole application so
I'm going to just quickly touch on a few other
things here we have a KML uploader answer running out of time to the demo that but as part of this project we did build into GeoServer it'll except a Kamal it'll try to read all the styles out of it and it will store it in just and publish it as a GeoServer layer for you we have written a little helper tool on top of that I don't know we may be open source and I'm Archer but basically it kind of web enables it so that you know you can send it to a web and point uh so that's pretty neat I
enforcement of time the demo that the if you're
interested maybe find later and then GeoWebCache we really did nothing new for this project of was GeoWebCache but it's something that we implemented as part of line the whole stack and I 1 of the things that were looking to do which is kind of need
is actually not just tile
caching of the tile caching with a temporal data so as you can
see here were actually made up of using a time-based requests I to catch rainfall data over the last week and so were able to do this but unfortunately the a Internet here is a little slower release it was earlier announced testing it but if you have a really fast internet connection school can you can zoom in and zoom out in the animation just you know keeps going on because it's all cash so that's pretty neat and on
the then chef just very briefly as part of this project we started to adopt chef which is something the onin guys turned us on to and were building VM's in just minutes with the push of a button a really great technology it's not necessarily the but geospatial but it is really sped up our development of virtualization environment so
1st challenges and I guess I would say security was probably 1 of the big ones was a you know we found a lot of times the technology work pretty well but when we got to security that became a bit of a challenge i were still working on integrating that you note environment with RL that so we're actually kind of running that sort of uh um behind the firewall and then we have a 2nd you server that out of phase in the public so that's probably 1 of the best things are frequent updates if you work with commercial software companies you can be frustrated without slowly these changes come in well this is kind of maybe the opposite problem of you know you're rebuilding a virtual environment 3 or 4 times a week you know and this is maybe not so much working with the stable software but it's like during development it's changing really really quickly that's redshift technology is critical to be able to just quickly rebuild these machines but but that's 1 of things that we found was you know we're not really developers were more and uses a implementers and these changes were just coming in so fast so it is a bit of a wild ride developing these things but then once they get working and before this stay stable but compatibility you know it's as things are developing we're moving pretty quickly and sort kind of you know so it seems like we're constantly looking at all will this change the JDK version and the Tomcat version and you know it just seems like with open source software from really more as reshot point of view but you know it's good that it's changing so fast and it's hard to imagine them complaining about softer evolving quickly but it also means your target environment is evolving quickly saw constantly seem like were have and upgrade the you know our environment which is good it keeps us moving were I think with more of a proprietary software we time to be a little more stagnant with that but this is kind more of our own problem but our system is really in a time intertwined with proprietary software so we had our snap was so built and arches server that actually I think it was easier to build the Geass our plugin then it would been to rewrite are apt to talk to something else but 1 of the things we've run into is basically a we've been looking at kind of open standards and that is something that as readers very very nicely as they kind of meld the feature service with the symbology of the map service and into that 1 single respect and so actually we found that that yes are plugin worked really well for us and you know we for while were playing with implementing SLT into a JavaScript client is really challenging so getting the styling along with Feature Service we give over most we deliver most of our data through features not map tiles and so that's been a particular challenge were working on
building partnerships and kind of you figuring out how to implement this you know we're not going to just do it ad hoc so that's something that we're working on now is just figuring out how to build everything into our process so if you're
interested in more presentations that element has to be giving several presentations this week on the technology and they will actually be going really and adapt on how all of this stuff works so I would recommend checking out 1 of these and again I know excuse me but I know I would really quickly through some of the slides if you're interested they will be available later on stream so that's my presentation I know
it what right up to the edge but maybe just take a moment for questions if anybody has any and you the next presented you have come up and start working so any other questions
and the the
the the
of the question was about the as rest
protocols there's a lot of interest and if we planted give those back but Scott
correctly from wrong but I believe it's all open source so
and so look
under boundless GeoServer extensions the
they but it a the the and and the the that sets of so this to get the answer into the
microphone here for the video the answer is that it's a a boundless extensions and there's so it may end up living somewhere else long-term but that's where it is right now any other questions ch any other questions OK well thank you very much


  305 ms - page object


AV-Portal 3.20.1 (bea96f1033d39fbe77f82542458e108105398441)