One click data publishing for QGIS to support OGC/INSPIRE
This is a modal window.
The media could not be loaded, either because the server or network failed or because the format is not supported.
Formal Metadata
| Title |
| |
| Title of Series | ||
| Number of Parts | 295 | |
| Author | ||
| Contributors | ||
| License | CC Attribution 3.0 Germany: You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor. | |
| Identifiers | 10.5446/43433 (DOI) | |
| Publisher | ||
| Release Date | ||
| Language |
Content Metadata
| Subject Area | ||
| Genre | ||
| Abstract |
| |
| Keywords |
FOSS4G Bucharest 2019151 / 295
15
20
28
32
37
38
39
40
41
42
43
44
46
48
52
54
57
69
72
75
83
85
87
88
101
103
105
106
108
111
114
119
122
123
126
129
130
131
132
137
139
140
141
142
143
144
147
148
149
155
157
159
163
166
170
171
179
189
191
192
193
194
195
196
197
202
207
212
213
214
215
216
231
235
251
252
263
287
00:00
Point (geometry)Time zoneProduct (business)Bridging (networking)Computer animation
00:22
Bridging (networking)Bridging (networking)Computer animation
00:48
MetadataMenu (computing)Decision theoryFood energyRepresentation (politics)Computer clusterWeb 2.0Server (computing)Descriptive statisticsTransformation (genetics)Process (computing)File formatComputer fileTouchscreenNetwork topologySoftware developerProjective planeGeometryMetadataText editorStandard deviationInformation privacyBitComputer animation
02:38
Bridging (networking)IRIS-TPlug-in (computing)Data modelEmailInstallation artMotion captureInformationCodeGeometryAbelian categoryGrass (card game)MultiplicationProcess (computing)WindowDatabasePolygon meshVector spaceRaster graphicsVideo game consoleService (economics)Server (computing)Configuration spaceSanitary sewerArithmetic meanOpen setEquals signError messageMessage passingMetadataUniform resource locatorFingerprintView (database)Level (video gaming)BuildingSoftware developerReading (process)Queue (abstract data type)DatabaseServer (computing)Product (business)Process (computing)SpacetimeStability theoryOrder (biology)File archiverShift operatorMathematicsAdditionEndliche ModelltheorieTable (information)Content (media)Menu (computing)Network topologyField (computer science)Revision controlRow (database)InformationError messageBitHydraulic jumpGeometryNumberDataflowPower (physics)BlogPlug-in (computing)Projective planeQuicksortBlock (periodic table)Series (mathematics)Interface (computing)Standard deviationSpherical capGenderSet (mathematics)Multiplication signAxiom of choiceForcing (mathematics)MultilaterationDemo (music)Computing platformMappingBusiness modelBridging (networking)State observerCuboidWindowClient (computing)Configuration spaceMetadataArc (geometry)Casting (performing arts)Human migrationBit rateOpen setText editorLastteilungMaxima and minimaSoftwareAttribute grammarContext awarenessForm (programming)Channel capacityComputer animationXML
09:23
Projective planeOpen sourceBridging (networking)Plug-in (computing)Computer animation
10:00
FreewarePlug-in (computing)Maß <Mathematik>Bridging (networking)ArchitectureCore dumpCodeProjective planeModule (mathematics)Repository (publishing)FreewareBridging (networking)Library (computing)CollaborationismComponent-based software engineeringSoftwareLogic gateOpen sourceXMLComputer animation
10:51
Bridging (networking)Library catalogLibrary (computing)Projective planeOpen sourceBridging (networking)CodeConfiguration spaceServer (computing)Multiplication signMetadataComputing platformAdditionGeometryLevel (video gaming)Presentation of a groupMappingComputer animation
12:03
Source codeBridging (networking)CollaborationismLibrary (computing)Execution unitDifferent (Kate Ryan album)Level (video gaming)Server (computing)BitLatent heatCASE <Informatik>MomentumGeometryGame controllerDebuggerCuboidComputer fontOperator (mathematics)Open sourceSound effectDemo (music)CollaborationismScripting languageData structureProjective planeNumberCodeField (computer science)Real numberStandard deviationPower (physics)Figurate numberFile formatVideo gameWater vaporMultilaterationRule of inferenceClosed setLie groupComputer animation
14:53
Library (computing)Process (computing)Service (economics)Inheritance (object-oriented programming)Digital video recorderComputer animation
15:44
Component-based software engineeringGroup actionProduct (business)Symbol tableProjective planeLevel (video gaming)Functional (mathematics)Field (computer science)Table (information)Multiplication signGeometryResultantCopyright infringementBridging (networking)Standard deviationData conversionOrder (biology)Electronic mailing listPolygonContext awarenessRight angleError messageCellular automatonServer (computing)Computer fileQueue (abstract data type)Library (computing)CASE <Informatik>WebsitePlug-in (computing)Computer iconInheritance (object-oriented programming)Arc (geometry)Distribution (mathematics)MathematicsOpen sourceSystem callCuboidBitComputer fontParity (mathematics)Web 2.0Point (geometry)Ocean currentProcess (computing)Goodness of fitMagnetic stripe cardLatent heatSequenceLecture/Conference
22:45
Wechselseitige InformationMetadataGeometryMetadataComputer animation
Transcript: English(auto-generated)
00:07
So welcome everybody so We don't have much time, so I'm gonna go straight to the point We have a new product announcement, and it's called in Chuka bridge for for Q gets
00:26
Yeah That was fun you could all leave now So the goal of bridge is to have a one-click publish experience from Q gets
00:45
So what is the data publication? and get to For us as geocat being kind of the hosts of the G not work project Any data publication involves these three steps, so we have data set publication data file upload
01:01
We have a metadata description being published somewhere on the web, and we have a cartographic representation of that data set the data publication in in Q guys It was quite hard to find a screenshot for this one But there's a data file involved it's either in postgres or a shapefile or a geo package or a tiff file
01:25
So there's data involved There's some transformation involved to Do a format that is recognized by by the server that you're going to send it to
01:41
Above and a metadata description has to be provided and uploaded so some of you may recognize here the metadata editor of QGIS that was Majorly improved last year by a splendid team of developers And there's a cartographic publication the layer style that
02:05
Will give us some challenges the other side of course has to understand that cartography and so it would Usually not understand that the QGIS cartography
02:23
Naturally so as all these is the proper you can a standard to use here but yes of the export in in Jugis is available, but it's a bit limited here and there So that were kind of the challenges to to
02:40
So how do we Start up with that so jukka bridge version 3 exists already it has a history of 10 years, but it's an arca arca s3 Who knows about bridge for for our map says actually a good question And who is using it actually oh?
03:01
That's that's a very limited We have a stable user base for that product all over the world It gives you this one-click experience to publish to geo server geo network from every platform and map server Yeah, based on that on this set of standards here
03:24
So While presenting that that conferences like this one we always got this question. Ah do you have this user experience for for QGIS and But we hadn't
03:40
Challenges that we we had So up till last year it was hardly animated data support in QGIS, which would Made a full workflow including metadata a bit a bit of a challenge As of the support was even more limited as it is today And there was already some tools available that that had some of this capacity
04:03
So there was the the QGIS geo server plugin that was able to publish from QGIS to geo server and You know for us, and this is still a bit of a challenge is that the business model behind all of this? It's kind of an was uncertain and that made us stop
04:23
but we have an opposite to that so Make the data has improved as all day as well. He has as improved The QGIS geo server is kind of abandoned. It's unfortunately unfortunate, but it's it's what it is
04:40
and Geocat changed kind of his mind shift, and this is now willing to experiment with with The licensing models So that's why we have a geocat bridge form so that was an effort of Of a couple of months the recent months before phosphor G. So we had a hard time to finish it now I cannot offer you a download yet, but that will
05:02
come soon so So you didn't now we can publish easily to G not work post this geo server and map server I would also just like to point out we're expanding the capabilities of this product. We're also good for our cartography We're gonna be converting both from our cast II to map box style and also from QGIS to map box style
05:25
Because we would really like to have a solution for the mobile clients as well So installation will be will be as easy as it is for other plugins You want to activate the plug-in by the plugins menu This is one of the first features is a kind of
05:43
We developed this actually as a developer tool So the developer could easily develop this but let me say hey This is actually a nice feature to have instantly a preview of the style that you defined on QGIS and have it instantly on SLB and map box GL and geo styler. Oh, yeah
06:04
comes that Configure the target server and these interfaces you see now they resemble very much the bridge product So people have a very easy Frog map so many people have a easy migration from from S rate to the QGIS platform
06:20
So people who are aware of the of the arc map bridge product may recognize these interfaces There's a publish window. You see all the layers in the table of contents of your QGIS project You click on one and you can Enter some metadata fields here The goal here is to provide a minimal metadata editor. So make the data editing
06:45
Is kind of boring says me as a geo network developer. So you have to minimize it where possible So we give you an intuitive minimal metadata editor that Provides you a valid record according to standard that you're using and I'm just gonna interject here
07:05
We're starting with the base metadata that's been added to QGIS 3, but that's not quite sufficient for the level of detail We need to when we publish to inspire So we've actually had to set up a few of our own additional fields here and set up our own little SQL
07:21
Light database in order to store this information We hope we can work with the QGIS development team in order to allow us space to record this additional metadata There's an additional tab here that allows you to Do some work on the attributes like activating them renaming
07:44
And then there is you hit the publish button. There's a spinner and this gives you then this experience data published symbology published metadata published Usually yes, yes. Yes. This time is no because there was an error on one layer This is still a better version
08:02
We're working on the things Stop by the geocat booth for a demo and you can produce your own errors and warnings. Yes Yeah, we love that because we love issues and errors and we love errors and then issues that relate to that So and then there is a
08:20
After you published it you have this Say logo there saying this has been published and then you it gives you the context menu and says okay WMS layer and that will give you the open layers preview of that layer As it is published on the server now because Paul is Experienced with geocat bridge. He's kind of glossing over how nice this is
08:42
This is a really nice experience from ArcGIS desktop. It's a really nice experience for QGIS once you've set this up, you can choose to publish or unpublish a layer very easily and Because you filled in all this information all your metadata all your cartography all your data is going to be taken along for the ride
09:02
We don't necessarily package the data if you're referring to a database that's accessible to Geo server accessible to map server You know, we'll be pointing to that table and so forth But this is a really powerful story as someone who used the QGIS Geo server plug-in I'm very impressed when I when I started looking at this
09:21
Please continue. Oh, that was really quick So as many of you know, I'm an open source Contributor, I've got the shirt to prove it and I'm here to announce a new open source project
09:40
and that project is QGIS bridge plug-in So this is a new open source project that we're pleased to announce We're starting this as an open source project rather than a proprietary project, which is what Bridge 3 was and
10:01
This is a QGIS project. It's with a GPL license And this is under a free software GPL license. We are making this available, of course to our customers But our customers do get a chance to access that code straight from GitHub and we are seeking contributions and collaborations
10:22
So that is available today. You can go to the github repository. You can check it out Please include all the sub modules and you can install it into QGIS 3.4 or later and try it out The internally the project is broken down into a couple components So we've got the QGIS bridge plug-in which I've just talked about and it's gonna make use of two Python libraries
10:45
Bridge common and bridge style and this is all Python 3 projects So the first library bridge Commons, this is also a new open source project So this is a library making publishing geospatial data and metadata on the internet as easy as using Python
11:04
Show of hands is Python easy Excellent, so I really hope you check out this library and give us feedback this library kind of takes the place of GS config which was a
11:20
Was used to publish things to Geo server This library can take the place of that and in addition to publishing to Geo server can also publish to map server So it's offering greater Capabilities and we hope it can be extended to other platforms in the future Is available on github this time it's an MIT license so MIT is a open source license
11:43
It's very popular in the Python community, especially the geo Python community and those are the folks we're looking to collaborate with Here's an example, this is how you know, you're the phosphor G conference there's code examples in the presentations I'm not going to read the code example to you. I'm not that cool
12:04
The other library that we'd like to talk about here is bridge style and this out because we think that this library is going to see a lot of uptake and be Really wonderful for a lot of people so this is a Python library That's specifically about converting between the different map styles. So once again, it's an open source MIT license
12:28
Internally, it's going to use Geo styler Jason as little data structures to pass the styles around and it has capability to export to SLD and SE and the Specific flavor of geo server
12:41
SLD that allows you greater control fonts and special effects like Alpha Blanding and so on We are also setting it up to export to map box specification in case you'd like to pick this up on mobile devices and Almost more importantly who here is not a Python
13:03
You can use this on the command line So if you want to use it in a DevOps situation or Jenkins or in little bash scripts You'll be able to make use of a style to style command line and use that to convert between formats So we're really hoping that this levels the playing field for a lot of the open source projects and helps
13:24
those of us who are enjoying proprietary tools a chance to chance to make use of a wider use of technology So fast scripting DevOps operation automation we would really like to see this tool picked up and used
13:40
It's also available on github Python 3 MIT license and Geocat really welcomes collaboration And that's not an idle threat So we are doing some some of this in collaboration with a really nice project called geo styler from the director's which I'm probably not saying right and
14:02
we managed to meet up with them at the ball singer code sprint and They gave us a really nice example of their geostyler demo so this is a front end where you can put together your style online and Convert it out to a number of different formats, but it's a JavaScript library
14:22
but they have a Specification of their JSON data structure and rather than invent our own We're collaborating with with them, and we hope that this also picks up some speed and momentum within the community So geostyler was not intended to be a new standard, so I'm not going to use that xkcd comic strip
14:43
But it is trying to be a little bit of a Rosetta stone to convert between standards Thank you, how are we doing for time? 20 minutes we're much too
15:00
Okay, well, that's excellent are there any questions In the back we're gonna come around to it with a microphone Because it wants to be picked up for the video recording as well, that's why we're asking you to use the microphone Do you have a?
15:20
processing toolbox in QGIS for that That might be something that could be produced one of those Python libraries right now We're really focused on that one click publishing experience, but that's a good idea I can see how that would be really advantageous Yeah Good anybody else we accept awkward questions also
15:46
Yeah You said you could you could publish from arc map from yes, right not not this product We have a product that publishes from our map, but okay
16:00
So if you've got like group layers in our map does it support the grouping? Yes, so geo server for example has the concept of a layer group for WMS, but it supports it when you Straight over here right and and just I'm gonna interrupt. We've been talking a little bit about Geocat bridge for this product is going to be available both for the Esri products and the QGIS projects
16:27
And it's going to be making use of a lot of the same open source components So please continue with your question and the symbology how complex is the symbology? How complex I mean if if we have a complex symbology do you support it?
16:41
So that's a really good question We do handle a lot of the things like picking up all the little icons and glyphs and packaging them up and sending them to Geo server so they can use the right icons Especially with the Esri tools a lot of the true type fonts are under a distribution
17:01
Restriction and so you've got the opportunity to map from here's the little font I'm using over here to here's the little font symbol I'm using on the server side that can be especially awkward for governments that have like standardized on symbology Donated it to Esri and then are surprised that they don't have the right to use the symbols afterwards
17:22
So hopefully you kept your SVG file so you can reuse them like a zebra style You know zebra like stripes Stripes symbology Polygon, okay. Yeah. Yeah support it
17:40
You don't you do Alright, and also when you publish you have you have the sequence of the layers. I mean do you keep this the sequence? Yeah, it actually goes a little bit beyond that in that if you've got a specific map That's configured with the layers in an order that comes out as a called a web map context
18:04
That standard is not used by very many products, but we do support it Right and last thing labeling when you choose a field for labeling. Does it keep that? Yes And actually this is a good point for the QGIS Story because QGIS a lot of people use dynamic functions and so on when they're configuring their styles and their labels
18:28
And that hasn't been supported by the native QGIS SLD export and it's supported right now in our initial You know Technology preview of geocap bridge. So already we're seeing
18:41
much better Fidelity between the originals and QGIS and what we're getting out of Geo server, so We're really pleased with the initial results Thank you. Okay, we still have time for more questions. So excellent One more question about style conversion you mentioned that you convert from
19:03
SLD to mob box styles and so on will be supported also conversion to mop server styles So I'm personally not across how the current Geocat bridge 3 doesn't my understanding is it packages? No, you're gonna take it
19:22
So we do have some support for taking the symbology Over to map server, I'm not myself knowledgeable about how that is done. Can you answer that? Maybe maybe I didn't fully understand the question but the answer to this question is that we we create a map file on the on the
19:45
okay on the arc map side and It's true that currently there's no map box style on the Styler library Is what's that an answer to your question
20:01
Wait, can you wait a second say or? Liar definitions are for for map server proposes with all the styling and then styles to port It's certainly on my roadmap to have that but it's currently not and
20:23
The in this case With mob server said we've also we can use SLD. Yeah, so that's how it's handled currently Something more specific for map server could certainly be added to the library and we do hope that more plugins Extensions are added to that library over time. Okay anymore. Yes
20:47
Thank you. So this bridge style that looks quite interesting I'm wondering how do I know? Like how successful was the conversion of the styles because lots of these like there is no good parity
21:03
So do I know if there are some errors or warnings That's a good question in our UI right now. We do offer a list of warnings I'm pretty sure that when we do the conversion we could make a list of any Components of the symbology that we weren't able to make use of but there's an awful lot of functionality in Geo server
21:23
That hasn't been taken advantage of in the current SLD export. So we're really hopeful we can get very good parity Yeah, okay cool anymore If we went to the GitHub repo, I could show you like a mapping of like these functions to these functions in Geo server
21:44
Yeah, we're doing we're doing our best to do a good job Okay, if there are no anymore further questions I actually came with my own So one question that we expected was why didn't you directly improve the QGIS sld
22:05
functionality and the answer was really that We were after that Python command-line experience and we were looking to collaborate with the Python community we also do intend to use these libraries in our arc map and ArcGIS Pro tools
22:21
The QGIS community also doesn't have a strong interest in sld So we're expecting to have a better chance collaborating with the Python community The other question is why the MIT license and the answer is really that we're that we're making friends with the geo Python community So the geo Python community at this conference is pi CSW geo API and geo health check. So
22:48
Yeah, we're looking forward to that and there was also a Prepared question about geo package metadata. That's not currently supported in QGIS So if you have your metadata in your geo package QGIS isn't noticing
23:02
So that's something we'd like to work with the QGIS community on Okay, Jody. Thank you. These were really good questions And the talk was good as well. Thank you very much