We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

GeoNetwork Opensource: What’s Happening and Upcoming

00:00

Formal Metadata

Title
GeoNetwork Opensource: What’s Happening and Upcoming
Title of Series
Number of Parts
295
Author
Contributors
License
CC Attribution 3.0 Germany:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Identifiers
Publisher
Release Date
Language

Content Metadata

Subject Area
Genre
Abstract
The GeoNetwork Opensource project has been an OSGeo project since a decade. It is a catalog application facilitating discovery of resources within any local, regional, national or global SDI. Users can register their spatial datasets, services, maps, sensors in a central catalog. Others can query the catalog to find resources via the website or directly from a GIS application, like GeoNode or QGIS. The catalog records can also be ingested by other catalogs and search engines to facilitate wider discovery. In this presentation the core developers introduce you to recent developments in the community. GeoNetwork adopted a twice-a-year lifecycle, so we’ve released the 3.6 and 3.8 version which had some interesting new features like metadata workflow, history, INSPIRE metadata guidelines 2.0, DOI, user searches, json and json-ld encodings, inline validation, WFS 2 and 19115-3:2018. Currently we’re in a major refactor to migrate the catalog to use ElasticSearch as a base search index for the 4.0 version.
Keywords
129
131
137
139
Thumbnail
28:17
Open sourceDrum memoryTable (information)Content (media)Content (media)Sheaf (mathematics)Front and back endsSign (mathematics)Expert systemMultiplication signTable (information)Client (computing)Intrusion detection systemQueue (abstract data type)Computer animation
MetadataDemosceneComputer wormSource codeSpatial data infrastructureLibrary catalogAxiom of choiceSoftware developerWeb portalService (economics)Variety (linguistics)Standard deviationSoftwareLibrary catalogSoftware developerVariety (linguistics)Projective planeFreewareOpen sourceBus (computing)NumberNumeral (linguistics)MetadataComputer animation
Demo (music)WebsiteLibrary catalogFunction (mathematics)MetadataFile viewerSpatial data infrastructureSign (mathematics)CodeLibrary (computing)File formatModule (mathematics)GoogolBranch (computer science)Elasticity (physics)Local GroupPrice indexScalable Coherent InterfaceHost Identity ProtocolEnterprise architectureProduct (business)Commercial Orbital Transportation ServicesService (economics)Point cloudImage resolutionFrequencyCore dumpStandard deviationVolumenvisualisierungPattern languageProcess (computing)Computer-assisted translationMotion captureProjective planeSinc functionGeometryShared memoryNumberSoftwareProduct (business)Order (biology)CodeBitPlug-in (computing)File formatVideo gameDataflowOcean currentAverageLimit (category theory)ResultantLibrary catalogElasticity (physics)Enterprise architectureOpen setIntegrated development environmentCategory of beingCodierung <Programmierung>Mobile appRevision controlSubject indexingTotal S.A.Covering spaceGoogolAdditionForm (programming)Address spaceComputer animation
Standard deviationLocal GroupCore dumpProcess (computing)Computer-assisted translationMotion captureSoftwareTurtle graphicsInformation privacyRegulator geneWrapper (data mining)Object (grammar)Mobile appOrder (biology)Execution unitComputer animation
Information privacyAxiom of choiceWindows RegistryData modelSelf-organizationExtension (kinesiology)Self-organizationGeometryRegulator geneAxiom of choiceWindows RegistrySoftwareProfil (magazine)Similarity (geometry)LogicMiniDiscMoving averageExtension (kinesiology)Endliche ModelltheorieComputer animation
Data modelRegulator geneLogicWeb portalWindows RegistryMortality rateStatisticsGeometryType theoryAuthorizationSelf-organizationEndliche ModelltheorieLibrary catalogExtension (kinesiology)Computer animation
Reverse engineeringRule of inferenceLink (knot theory)Process (computing)Formal verificationBit rateMetadataOpen setIntegrated development environmentProcess (computing)Self-organizationBitMultiplication signEndliche ModelltheorieComplete metric spaceData conversionExterior algebraHarmonic analysisData modelDigital photographyThumbnailRule of inferenceComputer animation
Rule of inferenceExecution unitReverse engineeringProcess (computing)Formal verificationBit rateTransformation (genetics)Rule of inferenceSelf-organizationSet (mathematics)ThumbnailSummierbarkeitProcess (computing)Uniformer RaumComputer animation
File formatOntologyType theoryFamilyMultiplication signLecture/Conference
Process (computing)Formal verificationGeometryLink (knot theory)Library catalogComputer animation
GoogolLibrary catalogRenewal theorySoftware developerWeb pageDisintegrationSoftware testingLinear regressionFile formatPresentation of a groupCASE <Informatik>Subject indexingSet (mathematics)Line (geometry)Medical imagingMathematical optimizationNumbering schemeRow (database)Content (media)DatabaseWeb pageDecision theoryLibrary catalogGoogolAddress spaceSearch engine (computing)Error messagePoint (geometry)BitInformationNetwork topologyWeb crawlerSoftware developerLoginCore dumpExecution unitType theoryLink (knot theory)GeometryMetadataSoftwareVideo game consoleWebsiteComputer animation
Open setNetwork topologyComputer animation
Open setData typeSign (mathematics)MassSample (statistics)Gamma functionMechanism designPhysical systemMathematicsIntegrated development environmentData storage deviceRevision controlMetadataWindows RegistryComputer configurationPresentation of a groupComputer configurationProfil (magazine)Windows RegistryRow (database)Graph coloringMathematicsValidity (statistics)VideoconferencingGoodness of fitMetadataComputer animation
Default (computer science)Revision controlSpacetimeNetwork topologyEmailElectronic mailing listPoint (geometry)BitReal numberSoftwareDefault (computer science)Numbering schemeScaling (geometry)Computer animation
Scalable Coherent InterfaceDefault (computer science)Suite (music)MalwareTemplate (C++)Uniform resource locatorBitPatch (Unix)Computer animation
Rule of inferenceDemosceneService (economics)Projective planeSoftwareLibrary catalogMereologyValidity (statistics)MetadataRevision controlLecture/Conference
Transcript: English(auto-generated)
Hey, hello, this I think this will be my last talk on this on this Conference so I have to enjoy it so so I'm talking here on behalf of Francois Brunier from titillers who's not able to join the conference unfortunately
Flora was here was a technical expert mostly on the on the client side Antonio and Juan was mostly on the back end. So so most of the team is actually here So if you have questions you go to them, so there's a typical thing with this logo
If you look at it from from this side, it was will tell you What will it say Good so a GN This is a thing that you have to see and then you never unsee it again
There's there's another thing with this logo It's it's a monk That didn't that makes a sign like this So those are those are the IDs of the designer behind this logo. We're considering to take a new logo
Although this one is very much appreciated, but we're still thinking about that so very short table of contents What's happening in June Network? I'm gonna throw a lot of topics on you
I probably don't have enough time to speak about everyone in detail But then we can have in the Q&A section more time to discuss it So short for those who are not who's not aware of G network So said I can do this really fast
Do your network? This is our website. It's a catalog free and open source. I wish your project founder is you don't take alert our bus At back then in the FAO It's adopted in numerous spatial data infrastructures and is Inspire ready and it has a growing community of users and developers of which you probably are
some So we share It's not handy that I'm looking like this because I wanted to talk to you probably I'm gonna stand here anyway
so the catalog is a way to share and organize the the spatial resources and It has a huge variety of metadata standards, which makes it kind of stand out between other catalogs This is our OS geo website, so we are an OS geo project since long
So that was the introduction to June Network it was pretty fast So what's happening in the community? Every year we have the Bolsona code sprint. I think we're on number 12 this year. So so We always invite all the OS geo projects there. But in practice it was is mostly the
Genome community joining up there Is it's a lovely code sprint in a lovely Italian monastery. So it's really Please join for example this year We discussed with with the tressress people the geo styler format that we discussed in some of the other
Talks Currently running is the OS geo Google Docs project and for for G another community. That's that's pulled by by Joe from Aston it's an amazing as effort from her so she's
setting up teams Engaging people we never met before and doing all kinds of Documentation efforts, that's it. That's a great value First results should come in the upcoming OS geo life It was a recently an elastic sprint which was actually at the second or third already where we are introducing
the current search index for elastic Elastic surge should improve the performance on on the larger catalogs and
Most importantly it will allow for clustering Because that's that's currently one of the big limitations of G network that is hard to cluster is possible we have some implementations, but it's it's not for the Average user but elastic search will will enable that Also
Sometimes we have limitations in the current search which would be really hard to implement in luching So with the last thing we will get that as a bonus so what what the Timeframe will be is a bit uncertain because it's a huge effort and and we're actually still looking for funding on that on that effort
But we hope that it will be next summer Looking a bit to flow out with the easy. It's not nodding yes or no, so we don't know So this is a thing I wanted to put in between it as Jew Jew cut we we currently offer a
Enterprise which is a commercial off-the-shelf product Which is the same code so it has the same GPL to license however We we release it a bit later than the community edition, and we offer longer support on that so so you have a
Three to five years support on that version This one can also be ordered as a hosted solution, so you have a kind of a One click Environment which is called yoga at life more on that on our booth, so this is a an interesting development
so the Flemish government developed a Geo DCAT app plugin That's so that's a DCAT is a is a format that is used in the open data community a lot however, it's it's kind of a challenge for G network because it's an RDF format and
You Know what is an XML oriented product and there isn't an XML encoding of RDF, but For example that doesn't have order where our XML world requires order in XML
in the in the properties So important in creating deacon geodica the app is quite simple and you network however importing it as JSON LD or turtle is it's kind of hard so that so we kind of made an intermediate wrapper that first converts
the RDF object into An XML object having a certain order so to your network is able to ingest that GDPR the the privacy regulation of the European Union even outside Europe you must have heard about it
One is used impacts on all of IT one of the mandates in that regulation was that that organizations have to set up a registry of data provenance and
Well logical choice would be to put that in an existing registry in your organization and the geo network could be one of those So we work with the Dutch National Health Institute to create a GDPR profile for geo network The GDPR model is quite quite similar
And there's things like title author that type of things But there's a couple of things that do not fit in the ISO model So we needed to create an extension on top of the ISO model, so we extended the schema but it has a so it was an amazing experience with those guys because also
When we started implementing that there was kind of also a return because they're there catalog was Growing considerably due to the effort and they had to go to all the departments to explain about GDPR and and their catalog so Also the efforts from them from the geo department were much clearer in the organization
So that was really a nice thing happening in parallel We're currently Investigating with a couple of our customers lightweight inspire harmonization
I've presented a couple of times on the on this topic on the inspire conference, but We see in a foot for those not here in Europe Organizations related to environment have to I comply to certain data models for their data and what we see is that that
People do that conversion to that European data model at the end of the pipeline So they work with their own models and then when all is done they do the conversion to the inspire model and This goes a bit against open data principles because you have to provide your data as primary and complete as possible
So that's why we're looking for alternative for this harmonization process and one of the things that we have Well, let me first do this this rule of thumb. So I always challenge organization saying okay, so you did this nice Transformation process, but now if I give you the inspire data set of your neighboring
municipality will you be able to ingest that go the other way and and put it next to your own data and use it in workflows and People then have to say, oh, I don't know about that. So
Our strongest advice the first advice we give is publish the inspire data in in in that transformed Format but also publish the original as is data. So people are always possible to go back to the originals Besides that we're suggesting
an RDF a type of approach where you tag your columns using the inspire ontology without touching the data and Let the consumers of the data do the actually harmonization step So so and and we're doing that based on the ISO 1 9 1 1 0 feature catalog
Standard so another thing this chemo.org Go and did the data crawlers. So we had a an interesting workshop at the JRC two months ago about catalogs and search engines and
Somebody from the your UK and geospatial Commission Presented that Their research at that found out that seventy five percent of the traffic to the catalog actually came from the search engine So if you want to promote Data and your catalog you have to make sure that your catalog is harvested by the search engines
and That's a that's a continuous effort to to Work on on search engine optimization for your catalog So in geo network 3.0. We added the capability to be crawled
But problems with spidering continued up to three six one which never released but you can you you could install it from git And that was partially related to the fact that there was low interest from from users as well as developers for this aspect and It's a bit of a shame
This is this is one of the tools that you can use to evaluate the this Crawling behavior of your catalog. This is the in this case the Google search console That gives you an indication of the coverage of your catalog how many records in your catalog are actually?
crawled by the spider and This this red line here is quite Flat because this is not Do you network was just but by geo API so I'm taking and by J API doesn't not have any errors usually in metadata you see a lot of errors like metadata or links in the metadata being invalid and
Then you see errors coming here Schema orc as you mark is a is a is a way to annotate your website So in search engines, so there's not just Google that that's all that being gandex is a wider initiative
Is able to extract structured content from that page for example addresses or opening hours of a shop? But they also have a schema or data set initiative, so if your website exposes Information about a data set and you tag it with this schema or data set annotations the search engine will be able to
Know that you're describing a data set So we always had the schema orc support As make micro data micro data is kind of a HTML way to do it However, this was replaced in 3-8 with a JSON LD type of approach
So we embed the JSON LD into the HTML and that's it's a bit more cleaner approach and was easier for us to to manage because schema orc has appeared to be quite fragile over time So If you have those those tags then then there's this initiative Google data set search that is able to
Find those data sets coming from the catalog So what's new in 3-8? 3-8 was actually launched last Monday So we actually was mostly Francois doing a lot of effort to finish it before this this conference, and it worked. I hope
There's not still too many blocking issues open that you're now confronted with else I'll suggest you wait till 3-8-1 It looks quite similar as 3-6 not not much changes on that side
But what is an important improvement is the workflow and draft so Antonio gave a presentation on this topic this morning So we have a You can now have a see a history of the of the all the edits and updates on your record and even
Jump back to a record in history if you're not happy with recent edits So if you're interested for this topic, please check out the video from from Antonio's presentation. That was really good presentation
Inspire meta data profile We're continuing to add improvements on that topic the thing is that also the validator is still in the kind of moving Goal that we try to
It so so that's a we're not finished with the with the metadata profile, but we're getting there For example, there was an improved anchor support. There is import vocabulary from inspire registry and Option to use a remote validator so you can use the inspire validator to validate metadata records
This is a this is a big one. So we had quite some discussion on the on the on the mailing list about this topic so up till 3.8. We have had ISO 1 9 1 3 9 as the default schema in in in G network but ISO 1 9 1 3 9 is 12 years old now the latest release and
It's a bit deprecated by ISO itself, but but in Europe is still quite common But we decided to remove it not remove it but Deprecate it. So so it's now Not the default schema anymore It's now ISO 1 9 1 1 5 dash 1 dash 3, whatever how you name it in the workshop
We we we we suggested to rename these standards and give them real names like tiger and lion Because that talks very much better ping-wing and Ginny pig But for now we still have this dash 1 and dash 3 and discussion
So in G network you have if you install it you have this schema by default ISO 1 I want to you know, I will still be available. No problem. If that's a relevant standard for you. It's one click to to Well, it's actually not a click but you load the templates of the proper schema that you want to have and it's there
We did some some patches on the on the 1 9 1 3 9 2 because Did ISO TC change some of their X paths of XML locations? so now that that's Fine again. Oh
That was it. I'm quite fast. No, thank you
It's really good to see that you're looking at including the new inspire validator service And hopefully that's in soon because otherwise I have to implement something for our portal
as part of that in Being able to call that service from within G network. Will you also provide an API? Version so we we could or our users could call that that validation through an API
So the ETF validator from inspire has an API that you can call well, yeah. Yeah. Yeah. Yes. I mean it's There's some discussions and some thoughts about whether Our NMA We had a service that called the European one and
Now we're looking to call the new ETF validator So the ETF project itself is also an open-source, yeah, I know the Dutch government implemented Deployed in their own ETF and applied their own rules in there That's that's what I've started looking at
But then I saw that if you if you guys are going to add that into G network Maybe I don't have to do so much Yeah Fantastic. Yeah, and and within that API you it's expected that metadata is in the catalog
We it doesn't it doesn't it is accept a remote Or a raw XML file. Yeah Okay This I think there is also a way to provide the XML at the end point, but I'm not sure I can do
No, I'll talk more with yeah with you as we go. Thank you Everybody happy. Okay Thank you, Paul. Look at their booth if you want to talk them