Big Data at the heart of open geospatial innovation
This is a modal window.
The media could not be loaded, either because the server or network failed or because the format is not supported.
Formal Metadata
Title |
| |
Title of Series | ||
Number of Parts | 208 | |
Author | ||
License | CC Attribution 4.0 International: You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor. | |
Identifiers | 10.5446/40931 (DOI) | |
Publisher | ||
Release Date | ||
Language |
Content Metadata
Subject Area | |
Genre |
00:00
Open sourcePresentation of a groupUniform resource locatorLecture/Conference
00:30
Projective planeLecture/Conference
00:44
Open sourceLatent heatProjective planeRootGroup actionUniform resource locatorLecture/Conference
01:23
Moment (mathematics)Internet service providerLatent heatData managementProcess (computing)Projective planeNumberGoodness of fitMobile appService (economics)Open sourceBitSoftware developerUniform resource locatorSoftwareLecture/Conference
03:16
Vector spaceModule (mathematics)Uniform resource locatorFocus (optics)Limit (category theory)Projective planeCartesian coordinate systemConnectivity (graph theory)Interpreter (computing)Self-organizationFlow separationOrder (biology)Software developerService (economics)Task (computing)Variable (mathematics)Element (mathematics)BitQuicksortMoment (mathematics)VelocityResultantTwitterAdditionWordPresentation of a groupCollaborationismLevel (video gaming)Open setNatural numberVolume (thermodynamics)Group actionPoint (geometry)InternetworkingComputing platformMultiplication signTerm (mathematics)Library (computing)InformationDigitizingSatelliteAngleLecture/Conference
10:33
Point cloudSpecial functionsSubject indexingType theoryVirtual machineData structureFunctional (mathematics)Data storage deviceRepository (publishing)Uniform resource locatorMultiplicationNeuroinformatikSet (mathematics)MathematicsSoftware frameworkKey (cryptography)ScalabilityRevision controlSoftwareCASE <Informatik>Projective planeInteractive televisionTable (information)Integrated development environmentDigital photographyService (economics)Order (biology)Standard deviationLecture/Conference
Transcript: English(auto-generated)
00:01
Good afternoon. Thank you for attending this talk. My name is Mark Veronc. The title of this presentation is Big Data and the Heart of Translational Innovation and the Sublime Location Act. I work for the Eclipse Foundation. A little introduction for those of you who don't know it yet.
00:23
The Eclipse Foundation is one of the top open source foundations. It boasts a growing amount of organizational and individual members. We will collaborate on this innovative technology
00:42
that has translated into a growing amount of projects. We are now slightly over 30 open source projects within the foundation. It has its roots way back when, 10 or 13 years.
01:00
We are now growing towards what we call a community of communities. What do we mean by that? We try to focus on specific industries, markets, segments, industry verticals. We do that through what we call industry working groups. On which one is location tech.
01:21
It is a location aware working group. Among the likes of the science working group, the IOT working group, we have at the moment 1, 2, 3, 4, 5, 6, 7 working groups. The number has grown rapidly. What do we do as a working group?
01:41
We collaborate and innovate on the creation of what we call commercially friendly technology. Specifications and best practices really value quite a lot, and that is for specific industries and markets. I am out to do this in 20 minutes, so I am a little bit speed talking.
02:01
Forgive me for that. What do we do as location tech, as a working group? Well, sustainable open source projects need good governance and transparent processes. That is the heart of what we try to achieve.
02:23
We have four, say, sub-activities. One is what we call the development of communities ecosystems. I will come back to that later, but an ecosystem is what, in my opinion, is traditional. This community is more traditional, developer community notion,
02:46
and the ecosystem has a little bit more to that. That is the crossroads where projects meet end users meet service suppliers. We try to supply our members with a infrastructure to develop
03:05
and test new projects, new tooling, new apps. And last but not least, we provide IP management services. Anybody who uses our software should be safe, literally safe, secure, and assured that no lawyer is going to chase him or her.
03:29
And we have for that specific license, that is called the EPL license, in terms of public license. Well, location tech, we are, amongst others, partnering with OTC and ORSGIO.
03:46
Regarding ORSGIO, we are working together on the organization of Foster G North America next year, which I am being the chairman. We work on several project development initiatives,
04:02
and we sponsor, for instance, the Godspeed next Saturday, we hope to see you over there. As I said, we are more than just a community of developers. We try to provide added value to service suppliers, which is quite a lot now sitting here,
04:22
individual and joint projects, and user organizations. That all results in what are called collaborative market development. Traditional communities have difficulty reaching out in a more commercial sense,
04:43
and that is a gap that we try to fill up. We do that with the offering of commercially friendly, and that is a word I always have to sort of read out loud, a temporal, spatial-aware software. With, and now the real title of this talk comes into play,
05:04
a special focus on big geospatial data. Location tech, to sort of bore you a little bit more with it, but we have recently established and communicated a new mission.
05:21
We are to be the international platform for sustainable, technical, and commercial collaboration for open geospatial, with the focus on commercial technical value-add to the members, and we promote diversity of interests and partnerships. The more angles we have towards a project,
05:44
the more sustainable it will be in the long run. And with our special focus on geospatial big data, we initiate and build tools and applications for the challenges
06:00
that big geospatial data trends at the moment pose to us. The execution is rather simple. Either we recruit projects and find projects to join our fault, and thereby fill in the gaps in our portfolio.
06:22
3D, geocoder are a few gaps we might still have. And if we can't find them outside of our ecosystem, then we have to create them ourselves. And last but not least, we are there to increase and broaden the use of data.
06:43
About that, at the moment we are very America-focused, and one of my tasks is to have a European membership that is built. Unfortunately, I have read somewhere in the Internet
07:00
that something at the DCA comes from America, so my point is that fishing is rather small, relatively speaking. The working group itself, we have a steering committee. Some members have a permanent seat in it, depending on their membership level.
07:20
Others are invited or elected, and those come from participating members. As you see, they are rather grounded by nature. And we have a special group for academic and research institutes
07:42
and the likes of both of you, called non-profits. The future of big data, and big digital information data in particular, When one thinks of the fact that the amount of data is growing by 20% per annum,
08:05
and that's due to the terrible increase in sensors, satellites and social networking devices, then we wouldn't say that about 80% of that amount has been sub-weighted,
08:23
and that 80% is a geospatial component. Now, there's huge amounts of data. Well, how can you retrieve any actionable intelligence from it? So, in order to monitor, manage, slice, dice, interpret and edit,
08:45
that's where the application thing can really push forward. Because the limits of open spatial components and the addition of components of tools has sort of, for me, arrived at.
09:04
Steve, I'm sitting in the front here, this morning he said, well, it's all about volume, velocity and variability. And it was ringing a bell. And I had to change a little bit in my presentation about big data,
09:22
because it's big volume challenges. Speed, velocity, is also an issue. How to process that without waiting days on end for a day in result. And how are you going to group?
09:42
Well, that's where the more spatial component comes into play. We try to really get the history of data. So, what we try to achieve is get the variability measured along the axis of time.
10:04
Although we have to research the project for that later on, but as we mentioned earlier, talk is wrong. A couple of projects that I want to highlight. We have a location tag, geome-mesa. And that's actually a collection of libraries and modules
10:23
by which you can manage those millions and trillions of vector data, where the streaming is enabled, and it provides support for SQL, Spark SQL, HVACs, et cetera, and others.
10:42
And it has special functions that do what we call cloud storage business. Another one, location tag geo-wave. Also a library. And now I have to really read out what it does.
11:00
It's connecting the scalability of distributed computing frameworks and key value stores. I hope you know what I mean by that. With modern geospatial software to store, retrieve, analyze big geospatial information on data sets. My name here is Scalable, and it allows for interactive type detection.
11:24
It provides indexing functionality to, among others, acumen and table entries. And last but not least, it provides related to GeoSurfer in order to visualize and share data.
11:43
The third project is location tag geo-trails. The framework by which large and small data sets are distributed.
12:00
Sorry, I have to restart again. The framework to process large and small data sets with low latency by distributing computation across multiple threads, cores, CPUs, and machines. And especially with distributed algorithms, it's very nice to have a cloud environment.
12:21
It provides speed, and it allows you to bring in a version for the ARG data structure. And it's helped also to create simple and standard REST services. Then the geospatial project that we promote.
12:44
And that is geogit, location tag geogit. We call it the distributed version for the system, especially designed to handle geospatial data efficiently. It is effectively inspired by the GIT system, the version of the system, especially.
13:02
And we can import raw data and put that into a repository. And every change to that, to the data, that repository is tracked. So that allows versioning, branching into separate offices, merging back it, and pushing it to a bunch of repositories.
13:22
I want to finish off with the fact that cosmo.g in North America is next year. So if this cosmo.g is really letting your appetite, please come over to secure this next year in April. And if you have special information, if you need special information, then this visit is across and it's 214.
13:45
Here we don't have the answer. We can grab somebody to provide you with more detailed answers to your questions. More info? Have a look. We made a photograph and we are done with the rest of the case.
14:01
Thank you.