We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

ESA-NASA-OGC: Open Science Persistent Demonstrator

00:00

Formal Metadata

Title
ESA-NASA-OGC: Open Science Persistent Demonstrator
Title of Series
Number of Parts
266
Author
License
CC Attribution 3.0 Germany:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Identifiers
Publisher
Release Date
Language

Content Metadata

Subject Area
Genre
Abstract
The Open Science Persistent Demonstrator (OSPD) is a long-term inter-agency initiative aiming to enable and communicate reproducible Earth Science across global communities of users and amplify inter-agency Earth Observation mission data, tools, and infrastructures. This talk will highlight the status and roadmap of the initiative (kicked off in 2023) and will provide an outlook on the first pilot activities of the demonstrator, as well as opportunities for participation for the FOSS4G community. In the scope of this activity, ESA, NASA and OGC work together on the development of a long-term Open Science framework (e.g., a permanent open science demonstrator) in which participating organisations provide data, tools, and infrastructure in a coordinated approach, building on existing investments where appropriate. In the frame of this activity, the OGC supports the Open-Source and Open Science Community by developing a persistent demonstrator that makes Open Science more tangible to a bigger audience, helps in exploring new forms of communication of scientific results to stakeholders, and helps develop the necessary standards to ensure the highest levels of interoperability across participating organizations. At the same time, it makes Earth Observation results available to other disciplines and communities, creates attention beyond the Earth Observation community, and directly impacts decision makers and political agendas. The goal here is to demonstrate interoperable, collaborative research that allows reuse of existing components. These other resources are either offered as part of emerging Open Science Environments or in the form of either directly accessible “cloud-native” data/functions or by means of Web APIs. To reach this goal, it is essential to empower communities of practice to share FAIR (Findable, Accessible, Interoperable, Reusable) descriptions of their resources and capabilities. To allow this system to scale, it is crucial to avoid infinite combinations of community and application specific metadata, functions, data and products. One focus is the facilitation of direct participation of the scientific community as the primary users of this framework, and of the open-source for geospatial community as essential contributors to the activity. To handle modelling complexity, OGC, NASA and ESA will define manageable processes and best practices for communities conducting geoscience research in multiple domains using heterogeneous data and tools on a distributed infrastructure. These agreements will include, but not limited to, standards, vocabularies, and ontologies for data and workflows and develop community-wide open source science mechanisms, modeling considerations and design patterns.
Projective planeSpacetimeOpen setComputer animation
TestbedPersonal digital assistantOpen setStandard deviationCubeArithmetic meanAdditionComputer architectureMoment (mathematics)Different (Kate Ryan album)Software testingCivil engineering
State observerCASE <Informatik>Open setStrategy gameCategory of beingArithmetic mean
Open setCodeComputing platformOpen sourceFreewareMachine visionAlgorithmMachine visionComputing platformOpen sourceoutputLink (knot theory)Computer animation
Content (media)Enterprise architectureComputer programData managementProcess (computing)Design by contractGoogoloutputLevel (video gaming)Computing platformDifferent (Kate Ryan album)Computer animation
Decision theoryDisintegrationError messageComputing platformMultiplicationRepresentation (politics)Level (video gaming)Different (Kate Ryan album)Presentation of a groupBitIntegrated development environmentAlgorithm
Mechanism designRegulärer Ausdruck <Textverarbeitung>Cartesian coordinate systemProjective planeComputing platformCASE <Informatik>Computer animation
Computing platformVisualization (computer graphics)Integrated development environmentOpen setService (economics)Decision theoryComputational physicsData analysisAlgorithmComputing platformConnectivity (graph theory)Computer animation
Product (business)View (database)Computing platformPerspective (visual)Different (Kate Ryan album)Library catalogComputer animation
Mathematical analysisProduct (business)CalculationDynamical systemProcess (computing)AlgorithmINTEGRALComputing platformComputer animation
Visualization (computer graphics)Product (business)Integrated development environmentInterface (computing)Interactive televisionConstraint (mathematics)Coma BerenicesDescriptive statisticsComputing platformKey (cryptography)DivisorElement (mathematics)Computer animation
Interactive televisionDuality (mathematics)Euler anglesIntegrated development environmentEmpennageWitt algebraMenu (computing)Data recoveryState observerComputer animation
Hill differential equationInformationDomain nameSmoothingDisintegrationSystem programmingLevel (video gaming)Computing platformVideoconferencingMusical ensembleLibrary catalogComputer programmingVisualization (computer graphics)Computer animation
outputFunction (mathematics)Open sourceAlgorithmCodeComputing platformFreewareOpen setCluster samplingIntegrated development environmentOpen setComputing platformExtension (kinesiology)Projective planeBitINTEGRALLaptopSoftwareInternet service providerComputer programmingNatural numberGroup actionMultiplicationStrategy gameComputer animation
Set (mathematics)IRIS-TSoftware testingInformation Technology Infrastructure LibraryLjapunov-ExponentProjective planeCodeNumberCubeMathematical analysisObject (grammar)Key (cryptography)Software testingParallel portMeeting/InterviewLecture/Conference
Broadcast programmingPhase transitionDependent and independent variablesComputing platformInformationAlgorithmCubePhase transition2 (number)Encapsulation (object-oriented programming)Level (video gaming)Portable communications deviceState observerFaktorenanalyseMusical ensembleError messageProjective planeWebsiteDescriptive statisticsScheduling (computing)Mathematical analysisNewsletterBit rateComputer animation
Computer animation
Transcript: English(auto-generated)
We'll talk about these giant initiatives of these two agencies and the OGC, as the Open Geospatial Consortium. So we have the European and national American space agencies that are introducing a new
project which we're working actually on that, I guess, almost a year to set it up already. And we're really thrilled to talk about that. And give you the opportunity to join this.
Because this will be led by OGC, meaning that this is open for participation in general, while this is driven by ESA and NASA for the moment. So as you may know, we are running in OGC the different innovation activities in addition
to civilization. And this innovation activity is the opportunity to test new approaches, to push forward the standards and to really build on that together. And there are some preparatory work that was done when we were working on this persistent demonstration for open science, like the testbeds on the data and open data cube architectures.
So briefly about the values that we want to promote that were agreed. These are actually based on the ESA Open Science Policy and Strategy. So the idea is that we want to share the best practices of this research on the Earth's
observation, give access to these resources and to the knowledge that is used in this community, make it more sustainable, meaning that it can be used wider in the communities
that were not so much engaged because of different reasons, because of the lack of the resources, because of the lack of the knowledge, but also because there were in the other categories, in the other sectors, and Earth's observation has so many use cases in the other sector that were traditionally not perceived, that this kind of insight
and this kind of demonstrators can really show how this can be used. And finally, that should drive the business, so that should really facilitate the uptake
in the commercial industry of the Earth's observation. I'm not sure why it's not switching, okay. Yeah, so the vision is that we have the open data and the open data is quite common
nowadays, even though that we are always struggling with the access of that data and we're already quality of that data, the idea is that we want to push that forward. So we don't only want to have the data, but we want to have the knowledge that link to the data. We want to have the algorithms and the idea of this persistent demonstrator is to have
the open source algorithms that are processing that data and producing new resources to have the open access to that and open access to the platforms. So, also to have this initial steps that could be done without particular inputs from
the participants. So, we're really working on the education and we're really working on the infrastructure. So in our perfect world, we have all of that initiatives in here that are working
together and really they are on multiple levels. They are really exploiting what's available in their own way. So, each of the participants has really their own expertise and their own meaningful input. But the reality is usually like this.
So, there are ecosystems around the platforms more than the ecosystem of the platforms. And all of that is used in different ways. And everything is pretty much not transferable. So, we cannot move from one platform to the other.
The concept is now to harmonize it a little bit. To harmonize this heterogeneous environment of different platforms on multiple levels. So, that will be on the infrastructure level, on the data representation, on the algorithms representation, on the execution.
And all of that should result in the faster uptake and to really build these new capabilities among the communities. And there is an in kind contribution from the agencies already. So, I'm not sure if you are following just yesterday.
I think that there was an ITT released from ESA. That's called Earthcode. I will just briefly talk about that. But already we have these two platforms, VEDA and Earth Observing Dashboard, which were built in the last couple of years and will be used in these persistent demonstrators
as the platform for the showcases of these solutions. First one is VEDA. That's provided by NASA. And NASA is working on the well, providing open data to the case or something like that. And they want to move forward. They want to move to these open science.
They released the policy that's SPD 41 that's really guiding how this open science should be built. And so, the policy is naturally not everything because we need to have the resources. So, this is the project that's providing also the opportunity to use this infrastructure
and to build this research application together. So, that's that are the components of these VEDA platforms. You have the data that's accessible on the platform. You have the infrastructure to compute the data. And you have some tools that can be deployed or already deployed on the platform.
So, the idea is to put more algorithms. The data is there. But we want to put more algorithms and more outcomes of that algorithms in the platform. And this is the yeah, this is the workflow how the how the data can be used and how
the open science can be represented in this platform. So, we have the catalog naturally of the resources with different views from different perspectives. We're going to analyze that. So, we have this Jupyter integration into this platform. So, we can run the algorithms already online.
We can try it out. We can produce new outcomes and then publish it to the platforms. Naturally that has some constraints. But the constraints bring these added values. So, you have the harmonized way of representing the data and browsing. So, we really try to pull out the key factors and the key elements of description of this data.
And then there is the storytelling is quite useful, it turns out. Because people who are not in the industry, like they are not earth observation nerds and working on that for a couple of years, are really not aware of the capabilities of these solutions.
And the storytelling can show you, okay, you can have the problem. You can solve it with this kind of solution, with this kind of data. The other platform. So, we are talking about the interoperability. So, we have two platforms now. And these two platforms should be somehow replaceable.
And the solution should be portable among those two. And the NASA ISA, YAXA, your dashboard was built, I think the publication was during the COVID. So, the first scenarios were really around the COVID and all of that stuff. So, you can already log in to this dashboard and see what's available. That's pretty much the same in general.
It also provides you the way how to, yeah, I guess this video here, yeah, so the video is actually presenting what's available. So, we have the visualization of the catalogs. We can narrow down. We can drill down to the actual data.
And this data is produced based on the contribution from this, from the AO dashboard program. So, we also have the integration of Jupyter notebook.
So, yeah, that's running or not. Yeah. It's running. So, there is a Jupyter notebook integration so we can actually access also the outcomes of the other work that's shared naturally. So, we can collaborate on this platform and you can publish that notebooks as well for
the community. And the Open Science group in the ESA strategy is actually to put everything on that platform. So, the idea is that all of the projects that will be run on this program of Open Science will be exploiting this platform.
Yeah. And this is a new initiative. So, as mentioned, there is an ITT now. And I shall invite you to look into the ESA gender-ink platform. So, just yesterday it was released. So, now we have something like three months to apply for that. And two months.
But anyhow, it's short, two or three for this kind of solution. This will be a multiyear project with possible extensions. And the idea is to push that a little bit forward and integrate it more open. And to really integrate it with the network of resources.
Network resources is the initiative that ESA is supporting and it's providing access to the infrastructure. So, we have those multiple European infrastructure providers. And you can apply for the resources through the network of resources by ESA. So, we will have kind of available credits to use in that platform.
Yeah. This is kind of summary of the objectives of this SPD. So, the idea is that we would like to have it persistent. We see that there are multiple projects that are running and the resources are available
somewhere or not. So, we can come back to that or not. We can try to reproduce what was really the research matter of the projects. If we set up our infrastructure. But here you have the data. You have the argons. So, you really are able to run it online so you can test it and you can extend in
the next projects. And yeah. There's a number of questions here. So, the mentioned analysis data, the data cubes technologies are one of those. So, in parallel to this Earth code tender, we are running this persistent demonstrator
which is run by coordinated by OGC which will try to answer some of these key questions. How this infrastructure should be built to make it really interoperable. And this is the schedule.
So, now we are setting up the RFE in the OGC. So, I invite you to observe the OGC website because or the newsletter. Because just in a month there will be RFE released. And based on this RFE request for information, we will tailor the RFP.
So, request for proposals. And proposals for this kind of project means that you are proposing something that could contribute to this, answering the quick questions of the pilot. So, how can we build these data cubes?
Or how shall we build this portable algorithms encapsulation? How shall we integrate those information level? Because naturally we have also the factor analysis ready data ideas is that we have some key principles of the data description.
So, the data is actually reusable from platform to platform. So, moving from ESA platform to NASA platform, the question is how much of the data can be simply reused? So, if we have this basic understanding of this analysis ready data, then we can move
forward. So, this will be the first step. This next second step is next year. So, as you can see, the timer is quite tight. Here we are releasing the RFE. And here we are implementing the first phase of this persistent demonstration. And then next year we are running the second phase. So, we are refurbishing that.
That doesn't matter that you cannot join the second year, but it's better if you join at least as the observer in the first year because you then know what's really the outcome what are the problems and what can you propose for that.