Standardcompliant geoprocessing services for Earth Observation timeseries data access and analysis
Video in TIB AVPortal:
Standardcompliant geoprocessing services for Earth Observation timeseries data access and analysis
Formal Metadata
Title 
Standardcompliant geoprocessing services for Earth Observation timeseries data access and analysis

Title of Series  
Part Number 
19

Number of Parts 
193

Author 

License 
CC Attribution 3.0 Germany:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor. 
Identifiers 

Publisher 

Release Date 
2016

Language 
English

Production Place 
Bonn

Content Metadata
Subject Area  
Abstract 
Earth Observation timeseries data are valuable information to monitor the change of the environment. But access to data and the execution of analysis tools are often timeconsuming tasks and data processing knowledge is required. In order to allow userfriendly applications to be built, tools are needed to simplify the access to data archives and the analysis of such timeseries data. In this work, web services for accessing and analyzing MODIS, Landsat, and Sentinel timeseries data have been developed based on the Web Processing Service specification of the Open Geospatial Consortium and made available within the Earth Observation Monitor framework. The Python library "pyEOM" has been developed to combine access and analysis tools for Earth Observation timeseries data. Algorithms developed to analyze vegetation changes are provided as webbased processing services in connection to the prior developed access services as well. Using the services developed, users only need to provide the geometry and the name of the dataset the user is interested in; any processing is done by the web service. The services and applications (web and mobile) are based on geospatial open source software.

Keywords  University of Jena Department for Earth Observation 
Related Material
00:00
Standard deviation
Metropolitan area network
State observer
Presentation of a group
Multiplication sign
Mathematical analysis
Time series
Mathematical analysis
Evolutionarily stable strategy
Web service
Vector space
Message sequence chart
Web service
Series (mathematics)
00:38
World Wide Web Consortium
State observer
Presentation of a group
Scaling (geometry)
Algorithm
Multiplication sign
Connectivity (graph theory)
Mathematical analysis
Internet service provider
Similarity (geometry)
Set (mathematics)
Database
Data analysis
Cartesian coordinate system
Orbit
Web service
Process (computing)
Web service
Social class
02:28
Point (geometry)
Pixel
MUD
Multiplication sign
Plotter
Artificial neural network
Set (mathematics)
Control flow
Mathematical analysis
Special unitary group
Emulation
Twitter
Mathematics
Analogy
Personal digital assistant
Moving average
Utility software
Extension (kinesiology)
Area
Algorithm
Information
Number
Angle
Personal digital assistant
Series (mathematics)
Right angle
Hydraulic jump
Spacetime
04:07
Open source
Disintegration
File format
Set (mathematics)
Shape (magazine)
Student's ttest
Demoscene
Web service
Optics
Different (Kate Ryan album)
Googol
Form (programming)
World Wide Web Consortium
User interface
Metropolitan area network
Mobile app
Satellite
Web portal
File format
Server (computing)
Interface (computing)
Computer file
Sound effect
Cartesian coordinate system
Open set
Orbit
Arithmetic mean
Web service
Different (Kate Ryan album)
06:06
Electronic data processing
Multiplication sign
Moment (mathematics)
Set (mathematics)
Database
Mathematical analysis
Subset
Web service
Software
Web service
Series (mathematics)
Internet service provider
Process (computing)
Information
Middleware
06:51
Point (geometry)
Web portal
Greatest element
Scripting language
Logistic distribution
State of matter
Mobile Web
Mathematical analysis
Client (computing)
Web service
Degree (graph theory)
Different (Kate Ryan album)
Process (computing)
Multiplication
Middleware
World Wide Web Consortium
Algorithm
File format
Open source
Mathematical analysis
Client (computing)
Internetworking
Web service
Series (mathematics)
Internet service provider
Different (Kate Ryan album)
output
Middleware
Data integrity
Geometry
08:12
Polygon
State observer
Web portal
Pixel
Mobile app
Scripting language
Open source
Multiplication sign
Mobile Web
Disintegration
Mathematical analysis
Architecture
Web service
Natural number
Singleprecision floatingpoint format
Reduction of order
Energy level
Process (computing)
Gotcha <Informatik>
Pixel
Multiplication
World Wide Web Consortium
Metropolitan area network
Information systems
Open source
Mathematical analysis
Library catalog
Singleprecision floatingpoint format
Software
Infinite impulse response
Web service
Series (mathematics)
Library (computing)
09:26
Metropolitan area network
Slide rule
Standard deviation
Open source
Weight
Cellular automaton
Moment (mathematics)
Bit
Client (computing)
Latent heat
Process (computing)
Uncertainty principle
Personal digital assistant
Logic
Web service
Revision control
Statement (computer science)
output
Utility software
Process (computing)
Engineering physics
Resultant
World Wide Web Consortium
11:27
Point (geometry)
Identifiability
Open source
Computergenerated imagery
Maxima and minima
Client (computing)
Formal language
Web service
Pi
Latent heat
Degree (graph theory)
Software
Process (computing)
Extension (kinesiology)
Execution unit
Dependent and independent variables
Java applet
Open source
Database
Flow separation
Degree (graph theory)
Process (computing)
Software
Web service
Interface (computing)
Statement (computer science)
output
Quicksort
Cuboid
12:35
Area
Metropolitan area network
Polygon
Programming language
Execution unit
Geometry
Link (knot theory)
Link (knot theory)
Computer file
File format
Polygon
Data analysis
Function (mathematics)
GEDCOM
Product (business)
CAN bus
Latent heat
Process (computing)
Geometry
14:14
Area
Polygon
Metropolitan area network
State observer
Execution unit
Pixel
Identifiability
Computer file
Multiplication sign
Mathematical analysis
Function (mathematics)
Emulation
Medical imaging
Web service
Series (mathematics)
Function (mathematics)
Charge carrier
Hydraulic motor
Cuboid
Pixel
Row (database)
Form (programming)
15:05
Polygon
Server (computing)
Computer file
File format
Set (mathematics)
Online help
Plot (narrative)
Google Earth
Googol
Process (computing)
Information
Control flow graph
Metropolitan area network
Geometry
Computer file
Interior (topology)
Data storage device
Data analysis
Statistics
Inflection point
Process (computing)
Raster graphics
Series (mathematics)
Function (mathematics)
output
Musical ensemble
Data integrity
Geometry
Library (computing)
16:03
Disintegration
Set (mathematics)
Branch (computer science)
Mathematical analysis
Function (mathematics)
Parameter (computer programming)
Data analysis
Google Earth
Twitter
Medical imaging
Web service
Computer configuration
Different (Kate Ryan album)
Endliche Modelltheorie
Execution unit
Workstation <Musikinstrument>
Algorithm
Software developer
Moment (mathematics)
Open source
Mathematical analysis
Data analysis
Product (business)
Series (mathematics)
Revision control
Different (Kate Ryan album)
output
Parametrische Erregung
Data integrity
Library (computing)
17:45
State observer
Mobile app
Link (knot theory)
Open source
Disintegration
Mobile Web
Calculation
Mathematical analysis
Google Earth
Cartesian coordinate system
Web service
CNN
Personal digital assistant
Set (mathematics)
Form (programming)
World Wide Web Consortium
Area
Metropolitan area network
World Wide Web Consortium
Workstation <Musikinstrument>
Image resolution
Open source
Parameter (computer programming)
Client (computing)
Product (business)
Series (mathematics)
Different (Kate Ryan album)
18:21
Point (geometry)
Electronic data processing
Process (computing)
Polygon
Mathematical analysis
Set (mathematics)
Client (computing)
Computer
18:45
State of matter
Multiplication sign
Client (computing)
Client (computing)
Data analysis
Field (computer science)
Twitter
Process (computing)
Web service
Series (mathematics)
Chain
Figurate number
Form (programming)
19:42
Satellite
Email
State observer
Scripting language
INTEGRAL
Length
System administrator
Web service
Ontology
Cuboid
Process (computing)
Information
Local ring
Descriptive statistics
Physical system
Area
Presentation of a group
Metropolitan area network
Bit
Open set
Process (computing)
Auditory masking
Internet service provider
Interface (computing)
Selforganization
output
Task (computing)
Resultant
Point (geometry)
Link (knot theory)
Disintegration
Time series
Mathematical analysis
Rule of inference
Event horizon
Latent heat
Software
Harmonic analysis
Software testing
output
Implementation
Task (computing)
World Wide Web Consortium
Rule of inference
Computer program
Mathematical analysis
Library catalog
Symbol table
Word
Personal digital assistant
Web service
International Date Line
Pressure
24:24
Polygon
State observer
Program code
Pixel
Structural load
Length
Set (mathematics)
Public domain
Function (mathematics)
Parameter (computer programming)
Data analysis
Web service
CNN
Semiconductor memory
Cuboid
Physical system
Area
Metropolitan area network
Computer font
Geometry
Link (knot theory)
Channel capacity
File format
Moment (mathematics)
GEDCOM
Demoscene
Process (computing)
output
Software testing
Hill differential equation
Quicksort
Point (geometry)
Functional (mathematics)
Link (knot theory)
Open source
Abstract syntax tree
Computer
Rule of inference
Graph coloring
Pi
Term (mathematics)
Internetworking
Energy level
Form (programming)
User interface
Focus (optics)
Interface (computing)
Weight
Cellular automaton
Polygon
Library catalog
CAN bus
Query language
Library (computing)
00:08
but by far less these days you need
00:11
do is evident from the University of Genoa here in Germany and the people of the acculturation so thank you for the introduction welcome to my presentation about a geoprocessing services for this observation time time series data vectors and analysis at our department for Earth observation here we're doing a lot of time series data and of course with time series analysis and of course
00:38
the question is how to access these um this observation times data and how you how scientists but also known as users to get access to the data and make some analysis or execute some analysis services class you might have in the 1st presentation of the 2nd session we have a bunch of both observation satellites in orbit and they are delivering data and data provided by due usually providing access to the data in databases in 5 5 service from a providing web based applications as some of providing is so certain so services but no they're very different different so some of us of a similar set of services and in general and we want to have a web based tool for web service for 1 to have a mobile that way you connect access the of datasets and also access some analysis and this is so when the question comes in and what is necessary when developing and and and application based on spatial time data and
01:53
we need to integrate integrated and animal scales of the the 1st component like for for example some web services to make data discovery but also data access and data analysis more and more usable for these kind of applications or also for for users so and this is why we were talking about uh the geocoded processing service because you can use them to access data and to to analyze data sets and also to discover what kind of data is is available
02:29
so 1st of all let let me introduce our use case we have in our department so we're working a lot with the mutation time Tuesday
02:37
that you will see here plot of a single pixel will the enhanced mutation in Mexico and information about the vegetation utility and this is from from them all the angle from thousand to to 2015 and we clearly see here negative trend of the debilitation and next and we also see a clear change in time and cost the vegetation that this has a higher when well years from 2000 to 2010 and after was we're we have lower well yes but beside excess besides just talking the data sets and then the science community is given of different uh algorithms to choose make it more clear today to to extract semantic information like you can see on on the uh top right plot this is the break points and that was the so called the fast and you clearly can identify the change in the seasons is when this season analogy of the signal so we can directly extract and at the time when the change has happened and also for this is a space spatial extent but the brown area indicates a negative trend of 2 vegetation and the green areas um indicates some positive trend so the and these algorithms that have been developed to and from the the science community there
04:09
doesn't describe some of this research papers and everybody can use and then they open source then and they are available and that you need you just need the data on the 1st thing and then you you need to set and set up for you still the effect but we have a
04:32
bunch of this observation satellites in orbit as at her and told you be before there there is another more understandable from 2001 to now well the daily coverage and and that the data accesses is very diverse like you have access to to size service but you can also use some some so web interface you can use the web portal by giving a web portal is not a good thing when when he went out to make the axis and the original data formats is it's an inmate when talking about lands on the day of the original data from other students if they have also some some portals or you can use Google or Amazon due to access some data sets and with the with will with the new use of them from the data that there are new data formats coming up like shape actually 2004 the optical datasets and they are and also you even has some different ways to access the data felt like search interface where you can also use the little farmers in the web portal but the mean the problem is we we have different access possibilities different file formats and no standardized services to to integrate these data sets and and then on application form for example so we need a solution and endeavor scientists need this solution for this to do not deal with 1 of these different file formats and is still different data access services so and also for
06:09
for the database the data
06:11
and data processing at the moment that every user has to to search for the data to request the data sets and to download the dataset and to process the data that usually so will would be more better to have I call this an ideal city situation to have a kind of a middleware between the user and the data providers and provide services to up to ultimate of these things and doesn't as possible as you may have seen in the 1st presentation by by met was this alliance that June human tutors software so what what we need is easy to use web services to to make us observation times x data access
06:52
and analysis more affordable and more more using his book usable by about all kinds of of users and so on but
07:01
what we have developed and then integrated with this kind of of middleware suffering we're at the
07:07
bottom we have these different data providers like now as I use GS is arguably Amazon and that we have different clients so you could also use you know or you can also you can build your own client and use all services and will the middle where we we have the different tools and of the tools are exposed as geoprocessing services either for the data and discovery and we will see is some some examples later they they want but also for the data integration so that the user can now I can add the point of pomegranate geometry as an input and the state and name of the dataset and this is the way the Web Processing Service means that integrates the data in a common data format and based on these that we have these assigned to the guy algorithms have shown at the beginning and all the data also this is provided with a logistic compliance services so that that that that clients like a web portal mobile that
08:13
can can make use of the services so the services
08:18
of based also on on the open source software we using for the data processing the entire WPS etc. that not comply are assumed to subserve written in Python and for the the OGC Web Processing Service but as a set before we we are also providing the the dataset and the data we have integrated into the new apps will vote compliant services so we use that the the idea I as the as low as for a patternbased library for those observation services so we use this for a single pixel at time serious by levels of natural reduce service as a possible for hours for preserving the WMS or uh also a WFS for for the analysis of sports um and the catalog service to to also provide some some data because if you in which you do in anything like the you process that the data is also important to create new metadata so that that users knew what has been been been done so
09:27
let let me talk a little bit of 1 just have 2 slides about the OGC Web Processing Service spins in the the the case in favor of of specifications and in general of course we have different different methods like the d do you get capabilities to show what kind of problem processes are available and then we have the described process to identify what kind of inputs and outputs and that's a several Sarah will then the process and with the executes statement we can also executes and then only the problem the process we can do this in the synchronous way but also in as from this weight so that means that the client need to pull the and this so what about the this status so will this we can implement the processes that also takes as some of our sources Hyundai's or even longer and will when the Indian woman of these troubled process began nearly do everything so with the peptide that w appears we're using it and you you can integrate them all kinds of processing tools in the standards that are available and Titan logic can also use of course my command line dude utilities and they're executed from from the Department in the T. within a cell so at the moment that there there 0 . 1 is the most used as a specification and have a really fracture I think it's a few months ago there was there's news said 0 . 2 specification was was published with further now and methods like its status get resultant and missed by by these metals are still there are still available so you see here
11:20
shown some some examples of at the top where we have our WPS and find that we have a 1
11:28
regressors detective ability is 1 that the by process was the the process identifier and the 3rd 1 is the the execute stage a statement so it is really easy to to execute and the WPS service as an example you we have just a process identifier and this database data data data inputs we have today is the dataset name and uh client that says 0 and the the expired them and the white point and that's all and and will this week and executed the WPS and there are several open source software
12:06
that that provide are provided WPS specifications like 52 last WPS in BadenBaden based on you have a higher degree WPS also you have a base is is WPS based but also with additional support that the process languages the pie WPS we're we're using up by other GeoServer has an extension for WPS sort let me show you some examples so
12:36
about the data discovery the data and the data access and the data analysis so this is the 1st known example from uh from our process uh to discover what kind of sentinel 1 datasets are available in a specific area of interest so this is the the the polygon and I went on text from performance and then you can sort out from from the product and didn't visually what we have integrated as a as a minimum overlap so so we're really only work in in this breast we are only interested in the central 1 sees that have the
13:15
minimal overlap will off of 70 % with the area of interest and indeed the output can be quite quite different what we have integrated as easily format so that so that have pro programming language can can easily access and this file with the the valid and if I was the calculated overlap a download link and the geometry of the central 1 c and this can be it can be extended or we can also just provided the dominant things for for example and so this is a way to to make data discovery more usable for a because we only need to execute that the process was and polygon geometry and the minimum overlap for example we have thought processes for far for data the data axis this is an example for the
14:14
motors vegetation times is that records for a pixel as only before and the the output as we we we have several outputs like uh directly plotted PNG image uh by the but also receive use and sees the file and as I said before and this is the file is also exposed as a sensor observation service and at traditionally well but we've also provide as an output as a unique identifier we can use this unique identifier and later on to to make our analysis form for
14:52
example and then this is nearly the same for for if you want to extract them carrier and not the only a single pixel in an area of interest uh again he had the means the
15:06
input of the uh the the geometry and put an and for for this we're we we have extracted DNA before we have downloaded the the data sets and extracted the data according to to their geometry and store the data and common help the format and as you can see and CTS helpful for each data synergy attentive but we have also and then we would bands have file so that and then you can very easily use this help or downloaded the
15:41
datasets also users in their own down on programming library for for example as I said before we we we have a unique identifier for for each of the data integration processes and thus have has been introduced to 2 referendums 2 data sets that is still available on our server and to to make on
16:05
and then to execute our analysis because then we can just provided the unique identifier out from the atria executed WBS service and then say OK please make this breakpoint analysis and there also of other options for the different parametres so I a parameter that is available for them this algorithm is also expose up here can be used as a data and data data data data input and this will be the output of 1 PNG image but also the the data behind a lot and this is the same for the green branch from a trend analysis so
16:49
well this is all based on on uh and this is a Python library where we we we are developing at the moment it's got tight you and so this is purely on development but this is available with the Quran stayed with uh on like it up and and that is the mainly for for data discovery data integration and at the moment that data analysis will will be integrated and very soon we have different data and datasets available so a lot of models of acts and there here and you need you can use the software on on your own several for example and hear some some examples how how to use it for example for for data ingestion and and behind this this method is that the the complete a Donald after data sets from from other services can have for
17:45
example and and the whole most of the day data instructions we have also a link to it to the Google ASR engine so so if you have an account for global and you can also useful but and and as a as a data source and this might be faster and depending of the in the area of interest from for data Donald for example and we
18:08
we have usecases in this last observation monotone as is a webbased tool and a mobile application where we are using these services and so so users can can just go to the web but form from uh for example
18:22
job point of polygon and then the the user or you you you
18:28
can it is integrated data you can make some analysis without any data processing and well and at the end you can also download and the the data sets to to have enough money on your computer and to make also from further analysis as said before
18:46
we have those mobile at medication so you can go into the field with the GPS location for for example the can directly extracted the 15 years of was more figure tation datasets and
18:59
that we have also some homework we also executing these times to
19:05
times is another like the breakpoint detection that trend in and the trend detection and this so here we will there's also benefit you hitting WPS so we can use existing JavaScript clients for example and just asking are requesting our down WPS and he is also a little chain of state and this process is so the 1st process for data access and a 2nd process for form for data analysis and the data them as sent back to work to include mobile devices so
19:45
let me conclude as so the WPS as the web service specifications for what kind of processing tasks not only for geoprocessing services you can also use them for for administrators this purposes for example uh but what this important is that it can also use a WPS for data access and data and discovery and she filed for example to provide a very unique to their friends the way for data discovery and data access because when when accessing the data as a strongly before there are a lot of steps included like download like flipping into the area of interest and maybe also mask a quality masking and but for other reasons researchers as is needed for a 2 2 2 harmonize input and output descriptions and if you have the distributed WPS if you want to use the WPS from another of other nativization and then of course is that it will also be very important if data data providers also can provide more symbols so services because we will release the research institutes and so our goal is to make research to to test new new ways of for example of data and data access by the women not the organization whole with providing these services forever with a big infrastructure for example so some some words about our future where we want to integrate further processes and analysis tools for for land sound and sound sensing for example but also to but possibility to implement the easy to our easytouse WPS API is so then that users are able to integrate their own processes for example by providing KGB butanol books or a book title and are so that they the users are able to directly access the data that is on the server and make some analysis for everyone and the 2nd point is was important that data and processing services need to be linked to each other that automatically find input data for processing services and where and why that so if I have a portal for for example you may know that the deduced portal uh from from the problem as observations there comes off of me the data available but if you from finding datasets does in most cases not linked to other processing services and so on so we we hope to to uh have this kind of false of link in the future and we met and like to
22:33
thank you for your attention thank you chose a questions committee satellites on the same the yes time series questions and I saw in yourself pressure for example you used by system 1 the area the question is I find a phone a case like that they used to be the it's usually I have seen all should be using it for processing and you mentioned you using it for data access of data discovery that question is by system you catalog it also already provides an end point for the discovery so the dual extensional was as you change and you can also specify the bonding box 0 and so so it's it's kind of difficult understand why you haven't find a bit this approach is the main event a catalog the white you this endpoint the 3rd to the morning of this kind of analysis of the results and even if you did that is in the goddesses from ontologies and from it so you can try to atlanta according to rules that is is so what is the length of the national to go for to bit to use it is for data discovery now has the our goal was to to so and so if you have a catalog services so so is w compliance catalog services in general and then need to do only 7 the needed data will possibilities to to filter the data but what we are doing so in my example
24:24
uh In this example will we always think that we also also processing that we did in the area of interest is that the user has given as input calculate for example the Indian the overlap between them and the satellite and and and the bounding box or the the polygon that the user has given as an input system so the 1st point is so we're we're providing some processing functionality within the data and discovery and the 2nd 1 is to to provide also a different are easy to use 5 formants of course we could could also that the um provide a them down how s feed as an output but in general the the user 1 static or direct taxes and then fired sounded to the the dominant length so so so we using this as a C C and C the format to to make it easier for you to sort John just takes place form form format with just the the links to the scene so if you want to use these processes for my work for example doesn't being their friend and edition going using undirected actors in the catalog weights and point there if I want to use this because I see that you have some value to the city itself so that you can from so obvious processes so far the other of the available in the public domain to force the use of that the previous positive so this this this set of data going for example a imagine you it is input parameters and probably will consider query the catalog get that isn't the format that is beginning so obvious processes are available for the public the use the yeah there's citizens so that the and the processes are online available for the public use of but as a said and idea and we really only research institutes so we can we can provide access to this service a little bit about but not for a probe forever but but all these processes body the and the the programming code behind is at the moment not available at all as open source so but we will integrate all the induced processes within the the pie you analyze library so you you could easily um said is headed up on your own the motivation of Hamilton yeah 1 thank the title of the is yes good things that work here it is such a request to quick to rules to get the resilience of I know do you via the previous 2 points you will into other assume from function some of the Ukrainian this also as a as a present from this probe process at the moment we in the cell and that we we haven't optimized for topic from for performance so in what this behind here is in the direct access them to to the DGT user interface cell if the user interface is still them our interface of our services also slow and because we we have optimized for but have phone for performance so so so if you have an interest to to to provide as sensor performance optimized way than than would be would be better to to to have the intermediate data sets and then make you various offline and not connected to the output for the user to a maybe weight on the internet has provided the understanding you could be a as does fall for lands In the last question how fast the services to the level European services hand which is used in capacity in terms of colors Brown Memorial how fast is the question what what kind of data access all data analysis and you you do execute executed so for for data data access will will you think with us and and that the background so for for is a single pixel this and this now the fast but to this that could be bad I my guess would if you have a large area of interest and that it could take some sometimes and how it affected me at the moment this is this and not very big have at the moment of room for this sort of the the US observation 1 in 4 were religious services are also exposed to it's just a single cell and but but we want to improve just we we have access to to classical computer so we like to improve this to uh in and in the next 2 to 3 years and but again the the focus and will then as well what was not focused on on the the performance increasing performance but that showing the the possibilities that all of WPS all where it's telling so that he goes a thank you thank you all for attending and the world right now and then we'll see later on