Merken

The Blue Hub, an integrated analysis platform with a WebGIS front-end to exploit maritime Big Data

Zitierlink des Filmsegments
Embed Code

Automatisierte Medienanalyse

Beta
Erkannte Entitäten
Sprachtranskript
OK land so we will start with the last topic of decisions midday engines will give merely layer by opponents 12 and which we reason to speak to you about the brewer but In many can be the the good afternoon I'm interested in the area and software developer at the Joint Research Centre and and member of the European Commission today hand here 2 per cent that want platform is a software platform that he developed the tool will handle billions of records it can on my dying context solid satellite images and so on with see my presentation we go very quickly through a platform overview of some of the functionality of the system and then we read the inside and use case that is related to the haven't Bayes knowledge discovery and then the loudest let's just part of the presentation will be dedicated on the official development so this stock what is the grew out blob is that Joint Research Centre here analysis platform that we use to collect process analyze these lights and loads of data on the maritime domain like she position on the ship position robots startles and that of Bermuda Cayman coming from most of the light like sending a 1 sentence to 1 another the main actors of the system are of scientists policy makers service for the European Commission and operational alternatives logic architecture of the system so and that we have multiple data provider that has a different type of data with different protocols
so with different formats like in a manner copy of all the or by using an HTTP streaming there has to be an and so on that the 1st the 1st the bottom part of the system is there the gardening part there we have multiple tools that you use to gather this information process this information then the put it inside of variables history that is represented mainly by positive that the base with positive sense sanction and more recently among would make then we have the knowledge and discovery tools that are a set of tools that allow our scientists meals a day crunch all the data that we stored inside the the repository introduces felt and put it back again decided that it was agreed to be lies or exchange we extend platform with the other 2 models that are visualization and essentially get about the web application and ended up exchange we have a lot of services that that expose data of different standards
of 1 for all for example I didn't 1 of the 1st set of functionality that implement inside the system used might situation picture so with this functionality we we know what is going to happen in with a prediction of 15 minutes on this C of and this is a different tionality did you expect is assigned the functionality that you you to track of the best seller and provide you with some information about this that accountability like the here and the expected time of arrival of all around destination and now there are 2 poodles but this is just the 1st feature and we have used our our data to map of fishing activities that just by analyzing the speed profiles of some truly we we're able to cluster this information leading 5 3 classes that are like this site is sitting at a loss of what the best so he's doing so we can identify and where it was fishing hosting and what is and when you the best so we're going to the people are always
inside the same context the and by using the power that in our dataset and we we we could be it and intensity of fishing on fishing marked and that is publicy available on our website in both for us that and that former
then we worked on and behavior detection in these examples we have a lot of data on the right bottle to the position of the vessel position and then we able to the 5 stunned the part of the movement for example on the that you can see the daughter green on the right path but then there are a lot of In this example the best so suddenly changed its
direction and then iron know to to to return and Becky Jena and all noun the expected of them and the expected route so we can identify these and other type of of of anomaly and we can produce a for authorities for example that you need to another
example is trajectory analyzes so all of we we can analyze the trajectory of the vessel and we can cannot we we glossary we the data and we we could for example identify of the party location just by using the information about movement of the sheep and other
being tyrosine no features seeds the IIS radio location this is the type of it's a system that best so used to send messages about what is going to top and on the sheeple where and and solve for by by collecting exactly the same message by multiple base station on the ground there and buy up touching on its timestamp but we can use this information to all of most to let the position of the vessel so in this example that I all Eric specially on the right bottom is added the interesting simple where the vessel declared to be in the position indicated by the blue our robots we detected that that the true
position on the where exactly the close the portal General and other
functionality that is the satellite image analyzes cytosol all and we we can accept and a
lot of information from something like my images and then overlay the images on the web application for a visa of competition then In this
case the simplest case uh in this is and part of the project is at and these knowledge discovery
and movement of functionality that that we built in collaboration with the Italian Costco essentially in we fetch from the raw data a lot of information OK I sure you in a few on few seconds are records we use we preprocessed this information that we accept trajectory from the software and written in Matlab in this case then no by building the situation of of what this happening on the of the global level we produced for each of us so that we identify a set of elements the 7 so I was sent to this system that process data and by using edgeR references little agreed that can build their own uh
and and some interesting results like specially for for
the of about what's the and you haven't that here we have more to talk about and like for example proximity elements all for example when approaching another 1 they're ups to something illegal or and likes changing staff goods and so on our own we have all the type of event like the 1 that muscle entering and area we interested only in the cell
the rest of this this 1 on in this example we have a lot of the the density representation all the elements of the entry into a single cell with is size satellite is an hour of the CEO of drug use of 0 . 2 0 0 4 the any In this example we sure that the density of the same event but just for fishing vessel and we are able to say yeah these are the low efficient that cell and that this is the idea where they are fishing we have a huge database as a tool for locating by using prosperous estimation we can say that the receiver more than 160 6 millions of records several months and then our system we stored more than 11 billions of records to process over time and space dimensions to do this we use a lot of technology and we use a matter called John called bite on the simplest blasts jobless created intentionally also openly years so best speaking there and we use a lot of jails said that lot of just have a functionality and Boston what is the problem now the problems of the study the scientists have had OK and I'm joking obviously but it 1 of the key point because of the the rights of the reading them out loud but higher and they're not used to build the I t systems or software we have multiple cooperating the process and that there are running on a different machine and that obviously we had to solve the problem of of the of the and rendering the performance of and so the 1st question is how we can we transfer data between the processor and machine and how can the scientists very he's the change the data structure they they want to exchange we've the processor without admitting that getting so we need a common that transfer mechanism in a common serialization format for these we choose the adjacent serialization blasted 0 and q library as messaging system essentially the Albanese generates a set of elements and and these these those islands are encoded hinges on format to stream into a service and then see inside the said that the bistable or more with more detail than what to reveal was a multidimensional of Delaware also Cuba and now we have this
process so minus plus plus that continuously process of the stream of event and the immediately update to the need to be the major see inside the multidimensional Cuban stored the you haven't inside the database the dimension that to use are the data without that time component not interesting for these example and the dispatch of dimension is I'm not to let alone as usual about the discrete value including the narrow column through the this 12 agreed that they show a few slides before that all the dimensionality vessel type and even by blasting especially dinky yeah and that we call simulation for performance reasons that we decide
to use the special dimensional row and column 288 in that generated multiple zoom level by preprocessing the information inside the tube and then and then using also the vessel typing given that we created 720 seeks slice of the cube this is for improved performance surrendering so In
this example we have a simple could lies so he's
going to foster care anyway In well I would like to show you a small detail but I cannot rule back
yeah that's it sorry but a simple quiz lies Caesar OK uniquely identified by the zoom level and that's it so that that's a type and haven't fortunately on only the only measure that he want inside a cube user density and sold on the web J. supplication and just have a real and the low and a set of parameter tool to access to the right due tool short to to render as fast as possible used a few
tricks for these that I want
to share with you my 1st 1 and then we increase the 5 sides of of in the in the Dublin as service
because we notice that for this experiment is more convenient when you bond and then we need web-application passes the information about the balance of the view that the user to visualizing based on the zoom level that uses at the user user's using so the past the bounds of to all of the uh the database query to restrict the area of interest that want to we slides a solid we now improved acquired performance then we have a lot of people so all the parameter like of the the type of rendering the and we we can decide that based on the Duma before you want to run their uh things like polygonal points because you can imagine when you zoom old-style to you are these slides something of the scale of Europol toward the using polygons tool to represent the satellite is quite useless because he's in this you cannot distinguish from point and the point is faster run so in this example the we use a with this is a
representation of the slice of the cube beta vessel type blasts the polygonal and with a distribution of the best social inside the
not on the same set we can access to all the information in this case we have a distribution over the course of the ground of the fishing vessels another interesting
functionality we introduce the is that he cannot that
these has been implemented by using just over rendering transformation you WPS extension and this is amazing because it's of faster than units did you did you did you expect it render beta very quickly and you find is the fine because the changes will white zoom so all these can use some information about the clustering of the of the
density and the urinating layer and engage said it was a very big problem Because to plot of all those points that we were able to do just that but because the 1st stop and to what to was to create 1 single layer year with 4 different color densities sense to render everything we found there will for this approach OK we fit in of problem we following solution we don't know about so we discovered that if we as just 7 to and that 1 single call for our points is very very very fast so we decided to create for the yes and
then that might rendering Alderley years so badly we overlaid all the results and to get to
the final and the final image last part
what we're doing here we are removing and we are moving forward direction to use more must sequel that the database because our developers histories changing we have that are more unstructured data and that of that you want to analyze the data and we want to understand what is inside this those data and for this reason we start using model sequel also for these expect for this experiment we used to be you so records of they 11 not to be extracted the can be stored inside the mall would be for performance reasons for the same reason that the knowledge and discovery to are going to be extended to 2 and the new data and by writing also and you are going to and but using new data mining approach and that for the what is concerned the did the rendering we are creating a new Web Tools and that we have stopped using more of a vector B that's all more than fast more direct Jason usage more vector ending in the state of the Dublin conclusions from our we were able to conclude this tool to to to to build a platform because we standardized the the access to the repository sold by creating libraries so by creating services of sometime often to me tool to keep the process of lunch by some scientist and the like to the scientist will be calls late start the query that around a full table scan over 11 billions of records so you can imagine that the mass OK so libraries and services so that we can control law and optimize the answers to the the communication is another key factor salt and but using standard that we we could communicate to the data between different process and the more important the between IT guys scientist and another thing that always related to scientists please don't put warriors the band studios just deals Saul and so what would like to overload and now we've technical EST stuff like that lets us to be out to optimize something so and they're not used to this and we use standards whenever possible like in a manner of innocent FEs no obviously there is no 1 technology that will give us the solution about use it that again and so to loosen the languages for the thank you so much so thank you think you does anybody have any
questions OK I just wanted on the relationship between you and the more next year the EU and projects testing marine data year yeah we find all we have a few compass points about essentially we receive the data we have the the agreement that we 1st extend company like a necessary as like the on a regimen calls the of Italian calls so long and as they are sending us the data so we didn't we have just context-free final it was a century later it seems quite similar to me but they too much about both of them but they seem very similar this choice of the choice it the rest of the team that you need to know what the hell is left from the projection zone going yet another project is still ongoing the user is running at the bottom of the understanding the project served by the start analyzing all sort of type of data that are more related to movement and migration in in the latest period but that the system is not the perfect isn't going there is available policy on our website so all you can now that they have and they have an overview of all the functionality of contact us if you want to read some people some of the key things In recent years of looking just as the underlying database questions with the recent versions of prescribes that implement a lot of no risk you functionally supporting varies from 1 to 2 etc. and you look at it as an alternative to monitor the way yeah we need we're on the best exactly in the same manner that effect so we and we we took the same that that we rounded pessimistic but the sense of the latest version of all this legislation normally be exactly the same test they a and that our wedding around that database fast among would be and lower on that's why we decide to use moment because we have to process a lot of rackets just imagine that to build the density it takes something like 15 days so on or it's a very long process in the now we not using the special attention on 1 would be the the rendering use built by using the open year and then client-side that as much as possible and obviously by using just have to the only thing that I don't think I'm particularly interested in you we'll look because of my research we might come from South Africa and now we do have a similar project that will be incorporated in the C L S is full begin people bolts shipping companies that this each 1 the device but they are eager shipping the activities that they don't they just each of the idea as been they do that things some have you considered incorporating is a sign of data indirectly that there is any match a lot of and aware and that we
are almost something on the shelf as you know there was a project
uh but to reply OK anyway should be assessing OK and there
was a slight where we show
and satellite image related on the web application but if you break the tension there where local was most symbols so on that humans because we process see a satellite images and then now we with that's processing weaker match the cooperating
sheep because sending a message and
not cooperating ship so there was a project that are related to the African idea called the mark that rules that are related to security and above the idea of of the West Africa and that we use the satellite images tools to to improve the results so of so you
have considers do something like like I don't know which also as well as spatial extension so you could perform some special functions on or is it something that you know you didn't know all we we took a consideration of group will the user goal Bob when we did this is what is analyzes we don't have the infrastructure of tools there and for a system of and the ball with the process all of those rights and fortunately things have changed in the latest period so we can do more spherical that's why we don't use get that was my other question so do you all users servers to host everything and in the Instituto user quality now so you you indexically yeah fiscally internally to the sodium OK so that wasn't is explained below the estimated variances that vision think knows of questions and I have 1 you as as you have implemented some kind of the best people in business so I I'm wondering ladies and you use the last which is which is implemented useful 7 years whereas the mean simply because we we decide to continue to use force because the other side are used to to use the positive as in that usually they belong to the want to learn another taller when they have something that they know how to query like the other 1 is based on the part of you as a back end user look and just come into so much that you realize everything this information and I will investigate the point that so we can do with something better with thank you it is being made from the because the ontologies used massively as the European Commission and the focus of this for his indications last mentioning thank you so much for such any is efficient so thank you very much for a nice evening and come to seismic this evening to meters you before security
Stereometrie
Satellitensystem
Domain <Netzwerk>
Subtraktion
Nichtklassische Logik
Prozess <Physik>
Ortsoperator
Content <Internet>
Dienst <Informatik>
Kombinatorische Gruppentheorie
Systemplattform
Analysis
Service provider
Computeranimation
Trigonometrische Funktion
Domain-Name
Multiplikation
Datensatz
Datentyp
Softwareentwickler
Ereignishorizont
Bildgebendes Verfahren
Analysis
Nichtlinearer Operator
Lineares Funktional
Wissensextraktion
URN
Prozess <Informatik>
Protokoll <Datenverarbeitungssystem>
Güte der Anpassung
Physikalisches System
Kontextbezogenes System
Entscheidungstheorie
Roboter
Dienst <Informatik>
Flächeninhalt
Last
Mereologie
Subtraktion
Einfügungsdämpfung
Web Site
Prozess <Physik>
Ortsoperator
Weg <Topologie>
Dokumentenserver
Web-Applikation
Klasse <Mathematik>
Computeranimation
Service provider
Variable
Informationsmodellierung
Erwartungswert
Prognoseverfahren
Visualisierung
Lineares Funktional
Dokumentenserver
Profil <Aerodynamik>
Physikalisches System
Dienst <Informatik>
Menge
Mereologie
Information
Lie-Gruppe
Standardabweichung
Web Site
Ortsoperator
Green-Funktion
Mereologie
Kontextbezogenes System
Computeranimation
Autorisierung
Programmfehler
Trajektorie <Mathematik>
Weg <Topologie>
Identifizierbarkeit
Routing
URL
Information
Trajektorie <Mathematik>
Analysis
Computeranimation
Richtung
Ortsoperator
Explosion <Stochastik>
Decodierung
Ortsoperator
Programmverifikation
Abgeschlossene Menge
Vektorpotenzial
Physikalisches System
Zwölf
Arbeitsplatzcomputer
Computeranimation
Roboter
Multiplikation
Funktion <Mathematik>
Datentyp
Minimum
Flächeninhalt
Zeitstempel
Information
URL
Message-Passing
Satellitensystem
Lineares Funktional
Wissensextraktion
Rohdaten
Web-Applikation
Content <Internet>
Extrempunkt
Overlay-Netz
Analysis
Computeranimation
Satellitensystem
Spezialrechner
Emulation
Mereologie
Vier
Projektive Ebene
Information
Ereignishorizont
Bildgebendes Verfahren
Resultante
Objekt <Kategorie>
Prozess <Physik>
Dichte <Physik>
PASS <Programm>
Element <Mathematik>
Trajektorie <Mathematik>
Nummerung
Computeranimation
Übergang
Metropolitan area network
Datensatz
Software
Mapping <Computergraphik>
Ereignishorizont
Lineares Funktional
Wissensextraktion
Kollaboration <Informatik>
Dean-Zahl
Rohdaten
Zwei
Physikalisches System
Kreisbogen
Kollaboration <Informatik>
Menge
Zellularer Automat
Trajektorie <Mathematik>
Räumliche Anordnung
Information
Ext-Funktor
Mittelwert
Satellitensystem
Selbstrepräsentation
Gewichtete Summe
Wärmeübergang
Element <Mathematik>
Computeranimation
Streaming <Kommunikationstechnik>
Wärmeübergang
Mapping <Computergraphik>
Multitasking
Flächeninhalt
Lineares Funktional
Kraftfahrzeugmechatroniker
Prozess <Informatik>
Rohdaten
REST <Informatik>
Datenhaltung
Güte der Anpassung
Applet
CAM
Gleitendes Mittel
Dateiformat
Mechanismus-Design-Theorie
Ereignishorizont
Endlicher Graph
Dichte <Physik>
Dienst <Informatik>
Datenstruktur
Menge
Rechter Winkel
Zellularer Automat
Ablöseblase
Dateiformat
Ultraviolett-Photoelektronenspektroskopie
Ext-Funktor
Arithmetisches Mittel
Server
Hausdorff-Dimension
Stab
Virtuelle Maschine
Zellularer Automat
Datenhaltung
Unendlichkeit
Virtuelle Maschine
Message-Passing
Datensatz
Software
Datentyp
Programmbibliothek
Skript <Programm>
Abstand
Coprozessor
Datenstruktur
Ereignishorizont
Minkowski-Metrik
Tabelle <Informatik>
Schätzwert
Beobachtungsstudie
Algorithmus
Mathematik
Raum-Zeit
Physikalisches System
Flächeninhalt
Würfel
Dimensionsanalyse
Serielle Schnittstelle
Räumliche Anordnung
Zeitzone
Prozess <Physik>
Hausdorff-Dimension
Program Slicing
Gewichtete Summe
Computeranimation
Übergang
Streaming <Kommunikationstechnik>
Komponente <Software>
Multiplikation
Datensatz
Datentyp
Multitasking
Zusammenhängender Graph
Ereignishorizont
Tabelle <Informatik>
Datentyp
Prozess <Informatik>
Rohdaten
Datenhaltung
Netzwerkbetriebssystem
Übergang
Zoom
Gerade
Ereignishorizont
Datensatz
Würfel
Würfel
Simulation
Information
Streaming <Kommunikationstechnik>
Magnetbandlaufwerk
Server
Dichte <Physik>
Computeranimation
Übergang
Benutzerbeteiligung
Trigonometrische Funktion
Ganze Zahl
Rechter Winkel
Datentyp
Zoom
Minimalgrad
Multitasking
Ereignishorizont
Einflussgröße
Tabelle <Informatik>
Gebundener Zustand
Parametersystem
Datentyp
Stichprobe
Volumenvisualisierung
Übergang
Schlussregel
Zoom
Dichte <Physik>
Menge
Polygon
Würfel
Rechter Winkel
Parametersystem
Würfel
Räumliche Anordnung
Satellitensystem
Punkt
Datenbank
Polygon
Computeranimation
Übergang
Gebundener Zustand
Endlicher Graph
Datentyp
Zoom
Ereignishorizont
Gebundener Zustand
Zentrische Streckung
Sichtenkonzept
Teilbarkeit
Volumenvisualisierung
Übergang
Zoom
Summengleichung
Rechenschieber
Dienst <Informatik>
Flächeninhalt
Polygon
Parametersystem
Information
Distributionstheorie
Lineares Funktional
URN
Datentyp
Transformation <Mathematik>
Dichte <Physik>
Program Slicing
Selbstrepräsentation
Volumenvisualisierung
Maßerweiterung
Rendering
Computeranimation
Menge
Polygon
Würfel
Datentyp
Mapping <Computergraphik>
Minimalgrad
Multitasking
Information
Subtraktion
Punkt
Mathematik
Systemaufruf
Einfache Genauigkeit
Plot <Graphische Darstellung>
Maßerweiterung
Zoom
Transformation <Mathematik>
Rendering
Computeranimation
Dichte <Physik>
Einheit <Mathematik>
Mapping <Computergraphik>
Information
Kantenfärbung
Maßerweiterung
Cluster <Rechnernetz>
Resultante
Telekommunikation
Overloading <Informatik>
Subtraktion
Prozess <Physik>
Dokumentenserver
Formale Sprache
Vektorraum
Fortsetzung <Mathematik>
Dienst <Informatik>
Computeranimation
Data Mining
Richtung
W3C-Standard
Informationsmodellierung
Datensatz
Benutzerbeteiligung
Task
Rendering
Standardabweichung
Gruppe <Mathematik>
Programmbibliothek
Softwareentwickler
Bildgebendes Verfahren
Algorithmus
Schlüsselverwaltung
Prozess <Informatik>
Dokumentenserver
Datenhaltung
Abfrage
Systemaufruf
Ruhmasse
Telekommunikation
Vektorraum
Schätzung
Rendering
Teilbarkeit
Overloading <Informatik>
Dienst <Informatik>
Zellularer Automat
Mereologie
Vier
Schlüsselverwaltung
Data Mining
Standardabweichung
Aggregatzustand
Tabelle <Informatik>
Web Site
Prozess <Physik>
Punkt
Momentenproblem
Versionsverwaltung
Vorzeichen <Mathematik>
Migration <Informatik>
Minimum
Datentyp
Äußere Algebra eines Moduls
Vorlesung/Konferenz
Auswahlaxiom
Soundverarbeitung
Softwaretest
Lineares Funktional
Matching <Graphentheorie>
Zirkel <Instrument>
Datenhaltung
REST <Informatik>
Systemaufruf
Physikalisches System
Zeitzone
Quick-Sort
Dichte <Physik>
Projektive Ebene
Schlüsselverwaltung
Mittelwert
Satellitensystem
Server
Dichte <Physik>
Web-Applikation
Analysis
Computeranimation
Datenhaltung
Metropolitan area network
Message-Passing
Minimalgrad
Ereignishorizont
Bildgebendes Verfahren
Tabelle <Informatik>
Algorithmus
Datentyp
Prozess <Informatik>
Matching <Graphentheorie>
Raum-Zeit
Volumenvisualisierung
Applet
Symboltabelle
Gleitendes Mittel
Rendering
Polygon
Dimensionsanalyse
Räumliche Anordnung
Satellitensystem
Trajektorie <Mathematik>
Schlussregel
Projektive Ebene
Analysis
Bildgebendes Verfahren
Computeranimation
Prozess <Physik>
Punkt
Ontologie <Wissensverarbeitung>
Computersicherheit
Gruppenkeim
Frequenz
Fokalpunkt
Computeranimation
Forcing
Gerade Zahl
Rechter Winkel
Front-End <Software>
Mereologie
Server
Meter
Indexberechnung
Information
Maßerweiterung
Maschinelles Sehen
Varianz

Metadaten

Formale Metadaten

Titel The Blue Hub, an integrated analysis platform with a WebGIS front-end to exploit maritime Big Data
Serientitel FOSS4G Bonn 2016
Teil 63
Anzahl der Teile 193
Autor Gammieri, Vincenzo (JRC)
Lizenz CC-Namensnennung 3.0 Deutschland:
Sie dürfen das Werk bzw. den Inhalt zu jedem legalen Zweck nutzen, verändern und in unveränderter oder veränderter Form vervielfältigen, verbreiten und öffentlich zugänglich machen, sofern Sie den Namen des Autors/Rechteinhabers in der von ihm festgelegten Weise nennen.
DOI 10.5446/20320
Herausgeber FOSS4G
OSGeo
Erscheinungsjahr 2016
Sprache Englisch
Produktionsort Bonn

Technische Metadaten

Dauer 26:34

Inhaltliche Metadaten

Fachgebiet Informatik
Abstract At the Joint Research Centre (JRC), scientists involved in maritime situational awareness are confronted with a growing volume of data. Every day millions of ship positions from terrestrial and satellite receivers are gathered globally and in real-time, as well as optical and radar Earth Observation images, leading to a significant variety of data. To support the researchers, policy makers and operational authorities in their activities a analysis platform with WebGIS functionality has been developed with the aim of turning data into valuable information and demonstrating pre-operational tools for maritime awareness. The platform is mostly based on FOSS software and consists of a front-end visualization tool and a back-end analysis engine. Fusion algorithms provide the ability to integrate data from multiple sources on the fly. A series of tools provide predictive analysis, activity mapping, anomaly detection, and cross disciplinary information, to support maritime security and safety and to improve marine knowledge. The web application is developed using open source programming languages (e.g. Javascript, Python), frameworks (e.g. Django, Geoserver), and interchange data format (JSON) to enable researchers to seamlessly integrate ad hoc algorithms developed in scientific languages (e.g. R, Matlab). A case study will be presented, showing examples of how the WebGIS architecture can provide visualisation and analysis tools to support decision makers and scientific and operational actors in the fields of fisheries science, maritime spatial planning, and maritime surveillance.
Schlagwörter JRC

Ähnliche Filme

Loading...