We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

Geo-spatial queries on multi-petabyte weather data archives

00:00

Formal Metadata

Title
Geo-spatial queries on multi-petabyte weather data archives
Title of Series
Number of Parts
490
Author
License
CC Attribution 2.0 Belgium:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Identifiers
Publisher
Release Date
Language

Content Metadata

Subject Area
Genre
Abstract
Geo-spatial queries on multi-petabyte weather data archives John Hanley, Nicolau Manubens, Tiago Quintino, James Hawkes, Emanuele Danovaro Weather forecasts produced by ECMWF and environment services by the Copernicus programme act as a vital input for many downstream simulations and applications. A variety of products, such as ECMWF reanalyses and archived forecasts, are additionally available to users via the MARS archive and the Copernicus data portal. Transferring, storing and locally modifying large volumes of such data prior to integration currently presents a significant challenge to users. The key aim for ECMWF effort in H2020 Lexis project is to provide tools for data query and pre-processing close to data archives, facilitating fast and seamless application integration by enabling precise and efficient data delivery to the end-user. ECMWF aims to implement a set of services to efficiently select, retrieve and pre-process meteorological multi-dimensional data by allowing multi-dimensional queries including spatio-temporal and domain-specific constraints. Those services are exploited by Lexis partners to design complex workflows to mitigate the effect of natural hazards and investigate the water-food-energy nexus. This talk will give a general overview of Lexis project and its main aims and objectives. It will present the pilot applications exploiting ECMWF data as the main driver of complex workflows on HPC and cloud computing resources. In particular, it will focus on how ECMWF's data services will provide geospatial queries on multi-dimensional peta-scale datasets and how this will improve overall workflow performance and enable access to new data for the pilot users. This work is supported by the Lexis project and has been partly funded by the European Commission's ICT activity of the H2020 Programme under grant agreement number: 825532.
MultiplicationQuery languageFocus (optics)File archiverComputer animation
Self-organizationService (economics)Data managementState of matterEndliche ModelltheorieNeuroinformatikState of matterCategory of beingThermal radiationDimensional analysisService (economics)Archaeological field surveyExploit (computer security)Field (computer science)SatelliteWorkstation <Musikinstrument>FreewareSelf-organizationComputer animation
Continuous functionSatelliteRadarWorkstation <Musikinstrument>Regular graphScalar fieldFunction (mathematics)Data modelField (computer science)SurfacePressureVariable (mathematics)Set (mathematics)Computer simulationMereologyField (computer science)Cellular automatonFunction (mathematics)Endliche ModelltheorieState observerWater vaporPhysical systemInterpolationNumberFile archiverInterpreter (computing)Degree (graph theory)Group actionPressureComputer virusComputer animation
Menu (computing)ConsistencyReduction of orderInstallable File SystemData modelOctahedronAxonometric projectionSurjective functionPoint (geometry)NeuroinformatikLevel (video gaming)NumberView (database)BitPole (complex analysis)OctahedronComputational geometryComputer animation
Installable File SystemData modelSigma-algebraLevel (video gaming)Logical constantPressureImage resolutionPhysical systemPressureMoore's lawSimulationMultiplication signCalculationFunction (mathematics)Shape (magazine)Computer fileLevel (video gaming)Electric generatorMetropolitan area networkConstraint (mathematics)Observational studyPower (physics)Endliche ModelltheorieComputer animation
Image resolutionCellular automatonField (computer science)BitPhysical systemComputer simulationFile archiverDifferent (Kate Ryan album)SimulationVideo gameSquare numberPoint (geometry)Computer animation
PressureSystem programmingModal logicQuantumMultiplication signPhysical systemBitSimulationLattice (order)Sampling (statistics)Constraint (mathematics)Category of beingImage resolutionDifferent (Kate Ryan album)Square numberMetreBit rateSupercomputerMereologyCASE <Informatik>Right angleData storage deviceMusical ensembleEndliche ModelltheorieParallel portMiniDiscPotenz <Mathematik>Computer animation
Point cloudTape driveSupercomputerMountain passFile archiverCache (computing)Tape driveClosed setParallel portBitSource codeObject (grammar)Data storage deviceSimulationLibrary (computing)NeuroinformatikPoint cloudPhysical systemService (economics)Right angle1 (number)MiniDiscChannel capacityPosition operatorQuery languageMereologyMassVideo gameMultiplication signSuite (music)Sign (mathematics)State of matterProcess (computing)CASE <Informatik>Computer animation
Chemical equationCubeHypercubeTime domainSynchronizationHypercubeSubject indexingParallel portDimensional analysisObject (grammar)Cache (computing)BitSummierbarkeitOperator (mathematics)Bit rateQuery languageNumberRange (statistics)File systemFlow separationEndliche ModelltheorieLevel (video gaming)Computer fileData storage deviceAreaField (computer science)Domain nameDifferent (Kate Ryan album)Front and back endsSimulationService (economics)MereologyEvoluteDescriptive statisticsPhysical systemWebsiteCASE <Informatik>Graphics tablet1 (number)Computer animation
HypercubeTime domainSynchronizationPhysical systemLevel (video gaming)PlastikkarteMultiplication signData storage deviceQuery languageObject (grammar)File systemMiniDiscBit rateParameter (computer programming)HypercubeLevel (video gaming)Field (computer science)LengthPhysical systemOffice suiteProcess (computing)Position operatorCASE <Informatik>SurfaceSubject indexingComputer animation
WritingBlock (periodic table)Revision controlSemantics (computer science)ACIDDatabase transactionConsistencyHash functionServer (computing)SpacetimeCASE <Informatik>ComputerInstance (computer science)Physical systemCrash (computing)Mainframe computerIntegrated development environmentMereologyProcess (computing)AreaUniform resource locatorNeuroinformatikRight angleTape driveCategory of beingFlash memoryComputer animation
HypercubeMachine learningFile systemPoint cloudData storage deviceClosed setParallel portProcess (computing)NeuroinformatikComputer fileObject (grammar)Tape driveFile archiverInformation privacyMultilaterationUsabilityComputer animation
Time domainMenu (computing)FluidVideo gameStability theorySubsetAddress spaceSource codeInterpreter (computing)Daylight saving timeNeuroinformatikData storage deviceField (computer science)Domain nameComputer animation
Point cloudTape driveService (economics)SupercomputerCommon Language InfrastructurePolytopMenu (computing)Duality (mathematics)Software developerClient (computing)Exploit (computer security)PolytopPhysical systemFile archiverPoint cloudQuery languageAddress spaceService (economics)Representational state transferReal-time operating systemProjective planeInterface (computing)Formal languageProcess (computing)Line (geometry)Metropolitan area networkComputer animation
Menu (computing)Revision controlSource codeFile archiverUsabilityReal-time operating systemProjective planeOpen setService (economics)System callMultiplication signInterpreter (computing)Open sourceInstallable File SystemImage resolutionComputer animation
Time domainQuery languageInterpolationParameter (computer programming)Degree (graph theory)Point (geometry)Image resolutionFormal languageGradientOperator (mathematics)Computer animation
FacebookPoint cloudOpen source
Transcript: English(auto-generated)