We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

Scalable geospatial processing using dask and mapchete

00:00

Formal Metadata

Title
Scalable geospatial processing using dask and mapchete
Title of Series
Number of Parts
Author
License
CC Attribution 3.0 Unported:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Identifiers
Publisher
Release Date
Language

Content Metadata

Subject Area
Genre
Abstract
Dask is a flexible parallel computing library that seamlessly integrates with popular Python data science tools. With its task graph and parallel computation capabilities, Dask excels in managing large-scale computations on both the local machine as well as on a computing cluster. Mapchete, an open-source Python library, specialises in parallelizing geospatial raster and vector processing tasks. Its strengths lie in its ability to efficiently tile and process geospatial data, making it a valuable asset for handling vast datasets such as satellite imagery, elevation models, and land cover classifications. This talk delves into the integration of these two technologies, showcasing how their combined capabilities can be used to conduct large-scale processing of geospatial data. It will also show how we at EOX are currently deploying our infrastructure and which challenges we face when using it to process the cloudless satellite mosaics under the EOxCloudless product umbrella.
Keywords
Service (economics)Process (computing)Mathematical analysisProduct (business)AdditionSatellite1 (number)Photographic mosaicGoodness of fitProcess (computing)File archiverTerm (mathematics)Exploit (computer security)Lecture/ConferenceComputer animation
GEDCOMThermodynamischer ProzessSpacetimeProcess (computing)CodeParallel portFunction (mathematics)Image resolutionExecution unitAzimuthConfiguration spaceType theoryFatou-MengeMaxima and minimaoutputProcess (computing)Function (mathematics)Configuration space1 (number)LaptopLevel (video gaming)Thermodynamischer ProzessScaling (geometry)Functional (mathematics)Parameter (computer programming)SpacetimeMultiplication signoutputPoint (geometry)Open sourceComputer fileCodePerfect graphMatrix (mathematics)Physical systemModule (mathematics)File formatSet (mathematics)Constraint (mathematics)TesselationAdditionMatching (graph theory)Power (physics)Raster graphicsShapley-LösungVector spaceComputer animationLecture/Conference
Common Language InfrastructureFile formatFunction (mathematics)Vector spaceRaster graphicsoutputDirectory serviceExtension (kinesiology)SatelliteMaizeParallel portData structureType theoryInformationInternet service providerDefault (computer science)Revision controlParallel computingTask (computing)SequenceWrapper (data mining)Graph (mathematics)Scheduling (computing)Client (computing)Tablet computerQuery languageGateway (telecommunications)Continuous trackScaling (geometry)FrequencyTask (computing)CodeData storage deviceRevision controlGraph (mathematics)SequenceCASE <Informatik>Multiplication signLevel (video gaming)Scaling (geometry)Function (mathematics)Parallel portProcess (computing)Physical systemObject-oriented programmingFitness functionCore dumpVirtual machineNeuroinformatikCache (computing)1 (number)BuildingGraph theoryImage resolutionScalabilitySocial classException handlingInterface (computing)Concurrency (computer science)AdditionMappingTesselationWritingCurveStack (abstract data type)File archiverGraph (mathematics)Extension (kinesiology)Directory serviceSatelliteFile formatComputer fileConnectivity (graph theory)BitLibrary (computing)Thermodynamischer ProzessService (economics)Vector spaceRange (statistics)Arithmetic progressionMaxima and minimaRandomizationCurvatureFlagRight angleRow (database)InformationDefault (computer science)Error messageParameter (computer programming)Zoom lensGateway (telecommunications)Latent heatSingle-precision floating-point formatClient (computing)Representational state transferMechanism designInterior (topology)Configuration spaceoutputSubsetStreaming mediaSinc functionMereologyComputer animationLecture/ConferenceXML
Task (computing)Graph (mathematics)Graph (mathematics)Random numberException handlingRead-only memoryError messageSemiconductor memoryPoint (geometry)Existential quantificationLevel (video gaming)Task (computing)Graph theoryVirtual machineError messageArrow of timeDampingThermodynamischer ProzessComputer animationLecture/Conference
MassComputer hardwarePhysical systemPhotographic mosaicComputer animationLecture/Conference
Graph (mathematics)User profileSimultaneous localization and mappingPhotographic mosaicUniform resource locatorScheduling (computing)CASE <Informatik>Computer animation
Server (computing)Point cloudView (database)Computer-generated imageryMaizeThermodynamischer ProzessHill differential equationTesselationLimit (category theory)ResultantMedical imagingPixelConnectivity (graph theory)Buffer solutionCASE <Informatik>Functional (mathematics)Product (business)Process (computing)Physical systemParameter (computer programming)Latent heatScheduling (computing)InformationError messageClient (computing)Mechanism designStandard deviationMereologySingle-precision floating-point formatBit rateAzimuthVector spaceMultiplication signMultiplicationImplementationAlgorithmMappingSoftware developerDatei-ServerLocal ringActive contour modelElectric generatorMetreElectronic data processingDatabaseGraph (mathematics)Task (computing)Moment (mathematics)MiniDiscTessellationSet (mathematics)Graph (mathematics)Presentation of a groupServer (computing)Line (geometry)Neighbourhood (graph theory)Computer animationLecture/Conference
Least squaresGEDCOMComputer animation
Transcript: Englisch(auto-generated)