Julia for large scale raster data processing

Cite

OpenGeoHub Foundation

Cremer, Felix

Formal Metadata

Title

Julia for large scale raster data processing

Title of Series

Open-Earth-Monitor science webinars

Number of Parts

Author

Cremer, Felix

License

CC Attribution 3.0 Germany:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.

Identifiers

10.5446/63423 (DOI)

Publisher

OpenGeoHub Foundation

Release Date

2023

Language

English

Producer

Jarrallah, Niamah

Production Year

2023

Production Place

Wageningen

Content Metadata

Subject Area

Computer Science

Genre

Conference/Talk

Abstract

In this talk Felix Cremer presents how he is using the Julia programming language to process large raster data. Julia is an interactive scientific programming language, designed for HPC applications with primitives for Multi-threaded and Distributed computations built into the language. The main work is done by the YAXArrays.jl data cube framework in Julia. YAXArrays.jl provides functionality to deal with labelled arrays, similar to the xarray python package and it also provides efficient and easy multithreading and distributed computation of user defined functions along arbitrary slices of the data.YAXArrays.jl uses DiskArrays.jl in the backend to deal with out of memory datasets.

Keywords