We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

Analyzing floating car data with clickhouse db, postgres and R

Formal Metadata

Title
Analyzing floating car data with clickhouse db, postgres and R
Title of Series
Number of Parts
295
Author
Contributors
License
CC Attribution 3.0 Germany:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Identifiers
Publisher
Release Date2019
LanguageEnglish

Content Metadata

Subject Area
Genre
Abstract
Spatio-temporal datasets like sensor-data or floating car data can be rather overwhelming because they quickly get in the order of billions of records. In this talk I show how we made billions of floating car data entries into a workable datastream that outputs visually attractive and useful maps and graphs over a routable network. I will start by summarizing the relatively new OS clickhouse database and how this column store helps in dealing with massive temporal datasets. Next I explain how we set up the pipeline with postgres/gis, pgrouting and R in order to create analysis in seconds and share some interesting results that you can get from these large trafficdatasets. The talk will be relatively code-focused (mainly SQL and R) but also show some ind-depth analyses of car data.
Keywords