We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

From pipelines to graphs Escape the tyranny of the shell’s linear pipelines with dgsh

Formal Metadata

Title
From pipelines to graphs Escape the tyranny of the shell’s linear pipelines with dgsh
Title of Series
Number of Parts
611
Author
License
CC Attribution 2.0 Belgium:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Identifiers
Publisher
Release Date
Language
Production Year2017

Content Metadata

Subject Area
Genre
Abstract
The Unix [dgsh] shell provides an expressiveway to construct sophisticated and efficient data processing pipelines usingstandard Unix tools, as well as third-party and custom-built components. Dgshallows the specification of pipelines of non-uniform non-linear operations.For example _tee_ can feed three processes whose output can then be collectedby _paste_. The pipelines form a directed acyclic process graph, which istypically executed by multiple processor cores, thus increasing the task'sprocessing throughput. We will see how to use _dgsh_ in practice through anumber of general data processing and domain-specific examples, and how toadapt tools for use with _dgsh_.