We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

Scaling your logging infrastructure

Formal Metadata

Title
Scaling your logging infrastructure
Subtitle
using syslog-ng
Title of Series
Number of Parts
611
Author
License
CC Attribution 2.0 Belgium:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Identifiers
Publisher
Release Date
Language
Production Year2017

Content Metadata

Subject Area
Genre
Abstract
Event logging is important not only for IT security and operations, but alsofor business decisions. The syslog-ng application is an enhanced loggingdaemon, with a focus on central log collection. It collects logs from manydifferent sources, processes and filters them and finally it stores them orroutes them for further analysis. From this session you will learn (usingexamples from syslog-ng) why and how to parse important information fromincoming messages, and how to route logs, feeding downstream systems usingarbitrary formats. We will also discuss how the client – relay – serverarchitecture can solve scalability problems. Also, I will present some of therecently introduced “Big Data” destinations of syslog-ng, which can help toscale your infrastructure even further. ## Outline: * what is syslog-ng * log collection * introduction to log processing * filtering * Big Data destinations * log formats - the importance of name-value pairs * message parsing (both unstructured and some structured message formats) * formatting (templates, anonymization) * log routing (optimizing analytics infrastructure) * client (collection) - relay (processing) - server (storing, routing) * summary