We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

High Performance Data Processing with Python, Kafka and Elasticsearch

Formal Metadata

Title
High Performance Data Processing with Python, Kafka and Elasticsearch
Title of Series
Number of Parts
115
Author
Contributors
License
CC Attribution - NonCommercial - ShareAlike 4.0 International:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal and non-commercial purpose as long as the work is attributed to the author in the manner specified by the author or licensor and the work or content is shared also in adapted form only under the conditions of this
Identifiers
Publisher
Release Date
Language

Content Metadata

Subject Area
Genre
Abstract
In the current technology era, all kind of applications work on data. Data is used to represent a set of information. The healthcare apps, e-commerce apps etc works on data. Sometimes, this data needs to be get updated to reflect new changes across the platform. This action can be performed manually but what if platform data is getting updated in realtime or let’s say in every 1 hour? Such kind of problem can be solved by implementing a service based on Producer Consumer model. In this talk, I will be covering how Producer Consumer models work and how such design pattern can be implemented with Python. I will be explaining the whole implementation process using other tools such as Kafka as data streamer and Elasticsearch as data store. Talk Outline: 1. Problem Statement (2 mins) Introduction to problem statement. 2. Introduction to Producer Consumer Model (3 mins) Basics of Producer Consumer Model Applications 3. Deep-dive explanation of Producer Consumer model using example (5 mins) Elasticsearch Kafka 4. Explaining parts of our Producer Consumer model (5 mins) What kind of data are we updating in our data store? Why it’s a high performance solution? Implementation in Python as end-to-end framework. 5. Code walkthrough (5 mins) Produce data Stream data Consume data 6. Conclusion and Learnings (5 mins) Learnings Performance Pros and Cons 7. Q/A Session (5 mins) Target Audience - Beginner / Intermediate Proposal Section - Web based Systems Prerequisites - Python & System Design