We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

Scrapy and Elasticsearch: Powerful Web Scraping and Searching with Python

Formal Metadata

Title
Scrapy and Elasticsearch: Powerful Web Scraping and Searching with Python
Title of Series
Number of Parts
8
Author
License
CC Attribution 4.0 International:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Identifiers
Publisher
Release Date
Language

Content Metadata

Subject Area
Genre
Abstract
"Scrapy is a versatile tool to scrape web pages with Python. Thanks to its pipeline architecture, it is easy to add new consumers to work on the scraped data. One such pipeline allows us to index the scraped data with Elasticsearch. With Elasticsearch, we can make the scraped data searchable in a highly efficient way. In this talk, we will not only show you the basics of the interaction between Scrapy and Elasticsearch, but also a hands-on showcase where we use these tools to collect sport results of Swiss running events and to answer interesting questions related to this data."