We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

URL Frontier, an open source API and implementation for crawl frontiers

8
 Cite
 Share
 Related Material
 Download
 Purchase
No logo availablePlain Schwarz
 Nioche, Julien

Formal Metadata

Title
URL Frontier, an open source API and implementation for crawl frontiers
Title of Series
Number of Parts
56
Author
Contributors
License
CC Attribution 3.0 Unported:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Identifiers
Publisher
Release Date
Language

Content Metadata

Subject Area
Genre
Abstract
This talk will present URLFrontier, an API and service implementation of a crawl frontier. After an introduction to how it fits in a distributed crawl architecture, we will go in more details on what the project provides, how it has been used so far and future works.