Show filters Hide filters

Refine your search

Publication Year
1-2 out of 2 results
Change view
  • Sort by:
43:10 DjangoCon US English 2017

The denormalized query engine design pattern

Most web applications need to offer search functionality. Open source tools like Solr and Elasticsearch are a powerful option for building custom search engines… but it turns out they can be used for way more than just search. By treating your search engine as a denormalization layer, you can use it to answer queries that would be too expensive to answer using your core relational database. Questions like “What are the top twenty tags used by my users from Spain?” or “What are the most common times of day for events to start?” or “Which articles contain addresses within 500 miles of Toronto?”. With the denormalized query engine design pattern, modifications to relational data are published to a denormalized schema in Elasticsearch or Solr. Data queries can then be answered using either the relational database or the search engine, depending on the nature of the specific query. The search engine returns database IDs, which are inflated from the database before being displayed to a user - ensuring that users never see stale data even if the search engine is not 100% up to date with the latest changes. This opens up all kinds of new capabilities for slicing, dicing and exploring data. In this talk, I’ll be illustrating this pattern by focusing on Elasticsearch - showing how it can be used with Django to bring new capabilities to your application. I’ll discuss the challenge of keeping data synchronized between a relational database and a search engine, and show examples of features that become much easier to build once you have this denormalization layer in place. Use-cases I explore will include: Finding interesting patterns in your data Building a recommendation engine Advanced geographical search and filtering Reacting to recent user activity on your site Analyzing a new large dataset using Elasticsearch and Kibana.
  • Published: 2017
  • Publisher: DjangoCon US
  • Language: English
34:16 DjangoCon US English 2017

DjangoCon US 2017: Lightning Talks Day 1

  • Published: 2017
  • Publisher: DjangoCon US
  • Language: English
out of 1 pages
Loading...
Feedback

Timings

   42 ms - page object
   29 ms - search
    3 ms - highlighting
    2 ms - highlighting/33196
    3 ms - highlighting/33216

Version

AV-Portal 3.8.0 (dec2fe8b0ce2e718d55d6f23ab68f0b2424a1f3f)