We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

From Text to Context: How We Introduced a Modern Hybrid Search

Formal Metadata

Title
From Text to Context: How We Introduced a Modern Hybrid Search
Title of Series
Number of Parts
131
Author
Contributors
License
CC Attribution - NonCommercial - ShareAlike 3.0 Unported:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal and non-commercial purpose as long as the work is attributed to the author in the manner specified by the author or licensor and the work or content is shared also in adapted form only under the conditions of this
Identifiers
Publisher
Release Date
Language

Content Metadata

Subject Area
Genre
Abstract
Customers only buy the products they are able to find. Improving the search functions on the website is crucial for user-friendliness. In our talk we present the lessons learnt from improving the search of our global online marketplace, which sells 20 million products per year. We moved from a traditional word-match based approach (BM25) to a modern hybrid solution that combines BM25 with a semantic vector model, an open-source language model that we fine-tuned to our domain. With numerous references to current literature, we will explain how we designed our new system and solved the multiple challenges we encountered on both the ML and engineering side (data pipeline encoding documents, live service encoding queries, integration with search engine). Our system is based on OpenSearch, the lessons can be applied to other search engines as well. In particular the presentation will cover: - Status and Short-Comings of our old Search - Introduction of Hybrid Search - Our Machine Learning Solution - Architecture and Implementation (with special consideration of latency) - Learnings and Next Steps