We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

Semantic vs keyword search as context for GPT

Formale Metadaten

Titel
Semantic vs keyword search as context for GPT
Serientitel
Anzahl der Teile
60
Autor
Mitwirkende
Lizenz
CC-Namensnennung 3.0 Unported:
Sie dürfen das Werk bzw. den Inhalt zu jedem legalen Zweck nutzen, verändern und in unveränderter oder veränderter Form vervielfältigen, verbreiten und öffentlich zugänglich machen, sofern Sie den Namen des Autors/Rechteinhabers in der von ihm festgelegten Weise nennen.
Identifikatoren
Herausgeber
Erscheinungsjahr2023
SpracheEnglisch

Inhaltliche Metadaten

Fachgebiet
Genre
Abstract
The OpenAI ChatGPT has taken the world by storm and people want to be able to offer the same type of chat bot experience on their own data. Such a bot can answer questions based on your documentation or knowledge base. This can be done with the OpenAI API by providing the right context, extracted from your data, to the model. You can do this in two steps: * the search step: perform a search to select the documentation pages that are likely to contain the answer. * the GPT step: provide these pages as context with a prompt like "With this context: .... answer this questions: ...". For the search step, semantic search is often used, because it makes use of the LLM capabilities. However, we have found that in practice keyword search (e.g. BM25 based) has some advantages when it comes to tuning the search step, and it tends to be more "explainable".