meilisearch/milli/src/vector
meili-bors[bot] b1844b0c27
Merge #4548
4548: v1.8 hybrid search changes r=dureuill a=dureuill

Implements the search changes from the [usage page](https://meilisearch.notion.site/v1-8-AI-search-API-usage-135552d6e85a4a52bc7109be82aeca42#40f24df3da694428a39cc8043c9cfc64)

### ⚠️ Breaking changes in an experimental feature:

- Removed the `_semanticScore`. Use the `_rankingScore` instead.
- Removed `vector` in the response of the search (output was too big).
- Removed all the vectors from the `vectorSort` ranking score details
  - target vector appearing in the name of the rule
  - matched vector appearing in the details of the rule

### Other user-facing changes

- Added `semanticHitCount`, indicating how many hits were returned from the semantic search. This is especially useful in the hybrid search.
- Embed lazily: Meilisearch no longer generates an embedding when the keyword results are "good enough".
- Graceful embedding failure in hybrid search: when doing hybrid search (`semanticRatio in ]0.0, 1.0[`), an embedding failure no longer causes the search request to fail. Instead, only the keyword search is performed. When doing a full vector search (`semanticRatio==1.0`), a failure to embed will still result in failing that search.

Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2024-04-04 16:00:20 +00:00
..
error.rs milli: add Embedder::embed_one 2024-04-04 15:57:29 +02:00
hf.rs Merge #4549 2024-04-04 13:47:18 +00:00
manual.rs Add distribution to all embedders 2024-03-27 11:50:22 +01:00
mod.rs milli: add Embedder::embed_one 2024-04-04 15:57:29 +02:00
ollama.rs Add distribution to all embedders 2024-03-27 11:50:22 +01:00
openai.rs Add distribution to all embedders 2024-03-27 11:50:22 +01:00
rest.rs Expose REST embedder to the API 2024-03-25 11:23:15 +01:00
settings.rs Finer granularity for embedder needs reindex 2024-03-27 12:01:34 +01:00