meilisearch/milli/src/search
meili-bors[bot] e9bf4c43a4
Merge #4649
4649: Don't store the vectors in the documents database r=dureuill a=irevoire

# Pull Request

## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/4607

## What does this PR do?
- Ensure that anything falling under `_vectors` is NOT searchable, filterable or sortable
- [x] per embedder, add a roaring bitmap of documents that provide "userProvided" embeddings
- [x] in the indexing process in extract_vector_points, set the bit corresponding to the document depending on the "userProvided" subfield in the _vectors field.
- [x] in the document DB in typed chunks, when writing the _vectors field, remove all keys corresponding to an embedder

Co-authored-by: Tamo <tamo@meilisearch.com>
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2024-06-17 12:32:03 +00:00
..
facet Revert "Reduce the universe while exploring the facet tree" because it's slower this way 2024-06-06 09:17:51 -04:00
new Merge #4649 2024-06-17 12:32:03 +00:00
fst_utils.rs custom fst automatons 2022-03-15 17:38:35 +01:00
hybrid.rs Add ranking_score_threshold to milli 2024-05-29 14:17:09 +02:00
mod.rs Merge #4666 2024-06-03 08:42:44 +00:00
similar.rs Add ranking score threshold to similar 2024-05-30 11:20:50 +02:00