Louis Dureuil
9b4627cc8b
Facets Bulk update
2023-10-19 21:06:03 +02:00
Clément Renault
4941543dfe
Introduce the CboRoaringBitmapCodec merge_deladd_into and use it
2023-10-19 18:10:09 +02:00
Clément Renault
87f8cb8b62
Introduce a function to only serialize the Add side of a DelAdd obkv
2023-10-19 18:09:44 +02:00
Clément Renault
81fe3eaa09
Rename FieldIdWordCountDocids correctly
2023-10-19 18:09:44 +02:00
ManyTheFish
b8fed737ef
update extract word pair proximity to support deladd obkvs
2023-10-19 14:18:14 +02:00
ManyTheFish
c63ff5298b
update extract word position docids
2023-10-19 13:27:07 +02:00
ManyTheFish
d50408d670
update extract word docids
2023-10-19 11:59:12 +02:00
ManyTheFish
e0dc413521
Make script language docids map taking a tuple of roaring bitmaps expressing the deletions and the additions
2023-10-19 11:59:12 +02:00
Clément Renault
061f490204
Update extract_facet_string_docids to support deladd obkvs
2023-10-19 10:08:15 +02:00
Clément Renault
5c43ff72c1
Update extract_facet_number_docids to support deladd obkvs
2023-10-18 17:40:13 +02:00
Clément Renault
c445e9daec
Rename docid_fid into fid_docid
2023-10-18 13:53:58 +02:00
Clément Renault
178a9802fa
Implement all the facet extraction paths and simplify them
2023-10-18 11:02:19 +02:00
Clément Renault
7d546b9c22
Generate the DelAdd for is_null, is_empty, and exists
2023-10-18 11:02:19 +02:00
Clément Renault
c829feb40b
Work on fid docid facet values rewrite
2023-10-18 11:02:19 +02:00
ManyTheFish
b88fd7994c
Support diff indexing on extract_docid_word_positions
2023-10-16 14:58:11 +02:00
ManyTheFish
096d7705c7
Make the transform struct return diff-based documents obkvs
2023-10-12 11:46:56 +02:00
ManyTheFish
e8f8730467
deactivate prefix dbs
2023-10-10 16:17:03 +02:00
ManyTheFish
26ef0b3a07
clean PR warnings
2023-10-10 14:04:56 +02:00
ManyTheFish
20394fda04
Split wpp in several sorters
2023-10-10 14:04:56 +02:00
ManyTheFish
27161bcd05
Fix word pair proximity
2023-10-10 14:04:56 +02:00
ManyTheFish
04fd44b5e2
Use a vecDeque in wpp database
2023-10-10 14:04:56 +02:00
ManyTheFish
9078e60024
Generalize usage of CboRoaringBitmap codec to ease the use
2023-10-10 14:04:56 +02:00
ManyTheFish
8fb96b8274
Add buffer to the obkv writter
2023-10-10 14:04:56 +02:00
ManyTheFish
50ba751244
Compute word_fid_docids before word_docids and exact_word_docids
2023-10-10 14:04:56 +02:00
ManyTheFish
f36c36e368
add puffin in sorter into reeder function
2023-10-10 14:04:56 +02:00
ManyTheFish
c2dcd66d32
Fix
2023-10-10 14:04:56 +02:00
ManyTheFish
d4594306d3
Fix fid_word_docids
2023-10-10 14:04:56 +02:00
ManyTheFish
93d0680903
Add usefull debug assert before key insertion in database
2023-10-10 14:04:56 +02:00
ManyTheFish
01101d55ac
Wip
2023-10-10 14:04:56 +02:00
meili-bors[bot]
487d493f49
Merge #4043
...
4043: Bring back hotfixes from v1.3.3 into v1.4.0 r=Kerollmops a=curquiza
Co-authored-by: curquiza <curquiza@users.noreply.github.com>
Co-authored-by: meili-bors[bot] <89034592+meili-bors[bot]@users.noreply.github.com>
Co-authored-by: Kerollmops <clement@meilisearch.com>
Co-authored-by: curquiza <clementine@meilisearch.com>
2023-09-11 12:27:34 +00:00
Vivek Kumar
abfa7ded25
use a new temp index in the test
2023-09-08 12:32:47 +05:30
Vivek Kumar
f2837aaec2
add another test case
2023-09-08 11:39:54 +05:30
Vivek Kumar
11df155598
fix highlighting bug when searching for a phrase with cropping
2023-09-08 11:39:52 +05:30
meili-bors[bot]
256cf33bca
Merge #4039
...
4039: Fix multiple vectors dimensions r=ManyTheFish a=Kerollmops
This PR fixes #4035 , making providing multiple vectors in documents possible. This is fixed by extracting the vectors from the non-flattened version of the documents.
Co-authored-by: Kerollmops <clement@meilisearch.com>
2023-09-07 09:25:58 +00:00
Kerollmops
679c0b0f97
Extract the vectors from the non-flattened version of the documents
2023-09-06 12:26:00 +02:00
Kerollmops
e02d0064bd
Add a test case scenario
2023-09-06 12:26:00 +02:00
meili-bors[bot]
dc3d9c90d9
Merge #3994
...
3994: Fix synonyms with separators r=Kerollmops a=ManyTheFish
# Pull Request
## Related issue
Fixes #3977
## Available prototype
```
$ docker pull getmeili/meilisearch:prototype-fix-synonyms-with-separators-0
```
## What does this PR do?
- add a new test
- filter the empty synonyms after normalization
Co-authored-by: ManyTheFish <many@meilisearch.com>
2023-09-05 14:42:46 +00:00
ManyTheFish
66aa6d5871
Ignore tokens with empty normalized value during indexing process
2023-09-05 15:44:14 +02:00
Kerollmops
8ac5b765bc
Fix synonyms normalization
2023-09-04 16:12:48 +02:00
Kerollmops
085aad0a94
Add a test
2023-09-04 14:39:33 +02:00
meili-bors[bot]
ccf3ba3f32
Merge #4019
...
4019: Bringing back changes from `v1.3.2` onto `main` r=irevoire a=Kerollmops
Co-authored-by: Kerollmops <clement@meilisearch.com>
Co-authored-by: meili-bors[bot] <89034592+meili-bors[bot]@users.noreply.github.com>
Co-authored-by: irevoire <irevoire@users.noreply.github.com>
Co-authored-by: Clément Renault <clement@meilisearch.com>
2023-08-28 12:14:11 +00:00
Clément Renault
8c0ebd1331
Update milli/src/search/new/bucket_sort.rs
...
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2023-08-23 16:40:39 +02:00
Kerollmops
5130e06b41
Temporarily disable an assert in the ranking rules
2023-08-23 16:11:54 +02:00
meili-bors[bot]
914b125c5f
Merge #3945
...
3945: Do not leak field information on error r=Kerollmops a=vivek-26
# Pull Request
## Related issue
Fixes #3865
## What does this PR do?
This PR ensures that `InvalidSortableAttribute`and `InvalidFacetSearchFacetName` errors do not leak field information i.e. fields which are not part of `displayedAttributes` in the settings are hidden from the error message.
## PR checklist
Please check if your PR fulfills the following requirements:
- [x] Does this PR fix an existing issue, or have you listed the changes applied in the PR description (and why they are needed)?
- [x] Have you read the contributing guidelines?
- [x] Have you made sure that the title is accurate and descriptive of the changes?
Thank you so much for contributing to Meilisearch!
Co-authored-by: Vivek Kumar <vivek.26@outlook.com>
2023-08-22 18:55:27 +00:00
Kerollmops
717b069907
Bump charabia to 0.8.3
2023-08-22 16:25:00 +02:00
Kerollmops
c53841e166
Accept the null JSON value as the value of _vectors
2023-08-14 16:03:55 +02:00
ManyTheFish
cab27c2ab4
upgrade indexmap = "2.0.0"
2023-08-10 18:09:02 +02:00
ManyTheFish
624fa9052f
upgrade deserr = "0.6.0"
2023-08-10 18:09:02 +02:00
ManyTheFish
60c11dbdbd
upgrade rstar - "0.11.0"
2023-08-10 18:09:02 +02:00
ManyTheFish
dacee40ebc
upgrade memmap2 = "0.7.1"
2023-08-10 18:09:02 +02:00