snowykami/meilisearch
1
0
Fork 0
mirror of https://github.com/meilisearch/meilisearch.git synced 2024-11-25 19:45:05 +08:00
Code Issues Actions 4 Packages Projects Releases Wiki Activity
8,537 Commits 166 Branches 387 Tags 80 MiB
diff-indexing-prefixes
Commit Graph

1902 Commits

Author SHA1 Message Date
Clément Renault
02a40645e2
Add TODOs to the prefix functions 2023-10-19 17:58:52 +02:00
ManyTheFish
b8fed737ef update extract word pair proximity to support deladd obkvs 2023-10-19 14:18:14 +02:00
ManyTheFish
c63ff5298b update extract word position docids 2023-10-19 13:27:07 +02:00
ManyTheFish
d50408d670 update extract word docids 2023-10-19 11:59:12 +02:00
ManyTheFish
e0dc413521 Make script language docids map taking a tuple of roaring bitmaps expressing the deletions and the additions 2023-10-19 11:59:12 +02:00
Clément Renault
061f490204
Update extract_facet_string_docids to support deladd obkvs 2023-10-19 10:08:15 +02:00
Clément Renault
5c43ff72c1
Update extract_facet_number_docids to support deladd obkvs 2023-10-18 17:40:13 +02:00
Clément Renault
c445e9daec
Rename docid_fid into fid_docid 2023-10-18 13:53:58 +02:00
Clément Renault
178a9802fa
Implement all the facet extraction paths and simplify them 2023-10-18 11:02:19 +02:00
Clément Renault
7d546b9c22
Generate the DelAdd for is_null, is_empty, and exists 2023-10-18 11:02:19 +02:00
Clément Renault
c829feb40b
Work on fid docid facet values rewrite 2023-10-18 11:02:19 +02:00
ManyTheFish
b88fd7994c Support diff indexing on extract_docid_word_positions 2023-10-16 14:58:11 +02:00
ManyTheFish
096d7705c7 Make the transform struct return diff-based documents obkvs 2023-10-12 11:46:56 +02:00
ManyTheFish
e8f8730467 deactivate prefix dbs 2023-10-10 16:17:03 +02:00
ManyTheFish
26ef0b3a07 clean PR warnings 2023-10-10 14:04:56 +02:00
ManyTheFish
20394fda04 Split wpp in several sorters 2023-10-10 14:04:56 +02:00
ManyTheFish
27161bcd05 Fix word pair proximity 2023-10-10 14:04:56 +02:00
ManyTheFish
04fd44b5e2 Use a vecDeque in wpp database 2023-10-10 14:04:56 +02:00
ManyTheFish
9078e60024 Generalize usage of CboRoaringBitmap codec to ease the use 2023-10-10 14:04:56 +02:00
ManyTheFish
8fb96b8274 Add buffer to the obkv writter 2023-10-10 14:04:56 +02:00
ManyTheFish
50ba751244 Compute word_fid_docids before word_docids and exact_word_docids 2023-10-10 14:04:56 +02:00
ManyTheFish
f36c36e368 add puffin in sorter into reeder function 2023-10-10 14:04:56 +02:00
ManyTheFish
c2dcd66d32 Fix 2023-10-10 14:04:56 +02:00
ManyTheFish
d4594306d3 Fix fid_word_docids 2023-10-10 14:04:56 +02:00
ManyTheFish
93d0680903 Add usefull debug assert before key insertion in database 2023-10-10 14:04:56 +02:00
ManyTheFish
01101d55ac Wip 2023-10-10 14:04:56 +02:00
meili-bors[bot]
487d493f49
Merge #4043 
4043: Bring back hotfixes from v1.3.3 into v1.4.0 r=Kerollmops a=curquiza



Co-authored-by: curquiza <curquiza@users.noreply.github.com>
Co-authored-by: meili-bors[bot] <89034592+meili-bors[bot]@users.noreply.github.com>
Co-authored-by: Kerollmops <clement@meilisearch.com>
Co-authored-by: curquiza <clementine@meilisearch.com>
 2023-09-11 12:27:34 +00:00
Vivek Kumar
abfa7ded25
use a new temp index in the test 2023-09-08 12:32:47 +05:30
Vivek Kumar
f2837aaec2
add another test case 2023-09-08 11:39:54 +05:30
Vivek Kumar
11df155598
fix highlighting bug when searching for a phrase with cropping 2023-09-08 11:39:52 +05:30
meili-bors[bot]
256cf33bca
Merge #4039 
4039: Fix multiple vectors dimensions r=ManyTheFish a=Kerollmops

This PR fixes #4035, making providing multiple vectors in documents possible. This is fixed by extracting the vectors from the non-flattened version of the documents.

Co-authored-by: Kerollmops <clement@meilisearch.com>
 2023-09-07 09:25:58 +00:00
Kerollmops
679c0b0f97
Extract the vectors from the non-flattened version of the documents 2023-09-06 12:26:00 +02:00
Kerollmops
e02d0064bd
Add a test case scenario 2023-09-06 12:26:00 +02:00
meili-bors[bot]
dc3d9c90d9
Merge #3994 
3994: Fix synonyms with separators r=Kerollmops a=ManyTheFish

# Pull Request

## Related issue
Fixes #3977

## Available prototype
```
$ docker pull getmeili/meilisearch:prototype-fix-synonyms-with-separators-0
```

## What does this PR do?
- add a new test
- filter the empty synonyms after normalization


Co-authored-by: ManyTheFish <many@meilisearch.com>
 2023-09-05 14:42:46 +00:00
ManyTheFish
66aa6d5871 Ignore tokens with empty normalized value during indexing process 2023-09-05 15:44:14 +02:00
Kerollmops
8ac5b765bc
Fix synonyms normalization 2023-09-04 16:12:48 +02:00
Kerollmops
085aad0a94
Add a test 2023-09-04 14:39:33 +02:00
meili-bors[bot]
ccf3ba3f32
Merge #4019 
4019: Bringing back changes from `v1.3.2` onto `main` r=irevoire a=Kerollmops



Co-authored-by: Kerollmops <clement@meilisearch.com>
Co-authored-by: meili-bors[bot] <89034592+meili-bors[bot]@users.noreply.github.com>
Co-authored-by: irevoire <irevoire@users.noreply.github.com>
Co-authored-by: Clément Renault <clement@meilisearch.com>
 2023-08-28 12:14:11 +00:00
Clément Renault
8c0ebd1331
Update milli/src/search/new/bucket_sort.rs 
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
 2023-08-23 16:40:39 +02:00
Kerollmops
5130e06b41
Temporarily disable an assert in the ranking rules 2023-08-23 16:11:54 +02:00
meili-bors[bot]
914b125c5f
Merge #3945 
3945: Do not leak field information on error r=Kerollmops a=vivek-26

# Pull Request

## Related issue
Fixes #3865

## What does this PR do?
This PR ensures that `InvalidSortableAttribute`and `InvalidFacetSearchFacetName` errors do not leak field information i.e. fields which are not part of `displayedAttributes` in the settings are hidden from the error message.

## PR checklist
Please check if your PR fulfills the following requirements:
- [x] Does this PR fix an existing issue, or have you listed the changes applied in the PR description (and why they are needed)?
- [x] Have you read the contributing guidelines?
- [x] Have you made sure that the title is accurate and descriptive of the changes?

Thank you so much for contributing to Meilisearch!


Co-authored-by: Vivek Kumar <vivek.26@outlook.com>
 2023-08-22 18:55:27 +00:00
Kerollmops
717b069907
Bump charabia to 0.8.3 2023-08-22 16:25:00 +02:00
Kerollmops
c53841e166
Accept the null JSON value as the value of _vectors 2023-08-14 16:03:55 +02:00
ManyTheFish
cab27c2ab4 upgrade indexmap = "2.0.0" 2023-08-10 18:09:02 +02:00
ManyTheFish
624fa9052f upgrade deserr = "0.6.0" 2023-08-10 18:09:02 +02:00
ManyTheFish
60c11dbdbd upgrade rstar - "0.11.0" 2023-08-10 18:09:02 +02:00
ManyTheFish
dacee40ebc upgrade memmap2 = "0.7.1" 2023-08-10 18:09:02 +02:00
ManyTheFish
cc2c19d4c3 upgrade itertools = "0.10.5" 2023-08-10 18:09:02 +02:00
meili-bors[bot]
e4e49e63d0
Merge #3993 
3993: Bringing back changes from v1.3.1 to `main` r=irevoire a=curquiza



Co-authored-by: irevoire <irevoire@users.noreply.github.com>
Co-authored-by: meili-bors[bot] <89034592+meili-bors[bot]@users.noreply.github.com>
Co-authored-by: Tamo <tamo@meilisearch.com>
Co-authored-by: ManyTheFish <many@meilisearch.com>
 2023-08-10 14:30:02 +00:00
ManyTheFish
5a7c1bde84 Fix clippy 2023-08-10 11:27:56 +02:00