JavaScript error: Cannot read properties of undefined (reading 'endsWith') (https://git.liteyuki.icu/assets/js/index.js?v=1.23.3 @ 15:151791). Open browser console to see more details.

11100 Commits

Author SHA1 Message Date
Clément Renault
e63fdf2b22
Move the heed env into the index itself to ease the usage of the library 2020-10-30 10:56:35 +01:00
Clément Renault
b5d52b6b45
Prefer using a smallstr instead of a real String to reduce allocations 2020-10-29 14:32:32 +01:00
Clément Renault
40993a0d25
Fix an indexing process bug, where documents were not written in order 2020-10-29 14:20:03 +01:00
Clément Renault
855a251489
Enable the clear documents optimization that wasn't working due to a bug 2020-10-29 13:52:48 +01:00
bors[bot]
39cf1931ae
Merge
1047: bump meilisearch r=Kerollmops a=MarinPostma



Co-authored-by: mpostma <postma.marin@protonmail.com>
v0.16.0rc0
2020-10-28 11:42:24 +00:00
mpostma
bbb6771625 bump meilisearch 2020-10-28 12:36:52 +01:00
Clément Renault
1228c2948d
Add a comment about the ClearDocuments operation in the DeleteDocuments 2020-10-28 11:17:36 +01:00
Clément Renault
98fc24cbdf
Bump heed to fix a prefix iter bug 2020-10-28 10:55:21 +01:00
Kerollmops
d6338af766
Improve documents deletion by iterating over all the word pair positions 2020-10-27 18:50:09 +01:00
Clément Renault
3889d956d9
Introduce the UpdateBuilder and use it in the HTTP routes 2020-10-27 18:47:58 +01:00
bors[bot]
e9f9f270e1
Merge
1045: Revert "Merge " r=MarinPostma a=MarinPostma

This reverts commit 257f9fb2b2b69045bff01a093e6ce15440af1bed, reversing
changes made to 9bae7a35bf98ee79370be422292fd71f5e884015.

The reason fo this is that de-unicoding is not always desirable (for example is the case of CJK documents). This cannot be handled correctly for now, and will necessitate work on the tokenizer.

Co-authored-by: mpostma <postma.marin@protonmail.com>
2020-10-27 17:16:27 +00:00
mpostma
190b78b7be Revert "Merge "
This reverts commit 257f9fb2b2b69045bff01a093e6ce15440af1bed, reversing
changes made to 9bae7a35bf98ee79370be422292fd71f5e884015.
2020-10-27 17:27:47 +01:00
bors[bot]
257f9fb2b2
Merge
1037: Synonym unidecode r=Kerollmops a=MarinPostma

fix  

- unidecodes all synonyms before adding them to the synonyms fst
- stores a copy of the original synonyms (unicoded) for later retrieve

Co-authored-by: mpostma <postma.marin@protonmail.com>
2020-10-27 10:57:40 +00:00
mpostma
d35a104ad3 requested changes 2020-10-27 11:53:24 +01:00
bors[bot]
9bae7a35bf
Merge
1032: Remove not maintained csv movies dataset r=MarinPostma a=bidoubiwa

Remove `movies.csv` from the dataset folder as it is not updated and not usable with MeiliSearch without converting it to json.

Co-authored-by: Charlotte Vermandel <charlottevermandel@gmail.com>
2020-10-27 08:18:20 +00:00
mpostma
33c7c5a7e3 remove del_synonyms function 2020-10-26 21:33:39 +01:00
mpostma
91363daeaa add tests 2020-10-26 17:48:13 +01:00
mpostma
f9ab85adbe deunicase synonyms 2020-10-26 17:47:55 +01:00
Clément Renault
5c62fbb6a8
Move the IndexDocuments update into its own module 2020-10-26 12:21:13 +01:00
Clément Renault
8f76ec97c0
Move the DeleteDocuments update into its own module 2020-10-26 11:01:00 +01:00
Clément Renault
92ef1faa97
Move the ClearDocuments update into its own module 2020-10-26 10:58:17 +01:00
Clément Renault
1e1821f002
Introduce the merge_two_obkv function to merge documents on update 2020-10-26 10:55:07 +01:00
Clément Renault
60347a5483
Move the AvailableDocumentsIds iterator into the update module 2020-10-26 10:53:23 +01:00
Clément Renault
b14cca2ad9
Introduce the UpdateBuilder type along with some update operations 2020-10-25 18:32:01 +01:00
Clément Renault
adacc7977d
Make the Index return default values when value don't exist 2020-10-25 18:30:24 +01:00
Clément Renault
a7a4984175
Introduce the Transform type into the indexing system 2020-10-24 17:06:09 +02:00
Clément Renault
b44b04d25b
Serialize the CSV record values as JSON strings 2020-10-24 14:43:46 +02:00
Clément Renault
656a851830
Introduce the Transform struct transforming CSVs
This allows us to:
  - transform a CSV, a JSON or a JSON lines data type into the same
    Grenad x Obkv streamable data type and creates the new FieldsIdsMap.
  - Extract all the documents user ids in advance to be able to delete
    the existing documents before re-indexing them.
  - Keep the last documents with the same user id avoiding duplicates
    in the same request.
2020-10-24 13:37:38 +02:00
Clément Renault
8d82e37ec0
Introduce the AvailableDocumentsIds iterator 2020-10-23 12:07:01 +02:00
Charlotte Vermandel
9dbf43d3e7 Update readme accordingly 2020-10-22 20:33:20 +02:00
Charlotte Vermandel
772f4d6671 Remove not maintained cvs movies dataset 2020-10-22 20:33:20 +02:00
bors[bot]
1b57218739
Merge
1040: Update movie posters r=Kerollmops a=bidoubiwa

This PR resolves 3 issues: 

1. update posters URLs that changed
2. All posters point to a smaller image ( +- 20kb instead of 500kb+-) this was done by changing the width size from 1280 px to 500 px. 
3. Remove films that are not in the tmdb database

Co-authored-by: Charlotte Vermandel <charlottevermandel@gmail.com>
2020-10-22 16:38:41 +00:00
Charlotte Vermandel
8767269b47 Update movie posters 2020-10-22 18:07:57 +02:00
bors[bot]
baceaed582
Merge
1038: Add Sandbox section to README.md r=LegendreM a=eskombro

This PR adds a link to [MeiliSearch Sandbox](https://sandbox.meilisearch.com/) in the README.md

Co-authored-by: Samuel Jimenez <sjimenezre@gmail.com>
2020-10-22 15:25:23 +00:00
Samuel Jimenez
62a28bc2a1 Add Sandbox section to README.md 2020-10-22 17:04:45 +02:00
bors[bot]
f83caa6c40
Merge
1008: Dump info r=Kerollmops a=LegendreM

fix  
fix  
fix 
fix 
fix 


Co-authored-by: many <maxime@meilisearch.com>
2020-10-22 14:23:50 +00:00
many
53b1483e71
fix pr comments 2020-10-22 16:12:55 +02:00
many
a0eafea200
fix tests 2020-10-22 15:46:20 +02:00
many
10dace305d
snapshot at start 2020-10-22 15:46:20 +02:00
many
1eace79f77
change error message to be absolute 2020-10-22 15:46:20 +02:00
many
e6033e174d
fix 2020-10-22 15:46:20 +02:00
many
f1925b8f71
fix 2020-10-22 15:46:20 +02:00
many
834f3cc192
rename folder to dir 2020-10-22 15:46:20 +02:00
many
e049aead16
improve dump status 2020-10-22 15:46:20 +02:00
Clément Renault
2a4cd81c86
Add documentation to the Index methods 2020-10-22 15:44:12 +02:00
Clément Renault
566a7c3039
Make the FieldsIdsMap serialization more stable by using a BTreeMap 2020-10-22 14:53:20 +02:00
Clément Renault
9133f38138
Introduce the FieldsIdsMap type 2020-10-22 12:56:35 +02:00
bors[bot]
0a9c9670e7
Merge
1028: Clean external contributions r=Kerollmops a=LegendreM

We accepted some unperfect external PRs, this one is here to clean this:
-  clean PR  (remove changelog line and add forgotten newline)
- remove useless function after health route refacto 

Co-authored-by: many <maxime@meilisearch.com>
Co-authored-by: Many <legendre.maxime.isn@gmail.com>
2020-10-22 10:46:19 +00:00
Many
1744dcebfe
Merge branch 'master' into clean_external_contributions 2020-10-22 12:23:51 +02:00
Clément Renault
802e925fd7
Switch to a JSON protocol for the front page 2020-10-21 18:26:29 +02:00