Commit Graph

10367 Commits

Author SHA1 Message Date
ManyTheFish
ff4b3578bf Fix index_documents_check_exists_database 2024-11-20 09:47:02 +01:00
ManyTheFish
cb226079fa Use tokenizer on numbers and booleans 2024-11-20 08:28:24 +01:00
Louis Dureuil
6f00c1dfb8
Add depth to facet extraction so that null inside an array doesn't mark the entire field as null 2024-11-19 17:52:44 +01:00
Clément Renault
b4fceb52e5
We no longer index geo lat and lng 2024-11-19 17:33:30 +01:00
ManyTheFish
511bd79132
Fix filtered_placeholder_search_should_not_return_deleted_documents and word_scale_set_and_reset 2024-11-19 16:59:09 +01:00
Louis Dureuil
094d922810
Fix setup_search_index_with_criteria 2024-11-19 16:49:28 +01:00
Louis Dureuil
e11e45348e
Attempt to fix setup_search_index_with_criteria 2024-11-19 16:49:27 +01:00
Clément Renault
153168c847
Improve test 2024-11-19 16:18:27 +01:00
Clément Renault
1088248546
One more 2024-11-19 16:02:57 +01:00
Clément Renault
340e2e1315
Fix a bit of the placeholder search tests 2024-11-19 15:56:08 +01:00
Louis Dureuil
9d25f0e9bf
Fix stats_should_not_return_deleted_documents 2024-11-19 15:53:35 +01:00
Louis Dureuil
f69dde5695
One more test passing 2024-11-19 15:45:26 +01:00
Louis Dureuil
9281d739e4
Fail in case of user error in tests 2024-11-19 15:35:51 +01:00
Clément Renault
2c38f9bedb
Correctly count indexed documents 2024-11-19 15:17:55 +01:00
Louis Dureuil
4c59503c6c
Allow fetching embedders from inside tests 2024-11-19 15:16:49 +01:00
Clément Renault
0019ec74fe
Count the number of documents correctly 2024-11-19 15:02:37 +01:00
Clément Renault
bce7ab614a
Generate internal ids only when needed 2024-11-19 14:46:25 +01:00
Louis Dureuil
ec31e33fdc
Remove all autogenerated tests 2024-11-19 14:31:52 +01:00
Louis Dureuil
53ef92bec7
Subfields of _vectors are no longer part of the fid map 2024-11-19 14:21:23 +01:00
Louis Dureuil
fad8080c8c
fix one 2024-11-19 14:18:07 +01:00
Clément Renault
105ede55e6
Increase the number of readers as the indexer uses readers too 2024-11-19 13:47:45 +01:00
Louis Dureuil
32caf3745e
documents! macro accepts a single object again 2024-11-19 12:02:26 +01:00
Clément Renault
2cf5faa0e8
Fix all the benchmark compilation errors 2024-11-19 11:24:41 +01:00
Louis Dureuil
708b4d0e6c
Fix settings test 2024-11-19 11:13:59 +01:00
Louis Dureuil
1e04880873
Removed some warnings 2024-11-19 11:13:59 +01:00
Clément Renault
67ded73161
Fix the benchmark tests 2024-11-19 10:46:14 +01:00
Clément Renault
848bb0be31
Fix some tests but not all of them 2024-11-19 10:23:25 +01:00
Clément Renault
8ef51bb683
Remove useless Transform methods 2024-11-19 10:23:25 +01:00
Louis Dureuil
bfefaf71c2
Progress displayed in logs 2024-11-19 09:32:52 +01:00
Louis Dureuil
c782c09208
Move step to a dedicated mod and replace it with an enum 2024-11-18 18:22:13 +01:00
Louis Dureuil
75943a5a9b
Add TODO to remember replacing steps with an enum 2024-11-18 17:40:51 +01:00
Louis Dureuil
04c38220ca
Move MostlySend, ThreadLocal, FullySend to their own commit 2024-11-18 16:43:05 +01:00
Louis Dureuil
5f93651cef
fixes 2024-11-18 16:23:11 +01:00
Louis Dureuil
0a21d9bfb3
Fix double borrow of new fields id map 2024-11-18 15:56:01 +01:00
Louis Dureuil
1f8b01a598
Fix snap since _vectors is no longer part of the field distributions 2024-11-18 12:50:59 +01:00
Louis Dureuil
e736a74729
Remove infinite loop in import_vectors 2024-11-18 12:50:56 +01:00
Louis Dureuil
e9d17136b2
Add deadline of 3 seconds to embedding requests made in the context of hybrid search 2024-11-18 12:15:11 +01:00
Louis Dureuil
a05e448cf8
Add test 2024-11-18 12:15:11 +01:00
Louis Dureuil
6570da3bcb
Retry in case where the JSON deserialization fails 2024-11-18 11:33:09 +01:00
Clément Renault
5b4c06c24c
Plug the grenad max memory parameter 2024-11-18 11:28:04 +01:00
Louis Dureuil
9150c8f052
Accept changes to vector format 2024-11-18 11:04:57 +01:00
Louis Dureuil
c202f3dbe2
fix tests and revert change in behavior when primary_key_from_op != primary_key_from_db && index.is_empty() 2024-11-18 10:59:05 +01:00
Clément Renault
677d7293f5
Fix a lot of primary key related tests 2024-11-18 10:59:05 +01:00
Clément Renault
bd31ea2174
Check for at least one valid task after setting their statuses 2024-11-18 10:59:05 +01:00
Clément Renault
83865d2ebd
Expose intermediate errors when processing batches 2024-11-18 10:59:05 +01:00
ManyTheFish
4ff2b3c2ee Fix test on locales 2024-11-14 15:45:04 +01:00
ManyTheFish
91c58cfa38 Fix positional databases 2024-11-14 11:40:12 +01:00
Clément Renault
9e8367f1e6
Move the rayon thread pool outside the extract method 2024-11-14 10:40:32 +01:00
Louis Dureuil
0e3c5d91ab
Document deletion test passes 2024-11-14 08:42:56 +01:00
Louis Dureuil
695c2c6b99
Cosmetic fix 2024-11-14 08:42:39 +01:00