107 Commits

Author	SHA1	Message	Date
ManyTheFish	ff4b3578bf	Fix index_documents_check_exists_database	2024-11-20 09:47:02 +01:00
ManyTheFish	cb226079fa	Use tokenizer on numbers and booleans	2024-11-20 08:28:24 +01:00
Louis Dureuil	6f00c1dfb8	Add depth to facet extraction so that null inside an array doesn't mark the entire field as null	2024-11-19 17:52:44 +01:00
Clément Renault	b4fceb52e5	We no longer index geo lat and lng	2024-11-19 17:33:30 +01:00
ManyTheFish	511bd79132	Fix filtered_placeholder_search_should_not_return_deleted_documents and word_scale_set_and_reset	2024-11-19 16:59:09 +01:00
Louis Dureuil	094d922810	Fix setup_search_index_with_criteria	2024-11-19 16:49:28 +01:00
Louis Dureuil	e11e45348e	Attempt to fix setup_search_index_with_criteria	2024-11-19 16:49:27 +01:00
Clément Renault	153168c847	Improve test	2024-11-19 16:18:27 +01:00
Clément Renault	1088248546	One more	2024-11-19 16:02:57 +01:00
Clément Renault	340e2e1315	Fix a bit of the placeholder search tests	2024-11-19 15:56:08 +01:00
Louis Dureuil	9d25f0e9bf	Fix stats_should_not_return_deleted_documents	2024-11-19 15:53:35 +01:00
Louis Dureuil	f69dde5695	One more test passing	2024-11-19 15:45:26 +01:00
Louis Dureuil	9281d739e4	Fail in case of user error in tests	2024-11-19 15:35:51 +01:00
Clément Renault	2c38f9bedb	Correctly count indexed documents	2024-11-19 15:17:55 +01:00
Louis Dureuil	4c59503c6c	Allow fetching embedders from inside tests	2024-11-19 15:16:49 +01:00
Clément Renault	0019ec74fe	Count the number of documents correctly	2024-11-19 15:02:37 +01:00
Clément Renault	bce7ab614a	Generate internal ids only when needed	2024-11-19 14:46:25 +01:00
Louis Dureuil	ec31e33fdc	Remove all autogenerated tests	2024-11-19 14:31:52 +01:00
Louis Dureuil	53ef92bec7	Subfields of _vectors are no longer part of the fid map	2024-11-19 14:21:23 +01:00
Louis Dureuil	fad8080c8c	fix one	2024-11-19 14:18:07 +01:00
Clément Renault	105ede55e6	Increase the number of readers as the indexer uses readers too	2024-11-19 13:47:45 +01:00
Louis Dureuil	32caf3745e	documents! macro accepts a single object again	2024-11-19 12:02:26 +01:00
Clément Renault	2cf5faa0e8	Fix all the benchmark compilation errors	2024-11-19 11:24:41 +01:00
Louis Dureuil	708b4d0e6c	Fix settings test	2024-11-19 11:13:59 +01:00
Louis Dureuil	1e04880873	Removed some warnings	2024-11-19 11:13:59 +01:00
Clément Renault	67ded73161	Fix the benchmark tests	2024-11-19 10:46:14 +01:00
Clément Renault	848bb0be31	Fix some tests but not all of them	2024-11-19 10:23:25 +01:00
Clément Renault	8ef51bb683	Remove useless Transform methods	2024-11-19 10:23:25 +01:00
Louis Dureuil	bfefaf71c2	Progress displayed in logs	2024-11-19 09:32:52 +01:00
Louis Dureuil	c782c09208	Move step to a dedicated mod and replace it with an enum	2024-11-18 18:22:13 +01:00
Louis Dureuil	75943a5a9b	Add TODO to remember replacing steps with an enum	2024-11-18 17:40:51 +01:00
Louis Dureuil	04c38220ca	Move MostlySend, ThreadLocal, FullySend to their own commit	2024-11-18 16:43:05 +01:00
Louis Dureuil	5f93651cef	fixes	2024-11-18 16:23:11 +01:00
Louis Dureuil	0a21d9bfb3	Fix double borrow of new fields id map	2024-11-18 15:56:01 +01:00
Louis Dureuil	1f8b01a598	Fix snap since _vectors is no longer part of the field distributions	2024-11-18 12:50:59 +01:00
Louis Dureuil	e736a74729	Remove infinite loop in import_vectors	2024-11-18 12:50:56 +01:00
Louis Dureuil	e9d17136b2	Add deadline of 3 seconds to embedding requests made in the context of hybrid search	2024-11-18 12:15:11 +01:00
Louis Dureuil	a05e448cf8	Add test	2024-11-18 12:15:11 +01:00
Louis Dureuil	6570da3bcb	Retry in case where the JSON deserialization fails	2024-11-18 11:33:09 +01:00
Clément Renault	5b4c06c24c	Plug the grenad max memory parameter	2024-11-18 11:28:04 +01:00
Louis Dureuil	9150c8f052	Accept changes to vector format	2024-11-18 11:04:57 +01:00
Louis Dureuil	c202f3dbe2	fix tests and revert change in behavior when primary_key_from_op != primary_key_from_db && index.is_empty()	2024-11-18 10:59:05 +01:00
Clément Renault	677d7293f5	Fix a lot of primary key related tests	2024-11-18 10:59:05 +01:00
Clément Renault	bd31ea2174	Check for at least one valid task after setting their statuses	2024-11-18 10:59:05 +01:00
Clément Renault	83865d2ebd	Expose intermediate errors when processing batches	2024-11-18 10:59:05 +01:00
ManyTheFish	4ff2b3c2ee	Fix test on locales	2024-11-14 15:45:04 +01:00
ManyTheFish	91c58cfa38	Fix positional databases	2024-11-14 11:40:12 +01:00
Clément Renault	9e8367f1e6	Move the rayon thread pool outside the extract method	2024-11-14 10:40:32 +01:00
Louis Dureuil	0e3c5d91ab	Document deletion test passes	2024-11-14 08:42:56 +01:00
Louis Dureuil	695c2c6b99	Cosmetic fix	2024-11-14 08:42:39 +01:00