4228 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Tamo	b87b071718	apply most style comments of the review	2022-10-20 16:14:36 +02:00
Tamo	e220cc2183	Update dump/src/error.rs ... Co-authored-by: Clément Renault <clement@meilisearch.com>	2022-10-20 16:14:36 +02:00
Tamo	458a531547	rebase on index-scheduler	2022-10-20 16:14:35 +02:00
Tamo	6987bc185e	fix a synchronization bug while importing tasks	2022-10-20 16:13:18 +02:00
Tamo	a2384dc627	fix all the errors code and settings issues when importing a dump v2	2022-10-20 16:13:18 +02:00
Tamo	bab0e050f1	fix all the error codes	2022-10-20 16:13:18 +02:00
Tamo	748249578d	commit after creating an index	2022-10-20 16:13:17 +02:00
Tamo	54d4d364c2	fix the deletion of the data.ms in case of errors	2022-10-20 16:13:17 +02:00
Tamo	9b96085327	the index-scheduler needs to wake-up after importing a dump	2022-10-20 16:13:17 +02:00
Tamo	4c1c108a19	remove the dbg	2022-10-20 16:13:17 +02:00
Tamo	c82bd429db	fix the content_file import	2022-10-20 16:13:17 +02:00
Tamo	8c9b758fa8	stop dumping the current dumping task as enqueued so it's not looping for ever	2022-10-20 16:13:17 +02:00
Tamo	ede46b716c	add a bufwriter on the documents	2022-10-20 16:13:16 +02:00
Tamo	cac924b663	first mostly working version	2022-10-20 16:13:16 +02:00
Tamo	6fae317277	update the API a little bit	2022-10-20 16:12:26 +02:00
Tamo	1a3fea4d8c	fix the tests	2022-10-20 16:12:26 +02:00
Tamo	9323f9f1c4	write the dump export	2022-10-20 16:12:25 +02:00
Loïc Lecrenier	7ce336306d	Fix number of deleted tasks details after duplicate task deletion	2022-10-20 16:09:33 +02:00
Loïc Lecrenier	d49d7e9c2d	Add task deletion tests where the same task is deleted twice	2022-10-20 16:09:33 +02:00
Loïc Lecrenier	dabc30d3d6	Return an error when calling DELETE /tasks with an empty query	2022-10-20 16:09:32 +02:00
Loïc Lecrenier	9067148270	Apply suggested changes from PR review	2022-10-20 16:09:32 +02:00
Loïc Lecrenier	4bd8607cf9	Avoid creating two read txn at the same time	2022-10-20 16:09:32 +02:00
Loïc Lecrenier	4c6145f782	Update snapshot tests following git rebase that fixes a bug	2022-10-20 16:09:32 +02:00
Loïc Lecrenier	012c3e986c	Finish first draft of the DELETE /tasks route	2022-10-20 16:09:32 +02:00
Loïc Lecrenier	ef3e9e87f5	Continue implementation of task deletion ... 1. Matched tasks are a roaring bitmap 2. Start implementation in meilisearch-http 3. Snapshots use meili-snap 4. Rename to TaskDeletion	2022-10-20 16:08:16 +02:00
Kerollmops	7d4527728e	Make sure that we do not batch tasks from different indexes	2022-10-20 16:00:58 +02:00
Kerollmops	1c697edb95	Add a test to check different indexes autobatching	2022-10-20 16:00:58 +02:00
Kerollmops	8433a432b1	Extract index creation rights and simplify the autobatcher rules	2022-10-20 16:00:58 +02:00
Kerollmops	ea192d31f4	Fix invalid import of tasks types	2022-10-20 16:00:58 +02:00
Tamo	dc1d739785	move the API key in meilisearch_types	2022-10-20 16:00:58 +02:00
Tamo	c9050759f5	remove an unused file	2022-10-20 15:59:53 +02:00
Tamo	c0a6f7a021	uncomment a task serialization test	2022-10-20 15:59:53 +02:00
Tamo	e533e740d4	refactor the Task a little bit	2022-10-20 15:59:52 +02:00
Tamo	e6c033bd6b	start moving a lot of task types to meilisearch_types	2022-10-20 15:59:52 +02:00
Tamo	974b40ba04	store md5 instead of the whole snapshots	2022-10-20 15:59:30 +02:00
Loïc Lecrenier	d85451b8e5	Add meili-snap crate to make writing snapshot tests easier	2022-10-20 15:59:30 +02:00
Tamo	8a32b766c6	fix all the import and comment most of the dump v6	2022-10-20 15:57:53 +02:00
Tamo	d8bbe18d71	push the document_format and settings I forgot in the previous PR	2022-10-20 15:57:53 +02:00
Tamo	f456fb5e0b	get rids of the index crate + the document_types crate	2022-10-20 15:57:52 +02:00
Loïc Lecrenier	f3ec39a769	Fix compiler errors related autobatching option of the index scheduler	2022-10-20 15:45:57 +02:00
Loïc Lecrenier	8d0ebbc9fa	Fix typo and remove useless code in tests	2022-10-20 15:45:57 +02:00
Loïc Lecrenier	5914889a29	Apply suggestions from code review ... Co-authored-by: Tamo <tamo@meilisearch.com>	2022-10-20 15:45:57 +02:00
Loïc Lecrenier	ccfe1babdc	Add more task deletion tests	2022-10-20 15:45:57 +02:00
Loïc Lecrenier	570ae05833	Use more complete snapshot tests for the index scheduler	2022-10-20 15:45:57 +02:00
Loïc Lecrenier	fd73e65165	Add a DetailsView type and improve index scheduler snapshots ... The DetailsView type is necessary because serde incorrectly deserialises the `Details` type, so the database fails to correctly decode Tasks	2022-10-20 15:45:57 +02:00
Loïc Lecrenier	05753c663f	Implement TaskDeletion in the index scheduler	2022-10-20 15:44:58 +02:00
Kerollmops	ee352b6c7c	Allow a user to disable the auto batching system	2022-10-20 15:44:58 +02:00
Kerollmops	21d6c03bb4	Add a test to check that it works without autobatching	2022-10-20 15:44:58 +02:00
Kerollmops	12c374e475	Remove the IndexScheduler::notify method	2022-10-20 15:44:58 +02:00
Kerollmops	fc148212aa	Make sure that the index-scheduler tick loop is rerun after processing	2022-10-20 15:44:58 +02:00