64 Commits

Author	SHA1	Message	Date
Loïc Lecrenier	baeb168b6e	Delete a task's persisted data when appropriate	2022-10-20 16:34:32 +02:00
Tamo	0bde0abd74	share the rtxn between the access to the tasks and to the indexes	2022-10-20 16:14:37 +02:00
Tamo	8e469d8d1d	flush the dump-writer only once everything has been inserted	2022-10-20 16:14:36 +02:00
Tamo	b87b071718	apply most style comments of the review	2022-10-20 16:14:36 +02:00
Tamo	8c9b758fa8	stop dumping the current dumping task as enqueued so it's not looping for ever	2022-10-20 16:13:17 +02:00
Tamo	cac924b663	first mostly working version	2022-10-20 16:13:16 +02:00
Tamo	6fae317277	update the API a little bit	2022-10-20 16:12:26 +02:00
Tamo	1a3fea4d8c	fix the tests	2022-10-20 16:12:26 +02:00
Tamo	9323f9f1c4	write the dump export	2022-10-20 16:12:25 +02:00
Loïc Lecrenier	7ce336306d	Fix number of deleted tasks details after duplicate task deletion	2022-10-20 16:09:33 +02:00
Loïc Lecrenier	d49d7e9c2d	Add task deletion tests where the same task is deleted twice	2022-10-20 16:09:33 +02:00
Loïc Lecrenier	9067148270	Apply suggested changes from PR review	2022-10-20 16:09:32 +02:00
Loïc Lecrenier	012c3e986c	Finish first draft of the DELETE /tasks route	2022-10-20 16:09:32 +02:00
Loïc Lecrenier	ef3e9e87f5	Continue implementation of task deletion ... 1. Matched tasks are a roaring bitmap 2. Start implementation in meilisearch-http 3. Snapshots use meili-snap 4. Rename to TaskDeletion	2022-10-20 16:08:16 +02:00
Kerollmops	7d4527728e	Make sure that we do not batch tasks from different indexes	2022-10-20 16:00:58 +02:00
Tamo	e533e740d4	refactor the Task a little bit	2022-10-20 15:59:52 +02:00
Tamo	e6c033bd6b	start moving a lot of task types to meilisearch_types	2022-10-20 15:59:52 +02:00
Tamo	f456fb5e0b	get rids of the index crate + the document_types crate	2022-10-20 15:57:52 +02:00
Loïc Lecrenier	5914889a29	Apply suggestions from code review ... Co-authored-by: Tamo <tamo@meilisearch.com>	2022-10-20 15:45:57 +02:00
Loïc Lecrenier	fd73e65165	Add a DetailsView type and improve index scheduler snapshots ... The DetailsView type is necessary because serde incorrectly deserialises the `Details` type, so the database fails to correctly decode Tasks	2022-10-20 15:45:57 +02:00
Loïc Lecrenier	05753c663f	Implement TaskDeletion in the index scheduler	2022-10-20 15:44:58 +02:00
Kerollmops	ee352b6c7c	Allow a user to disable the auto batching system	2022-10-20 15:44:58 +02:00
Clément Renault	a358eaa816	Create the index only if the task has the rights to do so	2022-10-20 15:44:35 +02:00
Clément Renault	134634d99a	Correctly batch tasks with different index creation rights	2022-10-20 15:44:35 +02:00
Kerollmops	be192f281d	Only mark the first clear document with the amount of cleared documents	2022-10-20 15:44:34 +02:00
Kerollmops	99d1e9a870	Let the tick function set the Failed status itself	2022-10-20 15:44:34 +02:00
Kerollmops	945cb00fc3	Fill an IndexDeletion task with the number of documents removed	2022-10-20 15:44:34 +02:00
Kerollmops	b7ad050737	Panic if we encountered a wring KindWithContent type	2022-10-20 15:44:34 +02:00
Kerollmops	f3f6bbf624	Update the tasks statuses	2022-10-20 15:44:33 +02:00
Kerollmops	88a0ed9736	Implement the IndexDeletion batch operation	2022-10-20 15:44:33 +02:00
Kerollmops	4a53cb1c50	Implement the IndexUpdate batch operation	2022-10-20 15:44:33 +02:00
Kerollmops	617994a9d7	Implement the IndexCreate batch operation	2022-10-20 15:44:33 +02:00
Kerollmops	8bffe41886	Remove the IndexRename operation	2022-10-20 15:43:02 +02:00
Kerollmops	78e730ca37	Add a TODO about the index creation	2022-10-20 15:43:02 +02:00
Kerollmops	373995dca9	Make clippy happy	2022-10-20 15:43:02 +02:00
Kerollmops	3fda1942c0	Implement a recursive indexation for the index-related operations	2022-10-20 15:43:02 +02:00
Kerollmops	e7ca5efe1e	Implement the SettingsAndDocumentImport batch operation	2022-10-20 15:43:01 +02:00
Kerollmops	e24715abe5	Merge both DocumentAddition/Update into one DocumentImport variant	2022-10-20 15:43:01 +02:00
Kerollmops	9e1d7fbfe5	Implement the DocumentClear batch operation	2022-10-20 15:43:01 +02:00
Kerollmops	eb8dda1f81	Implement the DocumentClearAndSettings batch operation	2022-10-20 15:43:01 +02:00
Kerollmops	ad0d285f12	Implement the Settings batch operation	2022-10-20 15:43:01 +02:00
Kerollmops	e84119fc75	Implement the DocumentUpdate batch operation	2022-10-20 15:43:01 +02:00
Kerollmops	78922a7c67	Implement the DocumentDeletion batch operation	2022-10-20 15:43:00 +02:00
Tamo	5cd1fc0b7b	remove an old unworking part of the batch execution	2022-10-20 15:42:45 +02:00
Tamo	2d31cff082	get rids of meilisearch-lib	2022-10-20 15:42:44 +02:00
Tamo	2de8f08517	fix a deadlock	2022-10-20 15:36:10 +02:00
Irevoire	60ee1f5e64	wip integrating the scheduler in meilisearch-http	2022-10-20 15:34:55 +02:00
Irevoire	16eab7b337	I can index documents without meilisearch	2022-10-20 15:30:20 +02:00
Tamo	7bbd75e1fb	wip	2022-10-20 15:29:48 +02:00
Tamo	a4bf859779	create the end Batch type for all Index* operations	2022-10-20 15:29:48 +02:00