4271 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Loïc Lecrenier	835745ac22	Add some documentation to the index scheduler	2022-10-20 16:39:22 +02:00
Irevoire	2f54dade04	fix all the snapshot tests in the dump	2022-10-20 16:39:22 +02:00
Loïc Lecrenier	50d48df636	Fix bug where assert used != instead of == ... And update snapshot tests.	2022-10-20 16:39:22 +02:00
Loïc Lecrenier	ffd5cb5ad3	cargo fmt	2022-10-20 16:39:22 +02:00
Loïc Lecrenier	5205c7dcc7	Fix date parsing for task queries ... Use rfc3339 or YYYY-MM-DD. Add a day to the parsed date when it is an excluded lower bound and the YYYY-MM-DD was used. Also the Query type does not need to be serialisable anymore	2022-10-20 16:39:22 +02:00
Loïc Lecrenier	af508b9a81	Apply suggestions from code review ... Co-authored-by: Clément Renault <clement@meilisearch.com> Apply suggestions from code review Co-authored-by: Clément Renault <clement@meilisearch.com> Co-authored-by: Tamo <tamo@meilisearch.com> Apply suggestions from code review Co-authored-by: Clément Renault <clement@meilisearch.com> Co-authored-by: Tamo <tamo@meilisearch.com> Apply code review suggestion Co-authored-by: Clément Renault <clement@meilisearch.com>	2022-10-20 16:39:22 +02:00
Loïc Lecrenier	1eeef1c1c8	Implement task date filters ... before/after enqueued/started/finished at	2022-10-20 16:39:21 +02:00
Irevoire	f3c2be1eb5	fix the auto-generated details	2022-10-20 16:37:29 +02:00
Tamo	aa13fc448d	remove the unused variants from the autobatcher	2022-10-20 16:37:29 +02:00
Tamo	3702249b1a	fix a bunch of snapshot tests	2022-10-20 16:37:29 +02:00
Tamo	49b14064c2	fix the dumps tests since we added informations in the DumpTask	2022-10-20 16:37:28 +02:00
Kerollmops	188e95d00f	Delete the tasks content file once the transaction has been successfully committed	2022-10-20 16:37:28 +02:00
Kerollmops	ad05bd9156	Remove the useless r#union thing	2022-10-20 16:37:28 +02:00
Kerollmops	ea0dcf2c7c	Clean up the delete_persisted_task_data function	2022-10-20 16:37:28 +02:00
Kerollmops	0bbda61169	Throw the error if we can't register the tasks in the store	2022-10-20 16:37:28 +02:00
Kerollmops	9945f984db	Introduce a ProcessingTasks constructor	2022-10-20 16:37:27 +02:00
Kerollmops	fd73306793	Extract the must_stop flag out of the RwLock	2022-10-20 16:37:27 +02:00
Kerollmops	07db4cfab0	Prefer using an u64 instead of a usize in some places	2022-10-20 16:37:27 +02:00
Kerollmops	cc6e2fd1e8	Delete the persisted data when we cancel a task	2022-10-20 16:37:27 +02:00
Kerollmops	4f1c0535b4	Use a tokio block_in_place method for potentially blocking tasks	2022-10-20 16:37:27 +02:00
Kerollmops	afafe8d207	Put the original URL query in the tasks details	2022-10-20 16:37:26 +02:00
Kerollmops	973e2f71eb	Add the tasks cancel route to cancel tasks	2022-10-20 16:37:26 +02:00
Kerollmops	01ed1fb128	Update the canceledBy and finishedAt fields	2022-10-20 16:37:26 +02:00
Kerollmops	74657bba2c	Introduce the core algorithm of task cancelation	2022-10-20 16:37:26 +02:00
Kerollmops	6276b2a382	Add more enum-iterator related stuff	2022-10-20 16:37:26 +02:00
Kerollmops	607a0600e5	Prefer using TaskDeletion in the dumps	2022-10-20 16:35:06 +02:00
Kerollmops	bcb7d1744a	Introduce the task cancelation task type	2022-10-20 16:35:06 +02:00
Kerollmops	4a7b5c7836	Add the canceled task status	2022-10-20 16:35:05 +02:00
Kerollmops	b8803781dc	Introduce the ProcessingTasks struct	2022-10-20 16:35:05 +02:00
Kerollmops	47168c613d	Use the indexation-abortion milli's branch	2022-10-20 16:35:05 +02:00
Kerollmops	e7047e8377	Remove the meilisearch-auth milli dependency	2022-10-20 16:34:33 +02:00
Loïc Lecrenier	baeb168b6e	Delete a task's persisted data when appropriate	2022-10-20 16:34:32 +02:00
Tamo	7308ccd530	make the tests compile again	2022-10-20 16:34:32 +02:00
Tamo	656f809b1d	fix the analytics	2022-10-20 16:26:17 +02:00
Tamo	65e69c06bc	extract the create_app function for the tests	2022-10-20 16:26:17 +02:00
Tamo	aff67f78c1	bump enum-iter and fix a bunch of error messages	2022-10-20 16:24:23 +02:00
Tamo	4921e926e5	fix meilisearch-http	2022-10-20 16:14:37 +02:00
Tamo	99f1d5df20	fix the tests	2022-10-20 16:14:37 +02:00
Tamo	0bde0abd74	share the rtxn between the access to the tasks and to the indexes	2022-10-20 16:14:37 +02:00
Tamo	dbcc3456c6	dump the content of the dump tasks instead of recreating at import time with wrong API keys	2022-10-20 16:14:36 +02:00
Tamo	09a0569228	remove useless todo	2022-10-20 16:14:36 +02:00
Tamo	860d343831	get rids of the useless Seek before creating a grenad reader	2022-10-20 16:14:36 +02:00
Tamo	8e469d8d1d	flush the dump-writer only once everything has been inserted	2022-10-20 16:14:36 +02:00
Tamo	b87b071718	apply most style comments of the review	2022-10-20 16:14:36 +02:00
Tamo	e220cc2183	Update dump/src/error.rs ... Co-authored-by: Clément Renault <clement@meilisearch.com>	2022-10-20 16:14:36 +02:00
Tamo	458a531547	rebase on index-scheduler	2022-10-20 16:14:35 +02:00
Tamo	6987bc185e	fix a synchronization bug while importing tasks	2022-10-20 16:13:18 +02:00
Tamo	a2384dc627	fix all the errors code and settings issues when importing a dump v2	2022-10-20 16:13:18 +02:00
Tamo	bab0e050f1	fix all the error codes	2022-10-20 16:13:18 +02:00
Tamo	748249578d	commit after creating an index	2022-10-20 16:13:17 +02:00