Commit Graph

111 Commits

Author SHA1 Message Date
Kerollmops
1c697edb95
Add a test to check different indexes autobatching 2022-10-20 16:00:58 +02:00
Kerollmops
8433a432b1
Extract index creation rights and simplify the autobatcher rules 2022-10-20 16:00:58 +02:00
Kerollmops
ea192d31f4
Fix invalid import of tasks types 2022-10-20 16:00:58 +02:00
Tamo
dc1d739785
move the API key in meilisearch_types 2022-10-20 16:00:58 +02:00
Tamo
c9050759f5
remove an unused file 2022-10-20 15:59:53 +02:00
Tamo
e533e740d4
refactor the Task a little bit 2022-10-20 15:59:52 +02:00
Tamo
e6c033bd6b
start moving a lot of task types to meilisearch_types 2022-10-20 15:59:52 +02:00
Tamo
8a32b766c6
fix all the import and comment most of the dump v6 2022-10-20 15:57:53 +02:00
Tamo
f456fb5e0b
get rids of the index crate + the document_types crate 2022-10-20 15:57:52 +02:00
Loïc Lecrenier
f3ec39a769
Fix compiler errors related autobatching option of the index scheduler 2022-10-20 15:45:57 +02:00
Loïc Lecrenier
8d0ebbc9fa
Fix typo and remove useless code in tests 2022-10-20 15:45:57 +02:00
Loïc Lecrenier
5914889a29
Apply suggestions from code review
Co-authored-by: Tamo <tamo@meilisearch.com>
2022-10-20 15:45:57 +02:00
Loïc Lecrenier
ccfe1babdc
Add more task deletion tests 2022-10-20 15:45:57 +02:00
Loïc Lecrenier
570ae05833
Use more complete snapshot tests for the index scheduler 2022-10-20 15:45:57 +02:00
Loïc Lecrenier
fd73e65165
Add a DetailsView type and improve index scheduler snapshots
The DetailsView type is necessary because serde incorrectly
deserialises the `Details` type, so the database fails to correctly
decode Tasks
2022-10-20 15:45:57 +02:00
Loïc Lecrenier
05753c663f
Implement TaskDeletion in the index scheduler 2022-10-20 15:44:58 +02:00
Kerollmops
ee352b6c7c
Allow a user to disable the auto batching system 2022-10-20 15:44:58 +02:00
Kerollmops
21d6c03bb4
Add a test to check that it works without autobatching 2022-10-20 15:44:58 +02:00
Kerollmops
12c374e475
Remove the IndexScheduler::notify method 2022-10-20 15:44:58 +02:00
Kerollmops
fc148212aa
Make sure that the index-scheduler tick loop is rerun after processing 2022-10-20 15:44:58 +02:00
Kerollmops
67e8ee6ef7
Add a test that verifies that sending multiple tasks works 2022-10-20 15:44:57 +02:00
Tamo
4958bf3a55
start writting the compat layer between v5 and v6 2022-10-20 15:44:52 +02:00
Tamo
b5ebab5c66
fix the tests 2022-10-20 15:44:51 +02:00
Clément Renault
a358eaa816
Create the index only if the task has the rights to do so 2022-10-20 15:44:35 +02:00
Clément Renault
134634d99a
Correctly batch tasks with different index creation rights 2022-10-20 15:44:35 +02:00
Clément Renault
cea19f5af1
Use a ControlFlow in the autobatcher function 2022-10-20 15:44:34 +02:00
Kerollmops
2a45d24143
IndexDeletion operation have ClearAll details 2022-10-20 15:44:34 +02:00
Kerollmops
be192f281d
Only mark the first clear document with the amount of cleared documents 2022-10-20 15:44:34 +02:00
Kerollmops
99d1e9a870
Let the tick function set the Failed status itself 2022-10-20 15:44:34 +02:00
Kerollmops
945cb00fc3
Fill an IndexDeletion task with the number of documents removed 2022-10-20 15:44:34 +02:00
Kerollmops
b7ad050737
Panic if we encountered a wring KindWithContent type 2022-10-20 15:44:34 +02:00
Kerollmops
f3f6bbf624
Update the tasks statuses 2022-10-20 15:44:33 +02:00
Kerollmops
88a0ed9736
Implement the IndexDeletion batch operation 2022-10-20 15:44:33 +02:00
Kerollmops
4a53cb1c50
Implement the IndexUpdate batch operation 2022-10-20 15:44:33 +02:00
Kerollmops
617994a9d7
Implement the IndexCreate batch operation 2022-10-20 15:44:33 +02:00
Kerollmops
4871509507
Make sure that meilisearch-http works without index wrapper 2022-10-20 15:44:33 +02:00
Kerollmops
478e3f0f6b
Remove the Index wrapper and use milli::Index directly 2022-10-20 15:43:03 +02:00
Kerollmops
8bffe41886
Remove the IndexRename operation 2022-10-20 15:43:02 +02:00
Kerollmops
257651c615
Move the IndexScheduler to the root of the index-scheduler crate 2022-10-20 15:43:02 +02:00
Kerollmops
78e730ca37
Add a TODO about the index creation 2022-10-20 15:43:02 +02:00
Kerollmops
373995dca9
Make clippy happy 2022-10-20 15:43:02 +02:00
Kerollmops
3fda1942c0
Implement a recursive indexation for the index-related operations 2022-10-20 15:43:02 +02:00
Kerollmops
e7ca5efe1e
Implement the SettingsAndDocumentImport batch operation 2022-10-20 15:43:01 +02:00
Kerollmops
e24715abe5
Merge both DocumentAddition/Update into one DocumentImport variant 2022-10-20 15:43:01 +02:00
Kerollmops
9e1d7fbfe5
Implement the DocumentClear batch operation 2022-10-20 15:43:01 +02:00
Kerollmops
eb8dda1f81
Implement the DocumentClearAndSettings batch operation 2022-10-20 15:43:01 +02:00
Kerollmops
ad0d285f12
Implement the Settings batch operation 2022-10-20 15:43:01 +02:00
Kerollmops
e84119fc75
Implement the DocumentUpdate batch operation 2022-10-20 15:43:01 +02:00
Kerollmops
78922a7c67
Implement the DocumentDeletion batch operation 2022-10-20 15:43:00 +02:00
Tamo
5cd1fc0b7b
remove an old unworking part of the batch execution 2022-10-20 15:42:45 +02:00