Commit Graph

4252 Commits

Author SHA1 Message Date
Kerollmops
4f1c0535b4
Use a tokio block_in_place method for potentially blocking tasks 2022-10-20 16:37:27 +02:00
Kerollmops
afafe8d207
Put the original URL query in the tasks details 2022-10-20 16:37:26 +02:00
Kerollmops
973e2f71eb
Add the tasks cancel route to cancel tasks 2022-10-20 16:37:26 +02:00
Kerollmops
01ed1fb128
Update the canceledBy and finishedAt fields 2022-10-20 16:37:26 +02:00
Kerollmops
74657bba2c
Introduce the core algorithm of task cancelation 2022-10-20 16:37:26 +02:00
Kerollmops
6276b2a382
Add more enum-iterator related stuff 2022-10-20 16:37:26 +02:00
Kerollmops
607a0600e5
Prefer using TaskDeletion in the dumps 2022-10-20 16:35:06 +02:00
Kerollmops
bcb7d1744a
Introduce the task cancelation task type 2022-10-20 16:35:06 +02:00
Kerollmops
4a7b5c7836
Add the canceled task status 2022-10-20 16:35:05 +02:00
Kerollmops
b8803781dc
Introduce the ProcessingTasks struct 2022-10-20 16:35:05 +02:00
Kerollmops
47168c613d
Use the indexation-abortion milli's branch 2022-10-20 16:35:05 +02:00
Kerollmops
e7047e8377
Remove the meilisearch-auth milli dependency 2022-10-20 16:34:33 +02:00
Loïc Lecrenier
baeb168b6e
Delete a task's persisted data when appropriate 2022-10-20 16:34:32 +02:00
Tamo
7308ccd530
make the tests compile again 2022-10-20 16:34:32 +02:00
Tamo
656f809b1d
fix the analytics 2022-10-20 16:26:17 +02:00
Tamo
65e69c06bc
extract the create_app function for the tests 2022-10-20 16:26:17 +02:00
Tamo
aff67f78c1
bump enum-iter and fix a bunch of error messages 2022-10-20 16:24:23 +02:00
Tamo
4921e926e5
fix meilisearch-http 2022-10-20 16:14:37 +02:00
Tamo
99f1d5df20
fix the tests 2022-10-20 16:14:37 +02:00
Tamo
0bde0abd74
share the rtxn between the access to the tasks and to the indexes 2022-10-20 16:14:37 +02:00
Tamo
dbcc3456c6
dump the content of the dump tasks instead of recreating at import time with wrong API keys 2022-10-20 16:14:36 +02:00
Tamo
09a0569228
remove useless todo 2022-10-20 16:14:36 +02:00
Tamo
860d343831
get rids of the useless Seek before creating a grenad reader 2022-10-20 16:14:36 +02:00
Tamo
8e469d8d1d
flush the dump-writer only once everything has been inserted 2022-10-20 16:14:36 +02:00
Tamo
b87b071718
apply most style comments of the review 2022-10-20 16:14:36 +02:00
Tamo
e220cc2183
Update dump/src/error.rs
Co-authored-by: Clément Renault <clement@meilisearch.com>
2022-10-20 16:14:36 +02:00
Tamo
458a531547
rebase on index-scheduler 2022-10-20 16:14:35 +02:00
Tamo
6987bc185e
fix a synchronization bug while importing tasks 2022-10-20 16:13:18 +02:00
Tamo
a2384dc627
fix all the errors code and settings issues when importing a dump v2 2022-10-20 16:13:18 +02:00
Tamo
bab0e050f1
fix all the error codes 2022-10-20 16:13:18 +02:00
Tamo
748249578d
commit after creating an index 2022-10-20 16:13:17 +02:00
Tamo
54d4d364c2
fix the deletion of the data.ms in case of errors 2022-10-20 16:13:17 +02:00
Tamo
9b96085327
the index-scheduler needs to wake-up after importing a dump 2022-10-20 16:13:17 +02:00
Tamo
4c1c108a19
remove the dbg 2022-10-20 16:13:17 +02:00
Tamo
c82bd429db
fix the content_file import 2022-10-20 16:13:17 +02:00
Tamo
8c9b758fa8
stop dumping the current dumping task as enqueued so it's not looping for ever 2022-10-20 16:13:17 +02:00
Tamo
ede46b716c
add a bufwriter on the documents 2022-10-20 16:13:16 +02:00
Tamo
cac924b663
first mostly working version 2022-10-20 16:13:16 +02:00
Tamo
6fae317277
update the API a little bit 2022-10-20 16:12:26 +02:00
Tamo
1a3fea4d8c
fix the tests 2022-10-20 16:12:26 +02:00
Tamo
9323f9f1c4
write the dump export 2022-10-20 16:12:25 +02:00
Loïc Lecrenier
7ce336306d
Fix number of deleted tasks details after duplicate task deletion 2022-10-20 16:09:33 +02:00
Loïc Lecrenier
d49d7e9c2d
Add task deletion tests where the same task is deleted twice 2022-10-20 16:09:33 +02:00
Loïc Lecrenier
dabc30d3d6
Return an error when calling DELETE /tasks with an empty query 2022-10-20 16:09:32 +02:00
Loïc Lecrenier
9067148270
Apply suggested changes from PR review 2022-10-20 16:09:32 +02:00
Loïc Lecrenier
4bd8607cf9
Avoid creating two read txn at the same time 2022-10-20 16:09:32 +02:00
Loïc Lecrenier
4c6145f782
Update snapshot tests following git rebase that fixes a bug 2022-10-20 16:09:32 +02:00
Loïc Lecrenier
012c3e986c
Finish first draft of the DELETE /tasks route 2022-10-20 16:09:32 +02:00
Loïc Lecrenier
ef3e9e87f5
Continue implementation of task deletion
1. Matched tasks are a roaring bitmap
2. Start implementation in meilisearch-http
3. Snapshots use meili-snap
4. Rename to TaskDeletion
2022-10-20 16:08:16 +02:00
Kerollmops
7d4527728e
Make sure that we do not batch tasks from different indexes 2022-10-20 16:00:58 +02:00