191 Commits

Author SHA1 Message Date
Loïc Lecrenier
8d5d92f927 Fix crash when batching an index swap task containing 0 swaps 2022-10-25 10:57:03 +02:00
Irevoire
3e45fdf7c5
rename the dumpExport to dumpCreation 2022-10-24 19:08:15 +02:00
Irevoire
3f5622f749
fix the task view and forward the task db size 2022-10-23 11:23:24 +02:00
Irevoire
395766bf26
fix clippy 2022-10-22 17:17:09 +02:00
Irevoire
3a95e6291e
remove ununsed function 2022-10-22 17:05:33 +02:00
Irevoire
3283bb0454
fix clippy 2022-10-22 17:04:47 +02:00
Irevoire
e35bc48ba6 fix all the snapshots 2022-10-22 16:24:48 +02:00
Irevoire
b910e65a1d update all the snapshots with the new kind name 2022-10-22 16:24:48 +02:00
Irevoire
8bda5e0787 fix the autobatched document deletion 2022-10-22 16:07:55 +02:00
Irevoire
2387db8ab7 fix the index creation in case an index already exists 2022-10-22 16:07:55 +02:00
Irevoire
9219bec053 fix the failed document addition with a primary key 2022-10-22 16:07:55 +02:00
Irevoire
d065a3e4f0 fix the import of the dumpv4&v5 when there is no instance-uid + rename the Kind+KindWithContent+Details variant for the DocumentImport and the Setting 2022-10-22 16:07:55 +02:00
Irevoire
5bb9023722 fix the error messages and the index stats 2022-10-22 16:07:55 +02:00
Irevoire
e495e2ec9d
fix the index creation 2022-10-21 13:58:58 +02:00
Clément Renault
85d567e878
Sort the TOML dependencies 2022-10-20 18:03:35 +02:00
Clément Renault
3f6bd7fb11
Introduce a rustfmt file 2022-10-20 18:00:07 +02:00
Clément Renault
2338eff20b
Reapply #2830 2022-10-20 17:33:31 +02:00
Clément Renault
2a51161258
Fix allow_index_creation useless field 2022-10-20 16:39:25 +02:00
Clément Renault
a257904cf4
Fix the insta tests 2022-10-20 16:39:25 +02:00
Irevoire
cb3ccee401
push the snapshot files 2022-10-20 16:39:25 +02:00
Irevoire
f1acafcf1c
fix the index deletion when the index doesn’t exists but would be created by one of the autobatched tasks 2022-10-20 16:39:24 +02:00
Irevoire
f816dc5221
fix the last rule about merging the allow_index_creation 2022-10-20 16:39:24 +02:00
Irevoire
6966256a3b
simplify the code A LOT and create less false positive 2022-10-20 16:39:24 +02:00
Irevoire
1fa6193f48
add a whole new batch of tests around the index already exists / allow_index_creation 2022-10-20 16:39:24 +02:00
Irevoire
a65317982f
fix all the snapshot tests 2022-10-20 16:39:24 +02:00
Irevoire
3357c439e3
it probably works but it's also horrendous 2022-10-20 16:39:23 +02:00
Loïc Lecrenier
8514c1c12b
Apply review suggestions and stop using rtxn.commit 2022-10-20 16:39:23 +02:00
Loïc Lecrenier
14a44776f6
Implement POST /indexes-swap 2022-10-20 16:39:23 +02:00
Loïc Lecrenier
bdb3702510
Remove key from index_tasks database when the value is empty 2022-10-20 16:39:23 +02:00
Loïc Lecrenier
835745ac22
Add some documentation to the index scheduler 2022-10-20 16:39:22 +02:00
Loïc Lecrenier
50d48df636
Fix bug where assert used != instead of ==
And update snapshot tests.
2022-10-20 16:39:22 +02:00
Loïc Lecrenier
ffd5cb5ad3
cargo fmt 2022-10-20 16:39:22 +02:00
Loïc Lecrenier
5205c7dcc7
Fix date parsing for task queries
Use rfc3339 or YYYY-MM-DD.

Add a day to the parsed date when it is an excluded lower bound
and the YYYY-MM-DD was used.

Also the Query type does not need to be serialisable anymore
2022-10-20 16:39:22 +02:00
Loïc Lecrenier
af508b9a81
Apply suggestions from code review
Co-authored-by: Clément Renault <clement@meilisearch.com>

Apply suggestions from code review

Co-authored-by: Clément Renault <clement@meilisearch.com>
Co-authored-by: Tamo <tamo@meilisearch.com>

Apply suggestions from code review

Co-authored-by: Clément Renault <clement@meilisearch.com>
Co-authored-by: Tamo <tamo@meilisearch.com>

Apply code review suggestion

Co-authored-by: Clément Renault <clement@meilisearch.com>
2022-10-20 16:39:22 +02:00
Loïc Lecrenier
1eeef1c1c8
Implement task date filters
before/after enqueued/started/finished at
2022-10-20 16:39:21 +02:00
Irevoire
f3c2be1eb5
fix the auto-generated details 2022-10-20 16:37:29 +02:00
Tamo
aa13fc448d
remove the unused variants from the autobatcher 2022-10-20 16:37:29 +02:00
Tamo
3702249b1a
fix a bunch of snapshot tests 2022-10-20 16:37:29 +02:00
Kerollmops
188e95d00f
Delete the tasks content file once the transaction has been successfully committed 2022-10-20 16:37:28 +02:00
Kerollmops
ad05bd9156
Remove the useless r#union thing 2022-10-20 16:37:28 +02:00
Kerollmops
ea0dcf2c7c
Clean up the delete_persisted_task_data function 2022-10-20 16:37:28 +02:00
Kerollmops
0bbda61169
Throw the error if we can't register the tasks in the store 2022-10-20 16:37:28 +02:00
Kerollmops
9945f984db
Introduce a ProcessingTasks constructor 2022-10-20 16:37:27 +02:00
Kerollmops
fd73306793
Extract the must_stop flag out of the RwLock 2022-10-20 16:37:27 +02:00
Kerollmops
07db4cfab0
Prefer using an u64 instead of a usize in some places 2022-10-20 16:37:27 +02:00
Kerollmops
cc6e2fd1e8
Delete the persisted data when we cancel a task 2022-10-20 16:37:27 +02:00
Kerollmops
afafe8d207
Put the original URL query in the tasks details 2022-10-20 16:37:26 +02:00
Kerollmops
973e2f71eb
Add the tasks cancel route to cancel tasks 2022-10-20 16:37:26 +02:00
Kerollmops
01ed1fb128
Update the canceledBy and finishedAt fields 2022-10-20 16:37:26 +02:00
Kerollmops
74657bba2c
Introduce the core algorithm of task cancelation 2022-10-20 16:37:26 +02:00