Commit Graph

4207 Commits

Author SHA1 Message Date
Loïc Lecrenier
4bd8607cf9
Avoid creating two read txn at the same time 2022-10-20 16:09:32 +02:00
Loïc Lecrenier
4c6145f782
Update snapshot tests following git rebase that fixes a bug 2022-10-20 16:09:32 +02:00
Loïc Lecrenier
012c3e986c
Finish first draft of the DELETE /tasks route 2022-10-20 16:09:32 +02:00
Loïc Lecrenier
ef3e9e87f5
Continue implementation of task deletion
1. Matched tasks are a roaring bitmap
2. Start implementation in meilisearch-http
3. Snapshots use meili-snap
4. Rename to TaskDeletion
2022-10-20 16:08:16 +02:00
Kerollmops
7d4527728e
Make sure that we do not batch tasks from different indexes 2022-10-20 16:00:58 +02:00
Kerollmops
1c697edb95
Add a test to check different indexes autobatching 2022-10-20 16:00:58 +02:00
Kerollmops
8433a432b1
Extract index creation rights and simplify the autobatcher rules 2022-10-20 16:00:58 +02:00
Kerollmops
ea192d31f4
Fix invalid import of tasks types 2022-10-20 16:00:58 +02:00
Tamo
dc1d739785
move the API key in meilisearch_types 2022-10-20 16:00:58 +02:00
Tamo
c9050759f5
remove an unused file 2022-10-20 15:59:53 +02:00
Tamo
c0a6f7a021
uncomment a task serialization test 2022-10-20 15:59:53 +02:00
Tamo
e533e740d4
refactor the Task a little bit 2022-10-20 15:59:52 +02:00
Tamo
e6c033bd6b
start moving a lot of task types to meilisearch_types 2022-10-20 15:59:52 +02:00
Tamo
974b40ba04
store md5 instead of the whole snapshots 2022-10-20 15:59:30 +02:00
Loïc Lecrenier
d85451b8e5
Add meili-snap crate to make writing snapshot tests easier 2022-10-20 15:59:30 +02:00
Tamo
8a32b766c6
fix all the import and comment most of the dump v6 2022-10-20 15:57:53 +02:00
Tamo
d8bbe18d71
push the document_format and settings I forgot in the previous PR 2022-10-20 15:57:53 +02:00
Tamo
f456fb5e0b
get rids of the index crate + the document_types crate 2022-10-20 15:57:52 +02:00
Loïc Lecrenier
f3ec39a769
Fix compiler errors related autobatching option of the index scheduler 2022-10-20 15:45:57 +02:00
Loïc Lecrenier
8d0ebbc9fa
Fix typo and remove useless code in tests 2022-10-20 15:45:57 +02:00
Loïc Lecrenier
5914889a29
Apply suggestions from code review
Co-authored-by: Tamo <tamo@meilisearch.com>
2022-10-20 15:45:57 +02:00
Loïc Lecrenier
ccfe1babdc
Add more task deletion tests 2022-10-20 15:45:57 +02:00
Loïc Lecrenier
570ae05833
Use more complete snapshot tests for the index scheduler 2022-10-20 15:45:57 +02:00
Loïc Lecrenier
fd73e65165
Add a DetailsView type and improve index scheduler snapshots
The DetailsView type is necessary because serde incorrectly
deserialises the `Details` type, so the database fails to correctly
decode Tasks
2022-10-20 15:45:57 +02:00
Loïc Lecrenier
05753c663f
Implement TaskDeletion in the index scheduler 2022-10-20 15:44:58 +02:00
Kerollmops
ee352b6c7c
Allow a user to disable the auto batching system 2022-10-20 15:44:58 +02:00
Kerollmops
21d6c03bb4
Add a test to check that it works without autobatching 2022-10-20 15:44:58 +02:00
Kerollmops
12c374e475
Remove the IndexScheduler::notify method 2022-10-20 15:44:58 +02:00
Kerollmops
fc148212aa
Make sure that the index-scheduler tick loop is rerun after processing 2022-10-20 15:44:58 +02:00
Kerollmops
67e8ee6ef7
Add a test that verifies that sending multiple tasks works 2022-10-20 15:44:57 +02:00
Tamo
4777449cc3
remove unused files 2022-10-20 15:44:57 +02:00
Tamo
baa67fade2
fix the tests 2022-10-20 15:44:57 +02:00
Tamo
997e7450d4
write a bunch of tests that goes through the whole compat layers 2022-10-20 15:44:57 +02:00
Tamo
bd509f3593
remove the warnings 2022-10-20 15:44:57 +02:00
Tamo
704b9566e4
rewrite the update file API 2022-10-20 15:44:56 +02:00
Tamo
d8ac2a0063
finish the dump reader API, the dump Writer API now needs to be updated 2022-10-20 15:44:56 +02:00
Tamo
2db486ad90
start dumping the update files to a known format 2022-10-20 15:44:56 +02:00
Tamo
170af0c9bd
fix the compat between v3 and v4 2022-10-20 15:44:56 +02:00
Tamo
392e2829f8
remove the ununsed snapshot files 2022-10-20 15:44:56 +02:00
Tamo
50dfe06efe
remove all warnings 2022-10-20 15:44:55 +02:00
Tamo
1a20ef2a79
write the compat layer from v2 to v3 2022-10-20 15:44:55 +02:00
Tamo
0c8e690675
remove old compat files 2022-10-20 15:44:55 +02:00
Tamo
70e3308e8c
write the dump v2 import 2022-10-20 15:44:55 +02:00
Tamo
2a7a6f9a30
make the open function public 2022-10-20 15:44:55 +02:00
Tamo
fe973b8a98
fix some warnings 2022-10-20 15:44:54 +02:00
Tamo
993011a5b6
rebase on main 2022-10-20 15:44:54 +02:00
Tamo
5b8041c4fe
write and test the compat layer from v3 to v4 2022-10-20 15:44:54 +02:00
Tamo
1d4f27d65f
write and test the dump v3 import 2022-10-20 15:44:54 +02:00
Tamo
826f7633de
fix the test once again 2022-10-20 15:44:54 +02:00
Tamo
34a3ba6aa2
finish the test for the compatibility between v4 and v5 2022-10-20 15:44:53 +02:00