5246: Fix dump import r=Kerollmops a=dureuill
- Fix: handle the change of format of the update files
- Correctly handle update files as JSON stream rather than obkv when exporting a dump with enqueued tasks
- Correctly recreate update files as JSON stream rather than obkv when importing a dump
- As the dump format itself didn't change, all dumps are still compatible
- Temporary workaround for https://github.com/meilisearch/meilisearch/issues/5247: set the batch uid of tasks to `null` at dump export time.
- Changes to meilitool
- Export dump with update files in new format if DB >= v1.12
- offline upgrade now supports upgrading from [1.9.0-1.12.5] to [1.10.0-1.12.5].
- offline upgrade supports no-op upgrades and has better error messages
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
Co-authored-by: ManyTheFish <many@meilisearch.com>
5252: Update version for the next release (v1.12.5) in Cargo.toml r=dureuill a=meili-bot
⚠️ This PR is automatically generated. Check the new version is the expected one and Cargo.lock has been updated before merging.
Co-authored-by: dureuill <dureuill@users.noreply.github.com>
5242: Fix infinite loop r=Kerollmops a=dureuill
- Fix possible infinite loop by releasing `writer_receiver` as soon as writing to DB panics
- Demote panic to error log
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
5243: Update version for the next release (v1.12.4) in Cargo.toml r=dureuill a=meili-bot
⚠️ This PR is automatically generated. Check the new version is the expected one and Cargo.lock has been updated before merging.
Co-authored-by: dureuill <dureuill@users.noreply.github.com>
5227: Update version for the next release (v1.12.3) in Cargo.toml r=dureuill a=meili-bot
⚠️ This PR is automatically generated. Check the new version is the expected one and Cargo.lock has been updated before merging.
Co-authored-by: dureuill <dureuill@users.noreply.github.com>
5205: Incremental facets on v1.12 r=curquiza a=dureuill
# Pull Request
## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/5213
## What does this PR do?
- Add `new_incremental`module that computes incremental facet indexing for the new indexer
- Change heuristics for incremental vs bulk facet choice: under 1000 operations is now always incremental, over 100_000 operations is now always bulk)
- Add sanity checks in debug
## Future improvements
- Use multi ops from Roaring to decrease the number of allocations
- Consider removing or adding multiple levels at once instead of max once per update
- Consider using information about the tree structure + the operations that were done (e.g. only addition) to avoid recomputing the group from all children
- Consider making the algorithm parallel and looking into the roaring values to know which actually changed
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
5207: Update version for the next release (v1.12.2) in Cargo.toml r=dureuill a=meili-bot
⚠️ This PR is automatically generated. Check the new version is the expected one and Cargo.lock has been updated before merging.
Co-authored-by: dureuill <dureuill@users.noreply.github.com>