Kerollmops
83616bc03e
Expose a new indexer parameter to enable the creation of a document dictionary
2025-01-21 14:44:07 +01:00
Kerollmops
bbbc4410ac
Fix the dump creation process
2025-01-21 14:44:07 +01:00
Kerollmops
46dfa9f7c1
Remove unused code
2025-01-21 14:44:07 +01:00
Kerollmops
bc62cb0801
Remove span that is called too many times
2025-01-21 14:44:06 +01:00
Kerollmops
9109fbaeb0
Add more spans to debug compression
2025-01-21 14:44:06 +01:00
Kerollmops
78c9f67550
Generate the dictionary only when necessary
2025-01-21 14:44:06 +01:00
Kerollmops
523733db0a
Clean up the tests
2025-01-21 14:44:06 +01:00
Clément Renault
6d7415a25f
Remove last warning by storing rtxn and compressor on each thread
2025-01-21 14:44:05 +01:00
Clément Renault
3a32a58d6c
Remove TODO and rely on the PR checklist
2025-01-21 14:44:05 +01:00
Clément Renault
ecc7741212
Fix some issues after a rebase
2025-01-21 14:44:05 +01:00
Clément Renault
d43ddd7205
Fetch the compression dictionary only once to decompress documents
2025-01-21 14:44:05 +01:00
Clément Renault
df80aaefc9
Compress and send compressed documents to the writer
2025-01-21 14:44:04 +01:00
Clément Renault
afec94d1f3
Compress the right documents when a new dictionary is computed
2025-01-21 14:44:04 +01:00
Clément Renault
e122970570
Move the compression extractor into a dedicated module
2025-01-21 14:44:03 +01:00
Kerollmops
19b0bf7121
Allocate the decompressed documents in the extractor allocator
2025-01-21 14:44:03 +01:00
Clément Renault
beef5b5f98
Squash in a single commit and rebase
2025-01-21 14:44:03 +01:00
meili-bors[bot]
0776217801
Merge #5234
...
Test suite / Tests on ${{ matrix.os }} (macos-13) (push) Waiting to run
Run the indexing fuzzer / Setup the action (push) Failing after 15s
Test suite / Tests on ${{ matrix.os }} (windows-2022) (push) Failing after 12m54s
Indexing bench (push) / Run and upload benchmarks (push) Has been cancelled
Benchmarks of indexing (push) / Run and upload benchmarks (push) Has been cancelled
Benchmarks of search for geo (push) / Run and upload benchmarks (push) Has been cancelled
Benchmarks of search for songs (push) / Run and upload benchmarks (push) Has been cancelled
Benchmarks of search for Wikipedia articles (push) / Run and upload benchmarks (push) Has been cancelled
Look for flaky tests / flaky (push) Failing after 7s
Publish binaries to GitHub release / Check the version validity (push) Successful in 11s
Publish binaries to GitHub release / Publish binary for Linux (push) Failing after 1s
Publish binaries to GitHub release / Publish binary for aarch64 (meilisearch-linux-aarch64, aarch64-unknown-linux-gnu) (push) Failing after 15s
Publish binaries to GitHub release / Publish binary for windows-2022 (push) Failing after 24s
Publish binaries to GitHub release / Publish binary for macos-13 (push) Has been cancelled
Publish binaries to GitHub release / Publish binary for macOS silicon (meilisearch-macos-apple-silicon, aarch64-apple-darwin) (push) Has been cancelled
Test suite / Tests almost all features (push) Failing after 1s
Test suite / Test disabled tokenization (push) Failing after 2s
Test suite / Tests on ubuntu-20.04 (push) Failing after 12s
Test suite / Run tests in debug (push) Failing after 1s
Test suite / Tests on windows-2022 (push) Failing after 26s
Test suite / Run Clippy (push) Failing after 21s
Test suite / Run Rustfmt (push) Successful in 1m37s
Test suite / Tests on macos-13 (push) Has been cancelled
5234: Parse ollama URL to adapt configuration depending on the endpoint r=Kerollmops a=dureuill
# Pull Request
## Related issue
Fixes #5002
## What does this PR do?
- Parses `url` parameter of `ollama` to recognize supported endpoint and adapt the REST configuration to the recognized endpoint
- Throws a new error if no endpoint is recognized
- Add a test for the various recognized endpoints
Thanks to `@Guikingone` for the original report and PR
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2025-01-20 09:51:42 +00:00
meili-bors[bot]
c85146524b
Merge #5232
...
Run the indexing fuzzer / Setup the action (push) Successful in 1h5m2s
Test suite / Tests on ${{ matrix.os }} (macos-13) (push) Waiting to run
Look for flaky tests / flaky (push) Failing after 1s
Indexing bench (push) / Run and upload benchmarks (push) Has been cancelled
Benchmarks of indexing (push) / Run and upload benchmarks (push) Has been cancelled
Benchmarks of search for geo (push) / Run and upload benchmarks (push) Has been cancelled
Benchmarks of search for songs (push) / Run and upload benchmarks (push) Has been cancelled
Benchmarks of search for Wikipedia articles (push) / Run and upload benchmarks (push) Has been cancelled
Publish binaries to GitHub release / Publish binary for Linux (push) Has been skipped
Publish binaries to GitHub release / Publish binary for ${{ matrix.os }} (meilisearch, meilisearch-macos-amd64, macos-13) (push) Has been skipped
Publish binaries to GitHub release / Publish binary for ${{ matrix.os }} (meilisearch.exe, meilisearch-windows-amd64.exe, windows-2022) (push) Has been skipped
Publish binaries to GitHub release / Publish binary for macOS silicon (meilisearch-macos-apple-silicon, aarch64-apple-darwin) (push) Has been skipped
Publish binaries to GitHub release / Publish binary for aarch64 (meilisearch-linux-aarch64, aarch64-unknown-linux-gnu) (push) Has been skipped
Test suite / Tests almost all features (push) Failing after 2s
Test suite / Test disabled tokenization (push) Failing after 0s
Test suite / Run tests in debug (push) Failing after 1s
Test suite / Tests on ubuntu-20.04 (push) Failing after 21s
Test suite / Tests on ${{ matrix.os }} (windows-2022) (push) Failing after 24s
Test suite / Run Rustfmt (push) Failing after 17s
Test suite / Run Clippy (push) Failing after 6m47s
Publish binaries to GitHub release / Check the version validity (push) Failing after 5s
5232: Stabilize vector store feature r=Kerollmops a=dureuill
# Pull Request
## Related issue
Fixes #4733
## What does this PR do?
- `vectorStore` feature can no longer be set or get from `/experimental-features`
- That feature has been removed, and there is no longer any check for its activation
- Always display `embedders` in the settings, even if empty
- Always hide `_vectors` in documents, unless `retrieveVectors: true`
- Make error codes consistent with the usual nomenclature
- Update tests as needed
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2025-01-16 11:50:21 +00:00
Louis Dureuil
de6cd3ac01
Consistent error codes
2025-01-14 13:55:34 +01:00
Kerollmops
63c8cbae5b
Improve the panic message when deleting an unknown entry
2025-01-14 10:31:44 +01:00
Louis Dureuil
72ded27e98
Update after review
2025-01-14 10:24:50 +01:00
Louis Dureuil
4070895a21
Add support to upgrade to v1.12.3 in meilitool
2025-01-14 10:24:27 +01:00
Louis Dureuil
a21711f473
Fix test
2025-01-14 10:23:59 +01:00
Louis Dureuil
f0ec8cbffe
Add currently failing test
2025-01-14 10:23:15 +01:00
meili-bors[bot]
247eaed872
Merge #5221
...
Test suite / Tests on ${{ matrix.os }} (macos-13) (push) Waiting to run
Test suite / Tests on ${{ matrix.os }} (windows-2022) (push) Failing after 1m4s
Test suite / Tests on ubuntu-20.04 (push) Failing after 27s
Test suite / Tests almost all features (push) Has been skipped
Test suite / Test disabled tokenization (push) Has been skipped
Test suite / Run tests in debug (push) Failing after 20s
Test suite / Run Clippy (push) Successful in 8m45s
Test suite / Run Rustfmt (push) Successful in 2m31s
5221: Merge bitmaps by using `Extend::extend` r=Kerollmops a=Kerollmops
This PR tries to speed up the merging of bitmaps by using [the new `Extend::extend` implementation](https://github.com/RoaringBitmap/roaring-rs/pull/306 ).
Co-authored-by: Clément Renault <clement@meilisearch.com>
2025-01-13 13:43:28 +00:00
Louis Dureuil
8b1fcfd7f8
Parse ollama URL to adapt configuration depending on the endpoint
2025-01-13 14:34:11 +01:00
meili-bors[bot]
cc4aca78c4
Merge #5220
...
5220: Merge back changes of v1.12.2 in main r=dureuill a=dureuill
Co-authored-by: curquiza <curquiza@users.noreply.github.com>
Co-authored-by: Tamo <tamo@meilisearch.com>
Co-authored-by: dureuill <dureuill@users.noreply.github.com>
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2025-01-13 10:54:36 +00:00
Clément Renault
00a03742ff
Prefer using extend when merging bitmaps than unions (less allocations)
2025-01-09 10:42:38 +01:00
Louis Dureuil
d11e359244
When spilling on the next fid, no longer ignore children
2025-01-09 10:36:38 +01:00
Louis Dureuil
09d45439c7
Check valid_facet_value as part of a filter of the iterator
2025-01-09 10:36:38 +01:00
Louis Dureuil
5d92da0c73
No longer ignore the first child without parent
2025-01-09 10:36:38 +01:00
Louis Dureuil
677bb39e73
Modernize valid_lmdb_key
2025-01-09 10:36:38 +01:00
Louis Dureuil
85ea77de0b
Switch to an iterative algorithm for find_changed_parents
2025-01-09 10:36:38 +01:00
Louis Dureuil
03317be0bd
Update after review
2025-01-09 10:36:38 +01:00
Louis Dureuil
4aa7c8f7b1
Remove unused FacetFieldIdOperation
2025-01-09 10:36:37 +01:00
Louis Dureuil
ce57a342a3
center groups
2025-01-09 10:36:37 +01:00
Louis Dureuil
1cc6cd78e0
Fix uselessly deep stack trace
2025-01-09 10:36:37 +01:00
Louis Dureuil
c204afdc79
Update snapshot
2025-01-09 10:36:37 +01:00
Louis Dureuil
c14967eeac
Use new incremental facet indexing and enable sanity checks in debug
2025-01-09 10:36:35 +01:00
Louis Dureuil
f38db86120
Add new incremental facet indexing
2025-01-09 10:24:36 +01:00
Louis Dureuil
50b155fa2d
add valid_facet_value utility function
2025-01-09 10:24:36 +01:00
Louis Dureuil
a533c8e041
Add sanity checks for facet values
2025-01-09 10:24:36 +01:00
Tamo
908adee6fc
Fix the addition of empty payload
2025-01-09 10:24:36 +01:00
Clément Renault
71e5605daa
Make clippy happy
2025-01-08 18:24:39 +01:00
Clément Renault
0ee4671a91
Fix after upgrading candle
2025-01-08 15:59:56 +01:00
Clément Renault
68333424c6
Remove a useless script test
2025-01-08 15:59:43 +01:00
Clément Renault
5e8144b0e1
Remove fuzzing feature
2025-01-08 15:59:03 +01:00
Clément Renault
3e3695445f
Fix after upgrading thiserror
2025-01-08 15:58:32 +01:00
Clément Renault
091f989b72
Upgrade incompatible dependencies
2025-01-08 15:58:03 +01:00
Clément Renault
48a9ad4c17
Fix insta to 1.39
2025-01-08 15:18:08 +01:00
