snowykami/meilisearch
1
0
Fork 0
mirror of https://github.com/meilisearch/meilisearch.git synced 2024-11-23 10:37:41 +08:00
Code Issues Actions 8 Packages Projects Releases Wiki Activity
aed8c69bcb
meilisearch/milli
History
Loïc Lecrenier aed8c69bcb Refactor indexation of the "facet-id-exists-docids" database 
The idea is to directly create a sorted and merged list of bitmaps
in the form of a BTreeMap<FieldId, RoaringBitmap> instead of creating
a grenad::Reader where the keys are field_id and the values are docids.

Then we send that BTreeMap to the thing that handles TypedChunks, which
inserts its content into the database.
2022-07-19 10:07:33 +02:00
..
fuzz fix the indexing fuzzer 2022-04-25 18:32:06 +02:00
src Refactor indexation of the "facet-id-exists-docids" database 2022-07-19 10:07:33 +02:00
tests Add integration tests for the EXISTS filter 2022-07-19 10:07:33 +02:00
Cargo.toml Bump uuid to 1.1.2 2022-07-05 16:23:36 +02:00
README.md update the readme + dependencies 2022-01-12 18:30:11 +01:00

README.md

Milli

Fuzzing milli

Currently you can only fuzz the indexation. To execute the fuzzer run:

cargo +nightly fuzz run indexing

To execute the fuzzer on multiple thread you can also run:

cargo +nightly fuzz run -j4 indexing

Since the fuzzer is going to create a lot of temporary file to let milli index its documents I would also recommand to execute it on a ramdisk. Here is how to setup a ramdisk on linux:

sudo mount -t tmpfs none path/to/your/ramdisk

And then set the TMPDIR environment variable to make the fuzzer create its file in it:

export TMPDIR=path/to/your/ramdisk