Commit Graph

  • bbaee3dbc6 Add Swedish pipeline in all-tokenization feature ManyTheFish 2024-09-19 08:34:51 +02:00
  • 877717cb26 Add a test using Swedish documents ManyTheFish 2024-09-19 08:34:04 +02:00
  • 0ffeea5a52 Remove wrong comments F. Levi 2024-09-19 09:06:40 +03:00
  • 716817122a Correct broken links in README Ian Ornstein 2024-09-18 16:30:29 -05:00
  • ff523a2357
    Merge #4939 meili-bors[bot] 2024-09-18 10:19:48 +00:00
  • 29c3aca72a
    Merge #4929 meili-bors[bot] 2024-09-18 09:47:20 +00:00
  • 00f8d03f43
    Use f32::min and f32::max Louis Dureuil 2024-09-18 11:43:07 +02:00
  • 50981ea778
    Update the error messages Clément Renault 2024-09-18 11:44:29 +02:00
  • c2caff1716
    Remove obsolete enum Louis Dureuil 2024-09-18 11:26:43 +02:00
  • 30aa1f6dea Merge with main F. Levi 2024-09-18 11:03:33 +03:00
  • 83113998f9 Add more test assertions F. Levi 2024-09-18 10:35:23 +03:00
  • 4c355bede7
    Merge #4937 meili-bors[bot] 2024-09-18 05:29:32 +00:00
  • 174d69ff72
    Don't override max value in indexes Louis Dureuil 2024-09-17 18:16:14 +02:00
  • 52a52f97cf
    Update tests Louis Dureuil 2024-09-17 17:49:12 +02:00
  • 5de4b48552
    Fixup error messages Louis Dureuil 2024-09-17 17:49:00 +02:00
  • df648ce7a6
    Update tests Louis Dureuil 2024-09-17 17:40:14 +02:00
  • af8edab21d
    Remove mention of sort order and recommend changing index settings on inconsistent order error Louis Dureuil 2024-09-17 17:39:51 +02:00
  • c42746c4cd
    Update tests Louis Dureuil 2024-09-17 17:22:14 +02:00
  • 98b77aec66
    Remove runtime sortFacetValuesBy Louis Dureuil 2024-09-17 17:22:03 +02:00
  • 54d3ba3357
    Fix tests that check error message content Clément Renault 2024-09-17 16:59:22 +02:00
  • 6e058709f2 Rustfmt ManyTheFish 2024-09-17 17:02:06 +02:00
  • 0fbf9ea5b1 Factorize using macro ManyTheFish 2024-09-17 16:59:13 +02:00
  • 9f1fb4b425
    Introduce the STARTS WITH filter operator gated under an experimental feature Clément Renault 2024-09-17 16:44:11 +02:00
  • f7337affd6 Adjust tests to changes F. Levi 2024-09-17 17:31:09 +03:00
  • 1120a5296c
    Update tests Louis Dureuil 2024-09-17 16:30:04 +02:00
  • a35a339c3d
    Touchup error message Louis Dureuil 2024-09-17 16:27:35 +02:00
  • cac5836f6f
    Remove hybrid.embedder boolean from analytics because embedder is now mandatory Louis Dureuil 2024-09-17 16:27:00 +02:00
  • 5239ae0297
    Rework search kind so that a search without query but with vector is a vector search regardless of semantic ratio Louis Dureuil 2024-09-17 16:28:40 +02:00
  • 2fdb1d8018
    SearchQueryGet can fail Louis Dureuil 2024-09-17 16:28:06 +02:00
  • 3c5e363554
    Remove default embedders Louis Dureuil 2024-09-17 16:30:13 +02:00
  • da0dd6febf
    Make embedder mandatory Louis Dureuil 2024-09-17 16:29:39 +02:00
  • a197d63ab6 simplify tests ManyTheFish 2024-09-17 15:30:12 +02:00
  • 390eadb733 Support iso-639-1 ManyTheFish 2024-09-17 15:01:01 +02:00
  • 93f0317b94
    Merge #4936 meili-bors[bot] 2024-09-17 11:47:08 +00:00
  • 29ff02f3ff Update version for the next release (v1.11.0) in Cargo.toml curquiza 2024-09-17 11:45:48 +00:00
  • d9e0df74ea
    update test Louis Dureuil 2024-09-17 10:09:01 +02:00
  • dc8a662209
    federated queries: adjust error message Louis Dureuil 2024-09-17 10:08:21 +02:00
  • 6732dd95d7
    Update tests Louis Dureuil 2024-09-16 15:18:32 +02:00
  • 95da428dc8
    Use route in federated Louis Dureuil 2024-09-16 15:18:23 +02:00
  • 38c4be1c8e
    compute_facets accepts Route argument to fixup error code Louis Dureuil 2024-09-16 15:18:09 +02:00
  • 91dfab317f
    New error Louis Dureuil 2024-09-16 15:17:46 +02:00
  • 47e3c4b5c3
    Add new tests Louis Dureuil 2024-09-12 17:52:13 +02:00
  • 533f1d4345
    Federated search: support facets Louis Dureuil 2024-09-12 17:51:20 +02:00
  • 7b55462610
    BREAKING CHANGE: errors if queries.facets in federated search Louis Dureuil 2024-09-12 17:50:03 +02:00
  • f6114a1ff2
    Introduce ComputedFacets and compute_facet_distribution_stats Louis Dureuil 2024-09-12 17:49:03 +02:00
  • 7c084b1286
    SearchQueriesWithIndex changes Louis Dureuil 2024-09-12 17:48:26 +02:00
  • 57f9517a98
    Required changes to IndexUid Louis Dureuil 2024-09-12 17:47:15 +02:00
  • 72cc573e0a
    Add new error types Louis Dureuil 2024-09-12 17:47:00 +02:00
  • a48b1d5a79
    Update existing tests following error message changes Louis Dureuil 2024-09-12 17:51:54 +02:00
  • a94a87ee54
    Slightly changes existing error messages Louis Dureuil 2024-09-11 11:25:26 +02:00
  • e098cc8320 Make comparison simpler, add IndexUid error details similarly F. Levi 2024-09-17 00:16:15 +03:00
  • ec815fa368 Format F. Levi 2024-09-16 23:59:48 +03:00
  • 4a922a176f Add test for > 512 byte ID F. Levi 2024-09-16 23:53:34 +03:00
  • 51bc7b3173 Update tests F. Levi 2024-09-16 22:22:24 +03:00
  • f4ab1f168e
    Prefer using Rc<str> than String when cloning a lot Clément Renault 2024-09-16 15:41:29 +02:00
  • 4b55ba68bc
    Merge #4911 meili-bors[bot] 2024-09-16 13:32:32 +00:00
  • 1a0e962299 Replace hashmap by vectors in wpp ManyTheFish 2024-09-16 15:01:20 +02:00
  • f13e076b8a Use hashmap instead of Btree in wpp extractor ManyTheFish 2024-09-16 14:40:40 +02:00
  • af2b722fed
    Make the CI happy about the never type option-disable-prefixdb Clément Renault 2024-09-16 11:40:26 +02:00
  • 8cb7001755
    Expose an experimental parameter to control the generation of prefix dbs prototype-control-prefixdb-1 Clément Renault 2024-09-16 10:57:52 +02:00
  • 7ba49b849e Extract and write facet databases ManyTheFish 2024-09-16 09:34:10 +02:00
  • 993408d3ba Change closure to fn F. Levi 2024-09-15 16:15:09 +03:00
  • dcb61f8b3a Return error for primary keys with a length greater than 512 bytes F. Levi 2024-09-09 15:27:47 +03:00
  • 51085206cc Misc adjustments F. Levi 2024-09-14 10:14:07 +03:00
  • a2a16bf846 Move MatchPosition impl to Match, adjust counting score for phrases F. Levi 2024-09-13 21:20:06 +03:00
  • cab63abc84 Improve MatchesPosition enum with an impl F. Levi 2024-09-13 14:35:28 +03:00
  • 65e3d61a95 Make use of helper function in one more place F. Levi 2024-09-13 13:35:58 +03:00
  • cc6a2aec06 Improve changes to Matcher F. Levi 2024-09-13 13:31:07 +03:00
  • f7652186e1
    WIP geo fields Clément Renault 2024-09-12 18:01:02 +02:00
  • 23e14138bb
    facet distribution: implement Display for OrderBy Louis Dureuil 2024-09-12 17:41:01 +02:00
  • e44325683a
    Facet distribution: fix issue where truncated facet distribution would have a wrong order Louis Dureuil 2024-09-12 17:40:33 +02:00
  • e7af499314 Improve changes to Matcher F. Levi 2024-09-12 16:58:13 +03:00
  • b2f4e67c9a
    Do not store useless updates Clément Renault 2024-09-12 15:38:31 +02:00
  • ff5d3b59f5
    Move the document id extraction to the primary key code Clément Renault 2024-09-12 12:01:31 +02:00
  • aa69308e45 Use a bufWriter to build word FSTs ManyTheFish 2024-09-12 11:48:00 +02:00
  • eb9a20ff0b Fix fid_word_docids extraction ManyTheFish 2024-09-12 11:08:18 +02:00
  • edcb4c60ba Change Matcher so that phrases are counted as one instead of word by word F. Levi 2024-09-12 09:44:37 +03:00
  • 0d868f36d7
    Make sure we always use a BufWriter to write the update files Clément Renault 2024-09-11 18:38:04 +02:00
  • e7d9db078f
    Use the right key name when convertir from CSV to NDJSON Clément Renault 2024-09-11 18:27:00 +02:00
  • 3e9198ebaa
    Support guessing primary key again Clément Renault 2024-09-11 15:59:30 +02:00
  • 2a0ad0982f
    Fix the document counter Clément Renault 2024-09-11 10:20:26 +02:00
  • 2b317c681b Build mergers in parallel ManyTheFish 2024-09-11 11:49:26 +02:00
  • 39b5990f64 Mutualize tokenization ManyTheFish 2024-09-11 10:20:23 +02:00
  • 3848adf5a2
    Improve error management and simplify JSON read Clément Renault 2024-09-11 10:10:51 +02:00
  • b4de06259e
    Better CSV support Clément Renault 2024-09-11 10:02:00 +02:00
  • 02c2b660f8
    Merge #4920 meili-bors[bot] 2024-09-11 07:08:39 +00:00
  • 8287c2644f
    Support CSV again Clément Renault 2024-09-10 21:10:28 +01:00
  • c1c44a0b81
    Impl serialize on TopLevelMap Clément Renault 2024-09-10 19:32:03 +01:00
  • 04596f3616
    Move the TopLevelMap into a dedicated module Clément Renault 2024-09-10 18:01:17 +01:00
  • 24cb5839ad
    Move the document changes sorting logic to a new trait Clément Renault 2024-09-10 17:37:52 +01:00
  • 8d97b7b28c
    Support JSON payloads again (not perfectly though) Clément Renault 2024-09-10 17:09:49 +01:00
  • f9b7a5ed93
    feat: Added Elestio as one-click deploy option Kaiwalya Koparkar 2024-09-10 13:25:50 +05:30
  • f69688e8f7 Fix several warnings in extractors and remove unreachable macros ManyTheFish 2024-09-09 14:52:50 +02:00
  • f18e9cb7b3
    Change openai default model Louis Dureuil 2024-09-09 13:09:35 +02:00
  • 0084868f8f remove await Santhosh Reddy Vootukuri (SUNNY) (from Dev Box) 2024-09-08 09:58:41 -07:00
  • 31d460044b removing .await Santhosh Reddy Vootukuri (SUNNY) (from Dev Box) 2024-09-08 09:52:22 -07:00
  • 8fd0afaaaa
    Make sure we iterate over the payload documents in order Clément Renault 2024-09-05 22:31:17 +02:00
  • 72c6a21a30
    Use raw JSON to read the payloads Clément Renault 2024-09-05 20:08:23 +02:00
  • 8412be4a7d
    Cleanup CowStr and TopLevelMap struct Clément Renault 2024-09-05 18:32:55 +02:00
  • 10f09c531f
    add some commented code to read from json with raw values Louis Dureuil 2024-09-05 18:22:16 +02:00