meilisearch

mirror of https://github.com/meilisearch/meilisearch.git synced 2025-02-20 01:27:52 +08:00

History

meili-bors[bot] 049bd45849

4371: Fixes embedder issues r=irevoire a=dureuill

# Pull Request

## Related issue
Fixes #4361
Fixes #4370 

## What does this PR do?
- Truncate tokens to 512 for Hugging Face embedders
- Move the tokio runtime to OpenAI so that we no longer have a thread with rayon -> tokio -> rayon
- Spawn a new reqwest client after each new runtime to avoid spurious runtime error 

## Manual tests

- embedding failing document from `@CaroFG` with hugging face
- embedding movies with hugging face
- embedding and searching movies with openai

Co-authored-by: Louis Dureuil <louis@meilisearch.com>

2024-01-29 11:23:57 +00:00

documents

Rename trait

2023-11-13 13:38:36 +01:00

facet

update milli with the new parser_filter

2021-11-04 15:02:36 +01:00

heed_codec

Clarify an unreachable unwrap

2023-11-28 14:26:31 +01:00

prompt

Remove prompt strategy and fallback