bors[bot]
c3e3c900f2
Merge #2173
...
2173: chore(all): replace chrono with time r=irevoire a=irevoire
Chrono has been unmaintained for a few month now and there is a CVE on it.
Also I updated all the error messages related to the API key as you can see here: https://github.com/meilisearch/specifications/pull/114
fix #2172
Co-authored-by: Irevoire <tamo@meilisearch.com>
2022-02-17 14:12:23 +00:00
Irevoire
05c8d81e65
chore: get rid of chrono in favor of time
...
Chrono has been unmaintened for a few month now and there is a CVE on it.
make clippy happy
bump milli
2022-02-16 18:14:29 +01:00
Clémentine Urquizar
e2a9414c7a
Update version (v0.26.0)
2022-02-14 16:11:07 +01:00
Clémentine Urquizar
1a87b2f37d
Bump milli to v0.22.1
2022-02-08 11:21:44 +01:00
mpostma
c9a236b0af
feat(lib): auto-batching
2022-02-01 18:06:20 +01:00
bors[bot]
622c15e825
Merge #2096
...
2096: feat(auth): Tenant token r=Kerollmops a=ManyTheFish
Make meilisearch support JWT authentication signed with meilisearch API keys
using HS256, HS384 or HS512 algorithms.
Related spec: [specifications#89](https://github.com/meilisearch/specifications/pull/89 ) [rendered](https://github.com/meilisearch/specifications/blob/scoped-api-keys/text/0089-tenant-tokens.md )
Fix #1991
Co-authored-by: ManyTheFish <many@meilisearch.com>
2022-01-27 10:38:41 +00:00
ManyTheFish
7ca647f0d0
feat(auth): Implement Tenant token
...
Make meilisearch support JWT authentication signed with meilisearch API keys
using HS256, HS384 or HS512 algorithms.
Related spec: https://github.com/meilisearch/specifications/pull/89
Fix #1991
2022-01-27 08:25:39 +01:00
Clémentine Urquizar - curqui
aa50fcb1f0
Merge branch 'main' into stable
2022-01-26 20:17:41 +01:00
Tamo
7828da15c3
feat(analytics): send the whole set of cli options instead of only the snapshot
2022-01-26 13:52:41 +01:00
Rob Ede
9f5fee404b
chore(all): update actix-web dependency to 4.0.0-beta.21
2022-01-21 20:44:17 +00:00
Tamo
436f61a7f4
chore: bump meilisearch
2022-01-18 12:27:15 +01:00
Tamo
3fab5869fa
chore: bump milli
2022-01-18 11:50:17 +01:00
mpostma
f6d53e03f1
chore(http): migrate from structopt to clap3
2022-01-12 14:07:19 +01:00
many
ee7970f603
feat(auth): Extend API keys
...
- Add API keys in snapshots
- Add API keys in dumps
- Rename action indexes.add to indexes.create
- fix QA #1979
fix #1979
fix #1995
fix #2001
fix #2003
related to #1890
2021-12-14 17:33:39 +01:00
Clémentine Urquizar
ae73386723
Update version for the next release (v0.25.0)
2021-12-07 14:00:43 +01:00
many
ae2b0e7aa7
Use milli reexported tokenizer instead of importing meilisearch-tokenizer dependency
2021-12-06 17:18:28 +01:00
many
ffefd0caf2
feat(auth): API keys
...
implements:
https://github.com/meilisearch/specifications/blob/develop/text/0085-api-keys.md
- Add tests on API keys management route (meilisearch-http/tests/auth/api_keys.rs)
- Add tests checking authorizations on each meilisearch routes (meilisearch-http/tests/auth/authorization.rs)
- Implement API keys management routes (meilisearch-http/src/routes/api_key.rs)
- Create module to manage API keys and authorizations (meilisearch-auth)
- Reimplement GuardedData to extend authorizations (meilisearch-http/src/extractors/authentication/mod.rs)
- Change X-MEILI-API-KEY by Authorization Bearer (meilisearch-http/src/extractors/authentication/mod.rs)
- Change meilisearch routes to fit to the new authorization feature (meilisearch-http/src/routes/)
- close #1867
2021-12-06 09:52:41 +01:00
Marin Postma
a30e02c18c
feat(all): Task store
...
implements:
https://github.com/meilisearch/specifications/blob/develop/text/0060-refashion-updates-apis.md
linked PR:
- #1889
- #1891
- #1892
- #1902
- #1906
- #1911
- #1914
- #1915
- #1916
- #1918
- #1924
- #1925
- #1926
- #1930
- #1936
- #1937
- #1942
- #1944
- #1945
- #1946
- #1947
- #1950
- #1951
- #1957
- #1959
- #1960
- #1961
- #1962
- #1964
- https://github.com/meilisearch/milli/pull/414
- https://github.com/meilisearch/milli/pull/409
- https://github.com/meilisearch/milli/pull/406
- https://github.com/meilisearch/milli/pull/418
- close #1687
- close #1786
- close #1940
- close #1948
- close #1949
- close #1932
- close #1956
2021-12-02 20:14:42 +01:00
many
cc6306c0e1
Update milli version
2021-11-04 14:57:45 +01:00
many
b664a46e91
Update milli version
2021-11-03 16:11:20 +01:00
Tamo
c4737749ab
bump segment to be able to display a user
2021-10-29 17:25:53 +02:00
Tamo
de35a9a605
use an official release of segment
2021-10-29 17:25:53 +02:00
Tamo
9be90011c6
save the user-id in the config dir of the OS
2021-10-29 17:25:51 +02:00
Tamo
664d09e86a
makes the analytics works with the option and the feature
2021-10-29 17:25:47 +02:00
Tamo
e226b1a87f
rewrite the main analytics module and the information sent in the tick
2021-10-29 17:25:42 +02:00
bors[bot]
cf67964133
Merge #1848
...
1848: Error format and Definition r=MarinPostma a=ManyTheFish
Co-authored-by: many <maxime@meilisearch.com>
2021-10-28 14:15:35 +00:00
many
3a29cbf0ae
Use milli v0.20.0
2021-10-28 15:59:06 +02:00
many
cbaca2b579
Fix PR comments
2021-10-28 15:42:42 +02:00
Clémentine Urquizar
a76d9b15c9
Update version for the next release (v0.24.0)
2021-10-28 12:24:49 +02:00
many
ff0908d3fa
Ignore errors tests that show unrelated bugs
2021-10-28 11:41:59 +02:00
many
7464720426
Fix some errors
2021-10-28 10:47:59 +02:00
marin postma
4ac005b094
optimize document transform
...
fix error types
bump milli
2021-10-26 13:51:15 +02:00
Clémentine Urquizar
0f342ac46e
Update MeiliSearch version
2021-10-12 16:43:31 +02:00
Clémentine Urquizar
29ac324e90
Update milli version to v0.17.3
2021-10-12 16:12:16 +02:00
Clémentine Urquizar
3edbc74430
Merge branch 'main' into stable
2021-10-11 18:30:10 +02:00
Clémentine Urquizar
60473637fe
Update milli version
2021-10-11 16:21:19 +02:00
Tom Parker-Shemilt
6c46fbbc57
Remove memmap dependency
2021-10-10 22:33:40 +01:00
bors[bot]
ddbcf449da
Merge #1763
...
1763: Index tests r=MarinPostma a=MarinPostma
This pr aims to test more thorougly the usage on index in the meilisearch database, by writing unit tests.
work included:
- [x] Create index mock and stub methods
- [x] Test snapshot creation
- [x] Test Dumps
- [x] Test search
Co-authored-by: mpostma <postma.marin@protonmail.com>
2021-10-06 14:39:53 +00:00
mpostma
85ae34cf9f
test snapshots
2021-10-06 14:10:23 +02:00
Tamo
fca686e7f8
bump meilisearch
2021-10-04 13:52:37 +02:00
Clémentine Urquizar
b17dae9ac0
Update version for the next release (v0.23.0)
2021-09-29 18:40:35 +02:00
bors[bot]
5fad37aebd
Merge #1711
...
1711: MeiliSearch refactor introducing OBKV format r=MarinPostma a=MarinPostma
This PR refactor some multiple components of meilisearch, and introduce the obkv document format to meilisearch
- [x] Split meilisearch-http and meilisearch-lib
- [x] Replace `IndexActor` and `UuidResolver` with `IndexResolver`
- [x] Remove mentions to Actor
- [x] Remove Actor traits to simplify code
- [x] Integrate obkv document format
- [x] Remove `Data`
- [x] Restore all route
- [x] Replace `Box<dyn error>` with `anyhow::Error`
- [x] Introduce update file store
- [x] Update file store error handling
- [x] Fix dumps
- [x] Fix snapshots
- [x] Fix tests
- [x] Update module documentation
- [x] add csv suppport (feat `@ManyTheFish` #1729 )
- [x] add jsonl support
- [x] integrate geosearch (feat `@irevoire` #1725 )
partially implements #1691 and #1690 . The error handling is very basic now, I will finish it in the next pr.
Some unit tests have been disabled, I will re-enable them ASAP, but they need a bit more work.
close #1531
P.S: sorry for this monstrous PR :'(
Co-authored-by: mpostma <postma.marin@protonmail.com>
Co-authored-by: Tamo <tamo@meilisearch.com>
Co-authored-by: many <maxime@meilisearch.com>
2021-09-29 14:38:55 +00:00
mpostma
311933614e
bump milli to v0.17.0
2021-09-29 15:44:54 +02:00
mpostma
1f537e1b60
jsonl support
2021-09-29 11:28:02 +02:00
mpostma
6e8a3fe8de
move csv parsing to document_formats
2021-09-28 22:58:48 +02:00
many
2a14948123
Use an existing revision of milli
2021-09-28 22:30:34 +02:00
many
d30830a55c
Add csv deserializer for documents
2021-09-28 22:28:13 +02:00
mpostma
5fa9bc67d7
remove unused dependencies
2021-09-28 22:16:18 +02:00
mpostma
3503fbf7fe
re-export milli from meilisearch_lib
2021-09-28 22:08:03 +02:00
mpostma
692c676625
fix tests
2021-09-28 18:57:36 +02:00
Tamo
654f49ccec
[WIP] put milli on branch main
2021-09-28 14:50:26 +02:00
Tamo
c1376a9f2a
add the geosearch to Meilisearch
2021-09-28 14:50:26 +02:00
mpostma
5353be74c3
refactor index actor
2021-09-22 15:07:04 +02:00
mpostma
60518449fc
split meilisearch-http and meilisearch-lib
2021-09-21 13:23:22 +02:00
mpostma
e14640e530
refactor meilisearch
2021-09-20 14:54:20 +02:00
happysalada
770b6d25ae
deps: unify pest dependency
2021-09-15 12:15:44 +09:00
Felix Yan
a57943b77e
Use tikv-jemallocator instead of jemallocator
...
`jemallocator` has been abandoned for nearly two years, and `rustc`
itself moved to use `tikv-jemallocator` instead:
3965773ae7
2021-09-14 18:30:24 +03:00
mpostma
0f7625e29a
bump dependencies
2021-09-13 15:17:08 +02:00
Clémentine Urquizar
6d2f7af642
Bump milli: fix some crashes
2021-09-13 12:14:54 +02:00
Tamo
49c918defa
bump milli
2021-09-08 17:41:47 +02:00
Clémentine Urquizar
33514b28be
Merge pull request #1588 from meilisearch/test-new-indexer
...
Integrate the new indexer
2021-09-06 10:21:42 +02:00
Clément Renault
7e80337e5b
Bump milli to v0.12.0
2021-09-02 18:19:12 +02:00
many
8d4723d91b
Update lock file
2021-09-02 18:19:12 +02:00
Clémentine Urquizar
63e67f72e3
Update tokenizer and new milli version
2021-09-02 18:19:00 +02:00
Kerollmops
0cd66c3a89
Bump the milli version
2021-09-02 18:19:00 +02:00
Clément Renault
b092a624ed
Introduce the MaxMemory struct that defaults to 2/3 of the available memory
2021-09-02 18:18:59 +02:00
Clémentine Urquizar
24e84d7ca1
Test new indexer
2021-09-02 18:11:20 +02:00
Clémentine Urquizar
90116155b4
Update version for the next release (v0.22.0)
2021-09-01 12:33:30 +02:00
bors[bot]
19c5c74291
Merge #1652 #1654 #1657
...
1652: Remove dependabot r=MarinPostma a=curquiza
Fixes #1649
Dependabot for vulnerability and security updates is still activated.
1654: Add Script for Windows r=MarinPostma a=singh08prashant
fixes #1570
changes:
1. added script for detecting windows os running git bash
2. appended `.exe` to `$release_file` for windows as listed [here](https://github.com/meilisearch/MeiliSearch/releases/ )
3. removed global `$BINARY_NAME='meilisearch'` as windows require `.exe` file
1657: Bring vergen hotfix from `stable` to `main` r=MarinPostma a=curquiza
Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
Co-authored-by: singh08prashant <singh08prashant@gmail.com>
Co-authored-by: Kerollmops <clement@meilisearch.com>
Co-authored-by: bors[bot] <26634292+bors[bot]@users.noreply.github.com>
2021-08-31 14:31:42 +00:00
Kerollmops
b8c954eb3f
Bump the MeiliSearch version to v0.21.1
2021-08-30 17:41:25 +02:00
Kerollmops
1782753387
Bump vergen and remove unused build feature
2021-08-30 15:03:45 +02:00
Kerollmops
51387b2c80
Introduce the new invalid sortable error codes
2021-08-25 17:29:30 +02:00
Irevoire
672fcee8aa
remove sentry
2021-08-24 12:38:31 +02:00
Clémentine Urquizar
149f46c184
Fix pacic when decoding
2021-08-23 12:37:51 +02:00
Clémentine Urquizar
38fc876704
Update tokenizer and new milli version with new tags
2021-08-18 14:55:10 +02:00
Clémentine Urquizar
39d5a99095
Update milli and tokenizer version
2021-08-18 12:09:34 +02:00
bors[bot]
2beb306834
Merge #1577
...
1577: Update milli dependency: fix facet values bugs r=Kerollmops a=curquiza
Fixes #1576
Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
2021-08-16 16:13:42 +00:00
Clémentine Urquizar
f3e595e2f0
Update milli dependency
2021-08-16 13:36:42 +02:00
Clémentine Urquizar
7531280764
Update tokenizer version to v0.2.4
2021-08-12 13:55:47 +02:00
bors[bot]
7e3b2ddff2
Merge #1554
...
1554: Fix dump v1 (attributesForFaceting, and criteria) r=curquiza a=MarinPostma
close #1553
Co-authored-by: mpostma <postma.marin@protonmail.com>
2021-08-05 19:45:52 +00:00
mpostma
8f05d8d546
fix clippy warnings
2021-08-05 16:00:47 +02:00
Clémentine Urquizar
31fe263356
Update milli to v0.9.0
2021-08-05 13:08:27 +02:00
bors[bot]
9810f6b695
Merge #1540
...
1540: Update milli to version 0.8.1 r=curquiza a=curquiza
Integrates this fix into MeiliSearch https://github.com/meilisearch/milli/pull/296
Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
2021-07-29 17:15:52 +00:00
mpostma
53b4b2fcbc
Use serdeval for validating json format.
2021-07-29 18:02:54 +02:00
Clémentine Urquizar
9a8629a6a9
Update milli
2021-07-29 17:45:31 +02:00
Clémentine Urquizar
e5dabf265a
Update milli version to v0.8.0
2021-07-28 10:52:47 +02:00
Tamo
f79b8287f5
update vergen
2021-07-26 15:25:30 +02:00
Tamo
9949a2a930
bump milli to 0.7.2
2021-07-05 12:19:27 +02:00
Clémentine Urquizar
4f0d3b065f
Update milli
2021-06-30 18:39:06 +02:00
Clémentine Urquizar
01de7f9e36
Update version
2021-06-30 15:59:59 +02:00
Tamo
ec809ca487
use rustls instead of openssl and remove all default-features of reqwest
2021-06-29 13:07:40 +02:00
Clémentine Urquizar
c09e610bb5
Update heed and milli
2021-06-29 10:25:47 +02:00
Tamo
a59f437ee3
use only half of the computer threads for the indexation by default
2021-06-28 14:35:50 +02:00
marin postma
74bb748a4e
bump milli to 0.6.0
2021-06-23 18:40:19 +02:00
Clémentine Urquizar
0de696feaf
Update version for alpha 6
2021-06-22 18:40:51 +02:00
Clémentine Urquizar
e2844f3a92
Update tokenizer version to v0.2.3
2021-06-22 15:57:47 +02:00
Clémentine Urquizar
2e3d85c31a
Update milli version to v0.5.0
2021-06-22 15:57:46 +02:00
marin postma
0bfdf9a785
bump milli
2021-06-21 12:11:09 +02:00
marin postma
abdf642d68
integrate milli errors
2021-06-21 12:11:08 +02:00
bors[bot]
2f2484e186
Merge #212
...
212: bump milli to 0.4.0 r=MarinPostma a=MarinPostma
Co-authored-by: marin postma <postma.marin@protonmail.com>
2021-06-16 15:42:34 +00:00
bors[bot]
2062b10b79
Merge #209
...
209: Integrate amplitude r=MarinPostma a=irevoire
And merge the sentry and amplitude usage under one “Enable analytics” flag
closes #180
Co-authored-by: Tamo <tamo@meilisearch.com>
Co-authored-by: Irevoire <tamo@meilisearch.com>
2021-06-16 15:25:31 +00:00
marin postma
5a47cef9a8
bump milli to 0.4.0
2021-06-16 17:15:56 +02:00
Tamo
def1596eaf
Integrate amplitude
...
And merge the sentry and amplitude usage under one “Enable analytics”
flag
2021-06-15 15:36:30 +02:00
Clémentine Urquizar
fe5a494035
Update alpha for the next release
2021-06-14 17:55:04 +02:00
bors[bot]
b119bb4ab0
Merge #197
...
197: Update milli (v0.3.1) with filterable attributes r=MarinPostma a=curquiza
Fixes #187 and #70
Also fixes #195
Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
2021-06-14 12:19:42 +00:00
Clémentine Urquizar
9996c59183
Update with milli 0.3.1
2021-06-14 13:20:43 +02:00
Clémentine Urquizar
aa04124bfc
Add changes according to milli update
2021-06-14 13:20:37 +02:00
marin postma
0f767e3743
conccurrent update run loop
2021-06-14 10:57:14 +02:00
bors[bot]
1e659bb17b
Merge #194
...
194: Bump sentry version r=MarinPostma a=irevoire
closes #102
Co-authored-by: tamo <tamo@meilisearch.com>
2021-06-14 08:34:04 +00:00
tamo
dffbaca63b
bump sentry version
2021-05-31 13:59:31 +02:00
tamo
26dcb9e66d
bump milli version and fix a performance issue for large dumps
2021-05-10 20:25:12 +02:00
Clémentine Urquizar
eb03a3ccb1
Upgrade Milli and Tokenizer
2021-05-04 17:56:19 +02:00
Marin Postma
928fb34eff
bump milli and fix tests
2021-05-04 15:10:22 +02:00
Marin Postma
78217bcf18
Fix cors authentication issue
2021-04-29 16:28:12 +02:00
Marin Postma
a961f0ce75
fix clippy warnings
2021-04-27 18:28:46 +02:00
Marin Postma
4fe2a13c71
rewrite update store
2021-04-27 15:20:52 +02:00
Marin Postma
5a38f13cae
multi_index udpate store
2021-04-27 15:07:13 +02:00
Clémentine Urquizar
f3b6bf55a6
Update version for the next release (alpha4)
2021-04-26 19:05:16 +02:00
Marin Postma
e4bd1bc5ce
update actix-web-static-file rev
2021-04-22 11:42:41 +02:00
Marin Postma
6bcf20c70e
serve static site
2021-04-22 10:26:54 +02:00
Marin Postma
bb79695e44
load mini-dashboard assets
2021-04-22 10:26:54 +02:00
Marin Postma
ea5517bc8c
add mini-dashboard feature
2021-04-22 10:26:54 +02:00
Marin Postma
c6bb36efa5
implement _formated
2021-04-20 21:23:28 +02:00
Clémentine Urquizar
b8e535579f
Update version for the next release (alpha3)
2021-04-20 16:11:07 +02:00
Marin Postma
f8c338e3a7
add test for dedicated distinct route
2021-04-20 15:49:17 +02:00
mpostma
ec230c2835
enable distinct
2021-04-20 11:29:06 +02:00
Marin Postma
45665245dc
bump actix
2021-04-20 11:07:23 +02:00
Clémentine Urquizar
2c380731b9
Update milli version to v0.1.1
2021-04-19 16:03:39 +02:00
Clémentine Urquizar
b0717b75d9
Update tokenizer to v0.2.1
2021-04-14 19:06:18 +02:00
Alexey Shekhirin
ae1655586c
fixes after review
2021-04-09 14:40:48 +03:00
Alexey Shekhirin
dd9eae8c26
feat(http): stats route
2021-04-09 14:34:42 +03:00
Alexey Shekhirin
51ba1bd7d3
fix(http, index): init analyzer with optional stop words
...
Next release
update tokenizer
2021-04-08 17:16:13 +03:00
tamo
40ef9a3c6a
push a first implementation of the stop_words
2021-04-06 16:29:04 +02:00
Clémentine Urquizar
4ee6ce7871
Next release
2021-04-01 17:16:16 +02:00
mpostma
46293546f3
add tests and mocks
2021-03-24 12:38:59 +01:00
mpostma
8b99860e85
use write sender for updates
2021-03-18 08:32:05 +01:00
bors[bot]
ca3b343b1f
Merge #96
...
96: Check json payload on document addition r=curquiza a=MarinPostma
Check if the json payload in updates is valid. It uses a json validator to avoid allocation, and only serializes the json in case of error, to return a pretty message.
Co-authored-by: mpostma <postma.marin@protonmail.com>
2021-03-16 17:20:44 +00:00
mpostma
204c743bcc
add json payload check on document addition
2021-03-16 14:28:13 +01:00
mpostma
6a742ee62c
restore version route
2021-03-15 19:11:27 +01:00
mpostma
c29b86849b
use actix cors git dependency
2021-03-15 17:40:20 +01:00
mpostma
f727dcc8c6
update milli
2021-03-15 14:26:59 +01:00
mpostma
adc71a70ce
fix displayed attributes in document retrieval
2021-03-15 10:17:41 +01:00
mpostma
3f68460d6c
fix update dedup
2021-03-11 20:58:51 +01:00
mpostma
79a4bc8129
use meta from milli
2021-03-11 19:40:18 +01:00
mpostma
a56e8c1a0c
fix tests
2021-03-10 14:47:04 +01:00
mpostma
5ecf514d28
restructure project
2021-03-10 13:46:49 +01:00
mpostma
562da9dd3f
fix test compilation
2021-03-10 11:56:51 +01:00
mpostma
7d28f8cff0
implement get single udpate
2021-03-06 10:51:52 +01:00
mpostma
f090f42e7a
multi index store
...
create two channels for Index handler, one for writes and one for reads,
so write are processed one at a time, while reads are processed in
parallel.
2021-03-04 19:18:01 +01:00
mpostma
62532b8f79
WIP concurent index store
2021-03-02 14:05:03 +01:00
