Tamo
de35a9a605
use an official release of segment
2021-10-29 17:25:53 +02:00
Tamo
9be90011c6
save the user-id in the config dir of the OS
2021-10-29 17:25:51 +02:00
Tamo
664d09e86a
makes the analytics works with the option and the feature
2021-10-29 17:25:47 +02:00
Tamo
e226b1a87f
rewrite the main analytics module and the information sent in the tick
2021-10-29 17:25:42 +02:00
bors[bot]
cf67964133
Merge #1848
...
1848: Error format and Definition r=MarinPostma a=ManyTheFish
Co-authored-by: many <maxime@meilisearch.com>
2021-10-28 14:15:35 +00:00
many
3a29cbf0ae
Use milli v0.20.0
2021-10-28 15:59:06 +02:00
many
cbaca2b579
Fix PR comments
2021-10-28 15:42:42 +02:00
Clémentine Urquizar
a76d9b15c9
Update version for the next release (v0.24.0)
2021-10-28 12:24:49 +02:00
many
ff0908d3fa
Ignore errors tests that show unrelated bugs
2021-10-28 11:41:59 +02:00
many
7464720426
Fix some errors
2021-10-28 10:47:59 +02:00
marin postma
4ac005b094
optimize document transform
...
fix error types
bump milli
2021-10-26 13:51:15 +02:00
Clémentine Urquizar
0f342ac46e
Update MeiliSearch version
2021-10-12 16:43:31 +02:00
Clémentine Urquizar
29ac324e90
Update milli version to v0.17.3
2021-10-12 16:12:16 +02:00
Clémentine Urquizar
3edbc74430
Merge branch 'main' into stable
2021-10-11 18:30:10 +02:00
Clémentine Urquizar
60473637fe
Update milli version
2021-10-11 16:21:19 +02:00
Tom Parker-Shemilt
6c46fbbc57
Remove memmap dependency
2021-10-10 22:33:40 +01:00
bors[bot]
ddbcf449da
Merge #1763
...
1763: Index tests r=MarinPostma a=MarinPostma
This pr aims to test more thorougly the usage on index in the meilisearch database, by writing unit tests.
work included:
- [x] Create index mock and stub methods
- [x] Test snapshot creation
- [x] Test Dumps
- [x] Test search
Co-authored-by: mpostma <postma.marin@protonmail.com>
2021-10-06 14:39:53 +00:00
mpostma
85ae34cf9f
test snapshots
2021-10-06 14:10:23 +02:00
Tamo
fca686e7f8
bump meilisearch
2021-10-04 13:52:37 +02:00
Clémentine Urquizar
b17dae9ac0
Update version for the next release (v0.23.0)
2021-09-29 18:40:35 +02:00
bors[bot]
5fad37aebd
Merge #1711
...
1711: MeiliSearch refactor introducing OBKV format r=MarinPostma a=MarinPostma
This PR refactor some multiple components of meilisearch, and introduce the obkv document format to meilisearch
- [x] Split meilisearch-http and meilisearch-lib
- [x] Replace `IndexActor` and `UuidResolver` with `IndexResolver`
- [x] Remove mentions to Actor
- [x] Remove Actor traits to simplify code
- [x] Integrate obkv document format
- [x] Remove `Data`
- [x] Restore all route
- [x] Replace `Box<dyn error>` with `anyhow::Error`
- [x] Introduce update file store
- [x] Update file store error handling
- [x] Fix dumps
- [x] Fix snapshots
- [x] Fix tests
- [x] Update module documentation
- [x] add csv suppport (feat `@ManyTheFish` #1729 )
- [x] add jsonl support
- [x] integrate geosearch (feat `@irevoire` #1725 )
partially implements #1691 and #1690 . The error handling is very basic now, I will finish it in the next pr.
Some unit tests have been disabled, I will re-enable them ASAP, but they need a bit more work.
close #1531
P.S: sorry for this monstrous PR :'(
Co-authored-by: mpostma <postma.marin@protonmail.com>
Co-authored-by: Tamo <tamo@meilisearch.com>
Co-authored-by: many <maxime@meilisearch.com>
2021-09-29 14:38:55 +00:00
mpostma
311933614e
bump milli to v0.17.0
2021-09-29 15:44:54 +02:00
mpostma
1f537e1b60
jsonl support
2021-09-29 11:28:02 +02:00
mpostma
6e8a3fe8de
move csv parsing to document_formats
2021-09-28 22:58:48 +02:00
many
2a14948123
Use an existing revision of milli
2021-09-28 22:30:34 +02:00
many
d30830a55c
Add csv deserializer for documents
2021-09-28 22:28:13 +02:00
mpostma
5fa9bc67d7
remove unused dependencies
2021-09-28 22:16:18 +02:00
mpostma
3503fbf7fe
re-export milli from meilisearch_lib
2021-09-28 22:08:03 +02:00
mpostma
692c676625
fix tests
2021-09-28 18:57:36 +02:00
Tamo
654f49ccec
[WIP] put milli on branch main
2021-09-28 14:50:26 +02:00
Tamo
c1376a9f2a
add the geosearch to Meilisearch
2021-09-28 14:50:26 +02:00
mpostma
5353be74c3
refactor index actor
2021-09-22 15:07:04 +02:00
mpostma
60518449fc
split meilisearch-http and meilisearch-lib
2021-09-21 13:23:22 +02:00
mpostma
e14640e530
refactor meilisearch
2021-09-20 14:54:20 +02:00
happysalada
770b6d25ae
deps: unify pest dependency
2021-09-15 12:15:44 +09:00
Felix Yan
a57943b77e
Use tikv-jemallocator instead of jemallocator
...
`jemallocator` has been abandoned for nearly two years, and `rustc`
itself moved to use `tikv-jemallocator` instead:
3965773ae7
2021-09-14 18:30:24 +03:00
mpostma
0f7625e29a
bump dependencies
2021-09-13 15:17:08 +02:00
Clémentine Urquizar
6d2f7af642
Bump milli: fix some crashes
2021-09-13 12:14:54 +02:00
Tamo
49c918defa
bump milli
2021-09-08 17:41:47 +02:00
Clémentine Urquizar
33514b28be
Merge pull request #1588 from meilisearch/test-new-indexer
...
Integrate the new indexer
2021-09-06 10:21:42 +02:00
Clément Renault
7e80337e5b
Bump milli to v0.12.0
2021-09-02 18:19:12 +02:00
many
8d4723d91b
Update lock file
2021-09-02 18:19:12 +02:00
Clémentine Urquizar
63e67f72e3
Update tokenizer and new milli version
2021-09-02 18:19:00 +02:00
Kerollmops
0cd66c3a89
Bump the milli version
2021-09-02 18:19:00 +02:00
Clément Renault
b092a624ed
Introduce the MaxMemory struct that defaults to 2/3 of the available memory
2021-09-02 18:18:59 +02:00
Clémentine Urquizar
24e84d7ca1
Test new indexer
2021-09-02 18:11:20 +02:00
Clémentine Urquizar
90116155b4
Update version for the next release (v0.22.0)
2021-09-01 12:33:30 +02:00
bors[bot]
19c5c74291
Merge #1652 #1654 #1657
...
1652: Remove dependabot r=MarinPostma a=curquiza
Fixes #1649
Dependabot for vulnerability and security updates is still activated.
1654: Add Script for Windows r=MarinPostma a=singh08prashant
fixes #1570
changes:
1. added script for detecting windows os running git bash
2. appended `.exe` to `$release_file` for windows as listed [here](https://github.com/meilisearch/MeiliSearch/releases/ )
3. removed global `$BINARY_NAME='meilisearch'` as windows require `.exe` file
1657: Bring vergen hotfix from `stable` to `main` r=MarinPostma a=curquiza
Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
Co-authored-by: singh08prashant <singh08prashant@gmail.com>
Co-authored-by: Kerollmops <clement@meilisearch.com>
Co-authored-by: bors[bot] <26634292+bors[bot]@users.noreply.github.com>
2021-08-31 14:31:42 +00:00
Kerollmops
b8c954eb3f
Bump the MeiliSearch version to v0.21.1
2021-08-30 17:41:25 +02:00
Kerollmops
1782753387
Bump vergen and remove unused build feature
2021-08-30 15:03:45 +02:00
Kerollmops
51387b2c80
Introduce the new invalid sortable error codes
2021-08-25 17:29:30 +02:00
Irevoire
672fcee8aa
remove sentry
2021-08-24 12:38:31 +02:00
Clémentine Urquizar
149f46c184
Fix pacic when decoding
2021-08-23 12:37:51 +02:00
Clémentine Urquizar
38fc876704
Update tokenizer and new milli version with new tags
2021-08-18 14:55:10 +02:00
Clémentine Urquizar
39d5a99095
Update milli and tokenizer version
2021-08-18 12:09:34 +02:00
bors[bot]
2beb306834
Merge #1577
...
1577: Update milli dependency: fix facet values bugs r=Kerollmops a=curquiza
Fixes #1576
Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
2021-08-16 16:13:42 +00:00
Clémentine Urquizar
f3e595e2f0
Update milli dependency
2021-08-16 13:36:42 +02:00
Clémentine Urquizar
7531280764
Update tokenizer version to v0.2.4
2021-08-12 13:55:47 +02:00
bors[bot]
7e3b2ddff2
Merge #1554
...
1554: Fix dump v1 (attributesForFaceting, and criteria) r=curquiza a=MarinPostma
close #1553
Co-authored-by: mpostma <postma.marin@protonmail.com>
2021-08-05 19:45:52 +00:00
mpostma
8f05d8d546
fix clippy warnings
2021-08-05 16:00:47 +02:00
Clémentine Urquizar
31fe263356
Update milli to v0.9.0
2021-08-05 13:08:27 +02:00
bors[bot]
9810f6b695
Merge #1540
...
1540: Update milli to version 0.8.1 r=curquiza a=curquiza
Integrates this fix into MeiliSearch https://github.com/meilisearch/milli/pull/296
Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
2021-07-29 17:15:52 +00:00
mpostma
53b4b2fcbc
Use serdeval for validating json format.
2021-07-29 18:02:54 +02:00
Clémentine Urquizar
9a8629a6a9
Update milli
2021-07-29 17:45:31 +02:00
Clémentine Urquizar
e5dabf265a
Update milli version to v0.8.0
2021-07-28 10:52:47 +02:00
Tamo
f79b8287f5
update vergen
2021-07-26 15:25:30 +02:00
Tamo
9949a2a930
bump milli to 0.7.2
2021-07-05 12:19:27 +02:00
Clémentine Urquizar
4f0d3b065f
Update milli
2021-06-30 18:39:06 +02:00
Clémentine Urquizar
01de7f9e36
Update version
2021-06-30 15:59:59 +02:00
Tamo
ec809ca487
use rustls instead of openssl and remove all default-features of reqwest
2021-06-29 13:07:40 +02:00
Clémentine Urquizar
c09e610bb5
Update heed and milli
2021-06-29 10:25:47 +02:00
Tamo
a59f437ee3
use only half of the computer threads for the indexation by default
2021-06-28 14:35:50 +02:00
marin postma
74bb748a4e
bump milli to 0.6.0
2021-06-23 18:40:19 +02:00
Clémentine Urquizar
0de696feaf
Update version for alpha 6
2021-06-22 18:40:51 +02:00
Clémentine Urquizar
e2844f3a92
Update tokenizer version to v0.2.3
2021-06-22 15:57:47 +02:00
Clémentine Urquizar
2e3d85c31a
Update milli version to v0.5.0
2021-06-22 15:57:46 +02:00
marin postma
0bfdf9a785
bump milli
2021-06-21 12:11:09 +02:00
marin postma
abdf642d68
integrate milli errors
2021-06-21 12:11:08 +02:00
bors[bot]
2f2484e186
Merge #212
...
212: bump milli to 0.4.0 r=MarinPostma a=MarinPostma
Co-authored-by: marin postma <postma.marin@protonmail.com>
2021-06-16 15:42:34 +00:00
bors[bot]
2062b10b79
Merge #209
...
209: Integrate amplitude r=MarinPostma a=irevoire
And merge the sentry and amplitude usage under one “Enable analytics” flag
closes #180
Co-authored-by: Tamo <tamo@meilisearch.com>
Co-authored-by: Irevoire <tamo@meilisearch.com>
2021-06-16 15:25:31 +00:00
marin postma
5a47cef9a8
bump milli to 0.4.0
2021-06-16 17:15:56 +02:00
Tamo
def1596eaf
Integrate amplitude
...
And merge the sentry and amplitude usage under one “Enable analytics”
flag
2021-06-15 15:36:30 +02:00
Clémentine Urquizar
fe5a494035
Update alpha for the next release
2021-06-14 17:55:04 +02:00
bors[bot]
b119bb4ab0
Merge #197
...
197: Update milli (v0.3.1) with filterable attributes r=MarinPostma a=curquiza
Fixes #187 and #70
Also fixes #195
Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
2021-06-14 12:19:42 +00:00
Clémentine Urquizar
9996c59183
Update with milli 0.3.1
2021-06-14 13:20:43 +02:00
Clémentine Urquizar
aa04124bfc
Add changes according to milli update
2021-06-14 13:20:37 +02:00
marin postma
0f767e3743
conccurrent update run loop
2021-06-14 10:57:14 +02:00
bors[bot]
1e659bb17b
Merge #194
...
194: Bump sentry version r=MarinPostma a=irevoire
closes #102
Co-authored-by: tamo <tamo@meilisearch.com>
2021-06-14 08:34:04 +00:00
tamo
dffbaca63b
bump sentry version
2021-05-31 13:59:31 +02:00
tamo
26dcb9e66d
bump milli version and fix a performance issue for large dumps
2021-05-10 20:25:12 +02:00
Clémentine Urquizar
eb03a3ccb1
Upgrade Milli and Tokenizer
2021-05-04 17:56:19 +02:00
Marin Postma
928fb34eff
bump milli and fix tests
2021-05-04 15:10:22 +02:00
Marin Postma
78217bcf18
Fix cors authentication issue
2021-04-29 16:28:12 +02:00
Marin Postma
a961f0ce75
fix clippy warnings
2021-04-27 18:28:46 +02:00
Marin Postma
4fe2a13c71
rewrite update store
2021-04-27 15:20:52 +02:00
Marin Postma
5a38f13cae
multi_index udpate store
2021-04-27 15:07:13 +02:00
Clémentine Urquizar
f3b6bf55a6
Update version for the next release (alpha4)
2021-04-26 19:05:16 +02:00
Marin Postma
e4bd1bc5ce
update actix-web-static-file rev
2021-04-22 11:42:41 +02:00
Marin Postma
6bcf20c70e
serve static site
2021-04-22 10:26:54 +02:00
Marin Postma
bb79695e44
load mini-dashboard assets
2021-04-22 10:26:54 +02:00
Marin Postma
ea5517bc8c
add mini-dashboard feature
2021-04-22 10:26:54 +02:00
Marin Postma
c6bb36efa5
implement _formated
2021-04-20 21:23:28 +02:00
Clémentine Urquizar
b8e535579f
Update version for the next release (alpha3)
2021-04-20 16:11:07 +02:00
Marin Postma
f8c338e3a7
add test for dedicated distinct route
2021-04-20 15:49:17 +02:00
mpostma
ec230c2835
enable distinct
2021-04-20 11:29:06 +02:00
Marin Postma
45665245dc
bump actix
2021-04-20 11:07:23 +02:00
Clémentine Urquizar
2c380731b9
Update milli version to v0.1.1
2021-04-19 16:03:39 +02:00
Clémentine Urquizar
b0717b75d9
Update tokenizer to v0.2.1
2021-04-14 19:06:18 +02:00
Alexey Shekhirin
ae1655586c
fixes after review
2021-04-09 14:40:48 +03:00
Alexey Shekhirin
dd9eae8c26
feat(http): stats route
2021-04-09 14:34:42 +03:00
Alexey Shekhirin
51ba1bd7d3
fix(http, index): init analyzer with optional stop words
...
Next release
update tokenizer
2021-04-08 17:16:13 +03:00
tamo
40ef9a3c6a
push a first implementation of the stop_words
2021-04-06 16:29:04 +02:00
Clémentine Urquizar
4ee6ce7871
Next release
2021-04-01 17:16:16 +02:00
mpostma
46293546f3
add tests and mocks
2021-03-24 12:38:59 +01:00
mpostma
8b99860e85
use write sender for updates
2021-03-18 08:32:05 +01:00
bors[bot]
ca3b343b1f
Merge #96
...
96: Check json payload on document addition r=curquiza a=MarinPostma
Check if the json payload in updates is valid. It uses a json validator to avoid allocation, and only serializes the json in case of error, to return a pretty message.
Co-authored-by: mpostma <postma.marin@protonmail.com>
2021-03-16 17:20:44 +00:00
mpostma
204c743bcc
add json payload check on document addition
2021-03-16 14:28:13 +01:00
mpostma
6a742ee62c
restore version route
2021-03-15 19:11:27 +01:00
mpostma
c29b86849b
use actix cors git dependency
2021-03-15 17:40:20 +01:00
mpostma
f727dcc8c6
update milli
2021-03-15 14:26:59 +01:00
mpostma
adc71a70ce
fix displayed attributes in document retrieval
2021-03-15 10:17:41 +01:00
mpostma
3f68460d6c
fix update dedup
2021-03-11 20:58:51 +01:00
mpostma
79a4bc8129
use meta from milli
2021-03-11 19:40:18 +01:00
mpostma
a56e8c1a0c
fix tests
2021-03-10 14:47:04 +01:00
mpostma
5ecf514d28
restructure project
2021-03-10 13:46:49 +01:00
mpostma
562da9dd3f
fix test compilation
2021-03-10 11:56:51 +01:00
mpostma
7d28f8cff0
implement get single udpate
2021-03-06 10:51:52 +01:00
mpostma
f090f42e7a
multi index store
...
create two channels for Index handler, one for writes and one for reads,
so write are processed one at a time, while reads are processed in
parallel.
2021-03-04 19:18:01 +01:00
mpostma
62532b8f79
WIP concurent index store
2021-03-02 14:05:03 +01:00
mpostma
61ce749122
update tokio and disable all routes
2021-02-26 09:10:04 +01:00
mpostma
91d6e90d5d
enable faceted searches
2021-02-16 19:20:39 +01:00
mpostma
f8f02af23e
incorporate review changes
2021-02-04 13:21:15 +01:00
mpostma
9af0a08122
post review fixes
2021-02-02 17:34:06 +01:00
mpostma
17c463ca61
remove unused deps
2021-02-01 13:32:21 +01:00
mpostma
e9c95f6623
remove useless files
2021-01-28 19:43:54 +01:00
mpostma
6c63ee6798
implement list all indexes
2021-01-28 18:32:24 +01:00
mpostma
74410d8c6b
architecture rework
2021-01-28 14:12:34 +01:00
mpostma
6a3f625e11
WIP: refactor IndexController
...
change the architecture of the index controller to allow it to own an
index store.
2021-01-16 15:09:48 +01:00
mpostma
686f987180
fix compile errors
2021-01-14 11:27:07 +01:00
mpostma
d22fab5bae
implement open index
2021-01-13 18:20:14 +01:00
mpostma
ddd7789713
WIP: IndexController
2021-01-13 17:50:36 +01:00
mpostma
b4d447b5cb
temp
2021-01-01 16:59:49 +01:00
mpostma
d1e9ded76f
setting builder takes ownership
2020-12-31 00:50:30 +01:00
mpostma
d9dc2036a7
support error & return document count on addition
2020-12-30 18:44:33 +01:00
mpostma
54861335a0
retrieve update status
2020-12-30 18:16:07 +01:00
mpostma
0cd9e62fc6
search first iteration
2020-12-24 12:58:34 +01:00
mpostma
1a38bfd31f
data add documents
2020-12-23 13:52:28 +01:00
mpostma
55e1552957
update queue refactor, first iteration
2020-12-22 17:13:50 +01:00
mpostma
7c9eaaeadb
clean code, and fix errors
2020-12-22 14:02:41 +01:00
