Irevoire
16eab7b337
I can index documents without meilisearch
2022-10-20 15:30:20 +02:00
Tamo
7bbd75e1fb
wip
2022-10-20 15:29:48 +02:00
Tamo
a4bf859779
create the end Batch type for all Index* operations
2022-10-20 15:29:48 +02:00
Tamo
72496122c3
create the end Batch type for all Document* operation
2022-10-20 15:29:48 +02:00
Tamo
d7146d7b21
write most of the run loop
2022-10-20 15:29:48 +02:00
Tamo
e9d2689499
use faux in the file-store
2022-10-20 15:29:36 +02:00
Tamo
0acc40b222
split the run function in two
2022-10-20 15:28:51 +02:00
Tamo
9069439a14
fix the register test
2022-10-20 15:28:51 +02:00
Tamo
e7c552a0d0
reduce the size of the snapshots
2022-10-20 15:28:50 +02:00
Tamo
cfc01e4372
test the register tasks
2022-10-20 15:28:50 +02:00
Tamo
f84ced7e38
start integrating the index-scheduler in the meilisearch codebase
2022-10-20 15:28:50 +02:00
Tamo
9882b7fa57
greatly reduce the number of warnings
2022-10-20 15:26:57 +02:00
Tamo
1a4461cd3a
fix smol typo
2022-10-20 15:26:57 +02:00
Tamo
ce0ebf9381
get rids of the horrendous spinlock in favor of synchronoise
2022-10-20 15:26:57 +02:00
Tamo
3001ed3a5f
implement the index swap in the index mapper
2022-10-20 15:26:46 +02:00
Tamo
c326613e06
move the index mapping logic in another structure
2022-10-20 15:26:45 +02:00
Tamo
48e10176b2
migrate the index handling code in a different file + implements the create index
2022-10-20 15:26:45 +02:00
Tamo
f7357fc504
reintroduce the uuid mapping for the indexes
2022-10-20 15:26:45 +02:00
Tamo
5b485e309c
add a bunch of tests
2022-10-20 15:26:45 +02:00
Tamo
3120057039
split the DocumentAdditionOrUpdate in two tasks; DocumentAddition and DocumentUpdate
2022-10-20 15:26:33 +02:00
Tamo
00f13f45b6
starts importing the real tasks
2022-10-20 15:26:32 +02:00
Tamo
bbb50d1b96
get rids of the auto-generated mains
2022-10-20 15:26:32 +02:00
Tamo
cf8c4310ab
extract the index abstraction out of the index-scheduler in its own module
2022-10-20 15:26:32 +02:00
Tamo
5abb79f149
rename the update-file-store to file-store since it can store any kind of file
2022-10-20 15:26:22 +02:00
Tamo
5dcd67c597
import the update_file_store in the index-scheduler
2022-10-20 15:26:22 +02:00
Tamo
215d318b53
get rids of nelson
2022-10-20 15:26:22 +02:00
Tamo
68e74e133f
move the update file store to another crate with as little dependencies as possible
2022-10-20 15:26:06 +02:00
Tamo
98bb742d77
finishes the global skelton of the auto-batcher
2022-10-20 15:26:06 +02:00
Tamo
1efccb1bc4
polish the global structure of the batch creation
2022-10-20 15:26:06 +02:00
Irevoire
78ca4bf608
move the autobatcher logic to another file
2022-10-20 15:26:06 +02:00
Tamo
66397bd0de
add the document format file
2022-10-20 15:26:06 +02:00
Tamo
0790a3cbbf
fix the create_new_batch method
2022-10-20 15:26:06 +02:00
Tamo
074dee59ec
fix the whole batchKind thingy
2022-10-20 15:26:05 +02:00
Tamo
ef4594c078
implements most operations
2022-10-20 15:26:05 +02:00
Tamo
9aa31cd391
fix a few typos
2022-10-20 15:26:05 +02:00
Tamo
b1f0431ab4
implements the index deletion, creation and swap
2022-10-20 15:26:05 +02:00
Tamo
fa27485070
makes the updates getters smoother to uses
2022-10-20 15:26:05 +02:00
Tamo
7c56fcfef3
make the project compile again
2022-10-20 15:26:05 +02:00
Tamo
d87b769469
fix the file store
2022-10-20 15:26:04 +02:00
Tamo
faac665d58
make the file store entirely synchronous, including the file deletion
2022-10-20 15:26:04 +02:00
Tamo
fda5ca60bd
fix most of the index module
2022-10-20 15:26:04 +02:00
Irevoire
e7b2b9306a
wip porting the index back in the scheduler
2022-10-20 15:25:55 +02:00
Irevoire
a2587149f4
add a little bit of documentation
2022-10-20 15:25:42 +02:00
Tamo
f359fcc220
implements the filter query
2022-10-20 15:25:41 +02:00
Tamo
c1eda13e64
add the task to the index db in the register task
2022-10-20 15:25:41 +02:00
Tamo
2b77d54412
split the scheduler into multiples files
2022-10-20 15:25:41 +02:00
Tamo
ff5d6d1703
implement the get_batch method
2022-10-20 15:25:41 +02:00
Tamo
5a9ac4ceb3
START THE REWRITE OF THE INDEX SCHEDULER: index & register has been implemented
2022-10-20 15:25:41 +02:00
bors[bot]
f2279f4615
Merge #2928
...
2928: Improve default config file r=curquiza a=curquiza
Following https://github.com/meilisearch/meilisearch/pull/2745#pullrequestreview-1115361274
`@gmourier` `@maryamsulemani97,` here are the changes I applied
- [After discussing with the cloud team](https://meilisearch.slack.com/archives/C03T1T47TUG/p1666014688582379 ) (internal link only), I let commented and uncommented the variables depending on their role.
- The only boolean variable I let be commented is the `no_analytics` one, and I wrote the non-default value (i.e. `true`)-> it will be easier for the users to disable analytics by only uncommenting the line. Plus, `no_analytics = false` is a double negative and not really easy to understand.
- I removed the `INDEX` section that was not really related to indexes
- I keep only 4 sections: SSL, Dumps, Snapshots, and an untitled section with all the uncategorized variables. I gathered all the uncategorized variable at the top of the file, so in the "untitled" section.
- I copied/pasted the really basic [documentation description](https://docs.meilisearch.com/learn/configuration/instance_options.html ) of the variables
- I added every doc linked to each variable.
Let me know if you agree or not with my choices!
Thanks for your review 🙏
Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
2022-10-19 11:49:33 +00:00
Clémentine Urquizar
48058b5e56
Improve default config file
2022-10-18 15:28:32 +02:00
