64 Commits

Author	SHA1	Message	Date
Clément Renault	3cdf14d4c5	Introduce the field-id-docid-facet-values database	2020-12-04 12:03:20 +01:00
Clément Renault	61b383f422	Introduce the criteria update setting	2020-12-04 12:02:22 +01:00
Clément Renault	ecc8bc8910	Introduce the FieldId u8 alias type	2020-12-02 11:19:45 +01:00
Clément Renault	96f64c629e	Move the UpdateStore out of the update module	2020-12-01 14:51:05 +01:00
Clément Renault	58a1f9081c	Allow users to abort pending updates, one by one or all at once	2020-12-01 14:51:05 +01:00
Kerollmops	d0240bd9d0	Done a big clippy pass	2020-12-01 14:45:19 +01:00
Clément Renault	ba4ba685f9	Make the facet levels maps to previous level groups and don't split them	2020-11-28 12:43:43 +01:00
Clément Renault	54d5cec582	Transform numbers into strings when faceted and necessary	2020-11-23 16:43:56 +01:00
Clément Renault	fc686aaca7	Use the De Morgan law to simplify the NOT operation	2020-11-23 16:43:56 +01:00
Clément Renault	c52d09d5b1	Support a basic version of the string facet query system	2020-11-23 16:43:55 +01:00
Clément Renault	59ca4b9fe4	Introduce a little bit of debug when deleting documents	2020-11-23 16:43:53 +01:00
Clément Renault	0694cc4916	Drastically speed up documents deletion updates	2020-11-23 16:43:53 +01:00
Clément Renault	38c76754ef	Make the facet level search system generic on f64 and i64	2020-11-23 16:43:52 +01:00
Clément Renault	67d4a1b3fc	Introduce a new update for the facet levels	2020-11-23 16:43:51 +01:00
Clément Renault	9ec95679e1	Introduce a function to retrieve the facet level range docids	2020-11-23 16:43:50 +01:00
Clément Renault	fd8360deb1	Update the facet indexing facet test	2020-11-23 16:43:50 +01:00
Clément Renault	9b7e516a56	Fix the indexing process going back in time	2020-11-23 16:43:49 +01:00
Clément Renault	27f3ef5f7a	Use the new ExternalDocumentsIds struct in the engine	2020-11-22 19:27:34 +01:00
Clément Renault	eded5558b2	Rename the users ids documents ids into external documents ids	2020-11-22 17:17:47 +01:00
Clément Renault	f06355b0bb	Display the time it takes to merge user documents ids	2020-11-22 11:28:35 +01:00
Clément Renault	e76558b0cc	Change the settings update system to reindex only one time	2020-11-14 11:17:49 +01:00
Clément Renault	f9cc12ae0f	Do not try to parse empty faceted strings	2020-11-13 18:35:47 +01:00
Clément Renault	a18d9a1f87	Parse and store the faceted fields	2020-11-13 16:13:51 +01:00
Clément Renault	4e5e55c21a	Simplify the merge functions	2020-11-13 14:50:30 +01:00
Clément Renault	466fb601d6	Faceted fields settings must specify the facet type	2020-11-13 11:46:48 +01:00
Clément Renault	ebe7087bff	Introduce the faceted fields setting	2020-11-11 17:08:18 +01:00
Clément Renault	92ec908303	Introduce the facet field id values engine database	2020-11-11 16:06:33 +01:00
Clément Renault	ea43080548	Make the indexing process send the new progress step events	2020-11-11 13:13:08 +01:00
Clément Renault	e78b96a657	Introduce a more detailed progress status enum	2020-11-11 12:31:59 +01:00
Clément Renault	535f8088d7	Write the words pairs proximities directly into LMDB to speedup indexing	2020-11-11 11:25:31 +01:00
Clément Renault	45ae086974	Make sure pending updates are process when restarting the UpdateStore	2020-11-09 17:33:07 +01:00
Clément Renault	4fb138c42e	Make sure we index all kind of JSON types	2020-11-06 16:35:07 +01:00
Clément Renault	a31db33e93	Introduce an optimization when the searchable attributes are ordered	2020-11-03 19:59:09 +01:00
Clément Renault	63f65bac3e	Ignore the long running UpdateStore test	2020-11-03 19:12:00 +01:00
Clément Renault	a20c871ece	Add more tests to the Settings searchable attributes operation	2020-11-03 18:58:19 +01:00
Clément Renault	649fb6e401	Make sure that the indexing Store only index searchable fields	2020-11-03 18:58:19 +01:00
Clément Renault	e48630da72	Introduce the searchable parameter settings to the Settings update	2020-11-03 18:58:19 +01:00
Clément Renault	7e120fc441	Allow library users to specify the rayon ThreadPool for UpdateBuilder	2020-11-02 19:11:22 +01:00
Clément Renault	995d72b8c1	Introduce the Settings update operation	2020-11-02 15:31:20 +01:00
Clément Renault	3abfe8aa22	Validate documents ids before accepting them	2020-11-01 20:55:21 +01:00
Clément Renault	0ccf4cf785	Simplify the IndexDocuments builder creation from the UpdateBuilder	2020-11-01 17:31:20 +01:00
Clément Renault	600aa223c2	Fix a bug where generated docids were not saved when indexing JSON docs	2020-11-01 12:19:07 +01:00
Clément Renault	f0e63025b0	Update the Transform struct to support JSON stream updates	2020-11-01 12:19:06 +01:00
Kerollmops	6d52c5b2f0	Introduce a parameter to disable the engine to autogenerate docids	2020-10-31 21:46:55 +01:00
Clément Renault	21b4d60101	Add replace/update csv/json from the HTTP server	2020-10-31 20:52:49 +01:00
Clément Renault	a4f8be7811	Support numbers and boolean when indexing JSON	2020-10-31 20:52:49 +01:00
Clément Renault	f0d028d3a4	Update the Transform struct to support JSON updates	2020-10-31 20:52:49 +01:00
Clément Renault	9d47ee52b4	Generate a uuid v4 based document id when missing	2020-10-31 15:11:06 +01:00
Clément Renault	0d01e4854b	Add a test to check that merging works correctly with CSVs	2020-10-30 13:46:56 +01:00
Clément Renault	7cc1a358f5	Fix a documents indexing bug and add a test	2020-10-30 12:14:25 +01:00