jygaulier
53e116cf4f
fix : conf:max_result_window (es) is now used when creating index by searchengine
2020-11-13 10:10:35 +01:00
jygaulier
e36b0785ee
- add some simple cache
...
- disable check of conf/searchengine/type
- faster construction of concept-paths
- pass strucure to es as factory (useless, to be reverted)
- add stopwatch (log into file, disabled for now)
2020-10-30 11:00:17 +01:00
aynsix
df85aa8827
PHRAS-1797 porting searchengine:index to 4.1 ( #2454 )
...
* portage commande searchengine:index vers 4.1
* FIX Indexer
* Update DataboxFetcherFactory.php
2018-01-30 18:50:57 +01:00
Mike Ng
071ce25b31
porting PHRAS-1578/PHRAS-1579/PHRAS-1621/PHRAS-1675/PHRAS-1404/PHRAS-1336 to 4.1
2018-01-03 15:26:43 +04:00
Thibaud Fabre
97f2e66698
Merge 4.0 branch
2016-12-05 17:04:54 +01:00
Thibaud Fabre
b5bbb1851f
Merge branch 4.0
2016-12-05 15:26:48 +01:00
Jean-Yves Gaulier
75a44812d6
PHRAS-828_CTERMS-NOT-PURGED
...
- fix : cterms are cleared before reindexation (admin button) or populate (cli) ; terms in "stock" are preserved.
nb.: rejected terms (red) are also purged so a term may pop-up again as candidate even if it had been rejected before.
2016-11-07 18:38:51 +01:00
Thibaud Fabre
899188d970
Export mapping as array to create it
2016-10-19 13:31:17 +02:00
Thibaud Fabre
c133b42716
Refactoring
...
- Split search engine service registration into sub-methods
- Remove unused properties
- Fix coding style
2016-10-19 13:31:17 +02:00
Thibaud Fabre
6e88b97c55
Extract record index and term index from respective indexers
2016-10-19 13:31:16 +02:00
Thibaud Fabre
246503ee42
Extract index data structure from indexer
2016-10-19 13:29:54 +02:00
Thibaud Fabre
79a9411923
Code architecture
...
- Remove circular dependency between indexer and record indexer
- Restore interface type hints on indexer methods
2016-10-18 21:17:38 +02:00
Jean-Yves Gaulier
cf40c99ea7
PHRAS-714_thesaurus_indexation
...
- new : if the thesaurus has been modified since it's last indexation, it will be re-indexed as soon a record is to be indexed.
- nb : after thesaurus modification, the databox MUST be manually re-indexed (which will reindex the thesaurus before)
- todo : remove useless dialog boxes from thesaurus app (... "this term was..." "...add with/out reindexing ?..."). To be done in the future app using future routes.
2016-10-12 18:42:16 +02:00
Thibaud Fabre
8cef133413
Leave shard refresh interval alone
2016-03-08 17:53:28 +01:00
Benoît Burnichon
8a907e9bb0
Add touch capability to record_adapter.
2016-02-23 10:40:01 +01:00
Jean-Yves Gaulier
9a9ce70aa6
#PHRAS-882 time 3h
...
the checkbox "can be indexed" works (only for index-task) : even if the databox is disabled for indexation via the task, real-time indexation & populate command still works
2015-12-22 18:10:39 +01:00
Benoît Burnichon
eebba1d2a5
Merge pull request #1499 from mdarse/PHRAS-368-thesaurus-event-handling
...
Handle thesaurus events & update index
2015-09-28 09:52:09 +02:00
Jean-Yves Gaulier
5146881076
PHRAS-716 #time 3d
...
fix : admin/base progress bar (indexation)
fix : reindex button
fix : indexation does not skip records between fetches
2015-09-17 11:03:42 +02:00
Mathieu Darse
8262e245de
Handle thesaurus events & update index
2015-09-08 14:45:12 +02:00
Benoît Burnichon
dbb33c85b9
Rename GlobalElasticOptions ElasticsearchOptions
2015-07-02 12:27:25 +02:00
Benoît Burnichon
28fee99fc4
Add Form for ElasticSearch Configuration.
...
Also changed type from array to Options object.
2015-06-29 17:10:32 +02:00
Mathieu Darse
a74428c8ea
Empty indexer queues after flushing to index
2015-06-22 14:09:41 +02:00
Mathieu Darse
f2f29c4290
Command to update index mapping
2015-03-23 19:12:59 +01:00
Benoît Burnichon
6c825f4582
Add logger to Elastic SearchEngine
2015-03-16 13:52:28 +01:00
Mathieu Darse
71c7fd8adb
Enhance thesaurus strict mode
2015-03-12 19:13:13 +01:00
Benoît Burnichon
118bb2f03c
Some fixup for ES instance
2015-03-11 15:22:20 +01:00
Mathieu Darse
5d3f8b3123
Merge pull request #35 from nlegoff/poplate-by-database
...
Add possibilty to explicitely set database to populate
2015-03-10 11:55:10 +01:00
Mathieu Darse
e889d19b7d
Filter databoxes earlier (in Indexer) and databox id error handling
2015-03-10 11:52:30 +01:00
Mathieu Darse
c917c7f952
Thesaurus matching while indexing records
...
- Add a new hydrator to ask query thesaurus on the fly
- Add a filtering system on thesaurus
- And a databox filter friend
2015-03-03 18:50:34 +01:00
Nicolas Le Goff
4daf40029a
Add possibilty to explicitely set database to populate
2015-02-27 16:23:26 +01:00
Mathieu Darse
339605167c
Ability to only populate thesaurus or records index
2015-02-26 13:54:00 +01:00
Mathieu Darse
733bdeb05d
More imperative style indexer methods
2015-02-18 18:58:45 +01:00
Mathieu Darse
2faec3686e
Refactor indexer job
2015-02-18 18:58:19 +01:00
Mathieu Darse
9dc653c543
Move bulk operation into indexer namespace
2015-02-18 12:19:10 +01:00
Mathieu Darse
cf33a25444
Fix indexing queues not being flushed
2015-02-18 11:56:15 +01:00
Mathieu Darse
f422902887
Refactor record fetching
...
- Extract hydration responsibility into other specialized objects
- Delegate queries to FetcherDelegateInterface to keep a single fetcher
- Fix RecordDeletedEvent crashing
2015-02-17 18:38:17 +01:00
Mathieu Darse
a0dad0e96e
WIP on reindexing events handling
2015-02-04 19:53:35 +01:00
Nicolas Le Goff
a01bf29c5b
Add elasticsearch reindex events
2015-01-26 16:04:23 +01:00
Damien Alexandre
3438295ca3
Remove serializer from dependencies and fix index time display
2014-10-14 16:27:41 +02:00
Damien Alexandre
fe2e694216
Add stopwatch listener to monitor populate time
2014-10-06 15:49:33 +02:00
Damien Alexandre
48928b60c2
PHRAS-302 Add concept path to records
2014-10-06 13:56:51 +02:00
Mathieu Darse
bc22dfcd6d
WIP Thesaurus terms linking
2014-09-22 10:17:53 +02:00
Mathieu Darse
c3e2c25787
Thesaurus terms indexing
2014-09-16 16:13:17 +02:00
Mathieu Darse
285826eb87
Use DI for indexer & share bulk operation
2014-09-10 17:34:15 +02:00
Damien Alexandre
775ce804e0
Refactor RecordIndexer for speed optims, fix lot's of stuffs
2014-09-09 16:48:02 +02:00
Damien Alexandre
3635df7337
Apply fix after code review, thx mat!
2014-09-09 14:06:05 +02:00
Damien Alexandre
d532d5fb72
Refactoring, add a RecordIndexer, more indexing logic, ping @mdarse
2014-09-09 12:05:37 +02:00
Damien Alexandre
6abcd8448c
Rename the created_at field to fit the search engine expected name
2014-09-08 16:42:37 +02:00
Damien Alexandre
f535aaf3ad
Add elision on french tokenizer and fix missed config
2014-09-08 15:50:47 +02:00
Damien Alexandre
c488e259f4
Fix the refresh interval not resseting to the original value
2014-09-08 14:47:46 +02:00
