Commit Graph

186 Commits

Author SHA1 Message Date
jygaulier
b4066c6362 PHRAS-3645_candidates-special-chars (#4046)
PHRAS-3645 : fix : thesaurus indexation _before_ fetch record (prevents double-candidates)
PHRAS-3645 : fix : <term (context)> parsing in php (fix first special char)
2022-06-03 12:31:21 +02:00
Nicolas Maillat
bdcbd7c0e0 Revert " "PHRAS-3215 : Revert add ThumbnailOrientation facet ; add strings"" 2022-03-08 11:49:36 +01:00
Nicolas Maillat
ccd460be27 Revert "PHRAS-3215 : add ThumbnailOrientation facet ; add strings" 2022-02-25 23:10:23 +01:00
jygaulier
406a0ce953 PHRAS-3602 : add ThumbnailOrientation facet ; add strings 2022-02-25 10:11:49 +01:00
jygaulier
12cb9b582b PHRAS-3584
add databox.record.cover_record_id
add get/set coverRecordId() to record adapter
include cover_record_id to api results (V1 & V3)
2021-11-25 11:52:11 +01:00
jygaulier
00979f2d6d PHRAS-3389_use-only-conceptpaths-from-selected-dbs_MASTER
fix : fixed [] search (thesaurus) caused by bad thesaurus hydration during record indexing
2021-04-12 15:57:44 +02:00
jygaulier
63bee24775 PHRAS-3389_use-only-conceptpaths-from-selected-dbs_MASTER
fix : search only concept-paths from the relevant thesaurus
fix : search only fields from the relevant databoxes (collections)
2021-04-08 18:15:27 +02:00
jygaulier
0e7daab638 PHRAS-3412_bad-gps-crash-indexation_MASTER
fix : PHRAS-3412 fix warning
2021-04-01 15:47:09 +02:00
jygaulier
27433c769f PHRAS-3412_bad-gps-crash-indexation_MASTER
fix : PHRAS-3412 bad gps values are ignored
2021-04-01 15:45:40 +02:00
aina esokia
957f9712ad PHRAS-3279 2020-12-10 14:24:22 +03:00
aina esokia
36f2e1a640 PHRAS-3279 2020-12-09 17:13:32 +03:00
aina esokia
c1090021dd fix 2020-12-09 17:00:49 +03:00
aina esokia
f411c715e3 PHRAS-3279 add populate_permalinks key in configuration 2020-12-09 16:48:07 +03:00
jygaulier
889471a3ff add : don't create missing permalinks during indexation (PHRAS-3279) 2020-11-24 17:23:07 +01:00
Nicolas Maillat
7b25a719b7 PHRAS-3658 enabled path 2020-11-20 10:28:19 +01:00
jygaulier
a5b2a3cc14 add : permalinks are injected in es (PHRAS-3279) 2020-11-19 21:59:29 +01:00
jygaulier
5ae105d9c2 - fix : error during populate
- add : clear structure cache when structure (field or sb) is changed
2020-11-05 11:27:39 +01:00
jygaulier
7c01c34dfc - add timing debug, disable permalinks injection to es 2020-10-27 17:18:37 +01:00
jygaulier
c3ffbd2820 WIP / DEBUG
- ignore failing permalinks during es indexation
2020-10-21 20:31:20 +02:00
jygaulier
ff44cc379e WIP / DEBUG
- add every subdef in es document, including permalink
2020-10-21 20:07:11 +02:00
Jean-Yves Gaulier
9b202bea31 PHRAS-3023_slow-query-while-indexing_4.1
- fix break with "bin/developer phraseanet:regenerate-sqlite" due to column add in sql result
2020-04-09 21:47:22 +02:00
Jean-Yves Gaulier
ff41be7e0e PHRAS-3023_slow-query-while-indexing_4.1
- fix rid-list fetcher
2020-04-09 19:57:21 +02:00
Jean-Yves Gaulier
4350e0adf0 PHRAS-3023_slow-query-while-indexing_4.1
- fix php 7.2 only syntax
2020-04-09 19:46:25 +02:00
Jean-Yves Gaulier
e1a3535afa PHRAS-3023_slow-query-while-indexing_4.1
- revert php 7.2 only syntax
2020-04-09 19:23:17 +02:00
Jean-Yves Gaulier
cb6a781b02 PHRAS-3023_slow-query-while-indexing_4.1
- fix bound limit depending on order/direction options
- add index on dbox:record.moddate
2020-04-09 19:11:08 +02:00
Nicolas Maillat
45dfa8050f Merge branch 'master' into PHRAS-3015_sb31-crashes-indexer_4.1 2020-04-08 23:39:04 +02:00
Jean-Yves Gaulier
3b99f5bb50 PHRAS-3023_slow-query-while-indexing_4.1
fix : remove double where
2020-04-08 20:06:19 +02:00
Jean-Yves Gaulier
2b4accae91 PHRAS-3023_slow-query-while-indexing_4.1
fix : change fetcher query to paginate with record_id/count (not limit/count)
2020-04-08 19:50:57 +02:00
Jean-Yves Gaulier
662fe95712 PHRAS-3015_sb31-crashes-indexer_4.1
fix : set es:flags_bitfield as long (signed 64 bits)
2020-04-06 19:51:52 +02:00
Jean-Yves Gaulier
027f7e1571 PHRAS-3001_es-geopoint-sources_4.1
- fix : exif source is a fallback if no good values are found in the configured source field (or if conf is not set)
2020-03-31 17:54:22 +02:00
Jean-Yves Gaulier
9f216813b7 PHRAS-3001_es-geopoint-sources_4.1
- fix : follow the original conf structure (position-fields into provider)
- add : handles "latlng" format
2020-03-31 17:16:57 +02:00
Jean-Yves Gaulier
8ffeb58289 PHRAS-3001_es-geopoint-sources_4.1
WIP
- fix : gps position indexed by es now comes from the metadata fields defined in conf; (not from exif anymore).
- todo/wip : decide conf place, since today we only have an array of geo providers
- todo/wip : does exif apply as fallback if nothing in conf ? or if metadata not set in record ?
2020-03-29 20:11:03 +02:00
Jean-Yves Gaulier
cba5f8a1a2 PHRAS-2815_generate-cterms-multi-db_4.1
fix : the "generate cterms" setting is applied by db
how : the "global_structure" (fields merged) now also contains field settings by db
2019-11-07 17:24:57 +01:00
Jean-Yves Gaulier
21bb2ffae4 PHRAS-2808-2806_disable-cterms_mask-writable-fields_4.1
fix php syntax error during circleci test (ok on devjy ?)
todo : implement "gui_editable" in edit ux (hide field when =false)
todo : 2 new strings (ckbox labels) to trans
2019-11-04 10:35:16 +01:00
Jean-Yves Gaulier
b4e848a5e9 PHRAS-2808-2806_disable-cterms_mask-writable-fields_4.1
new : checkbox in admin/field to allow gui (prod) editing, default=checked.
rename "publish_cterms" to "generate_cterms"
todo : implement "gui_editable" in edit ux (hide field when =false)
todo : 2 new strings (ckbox labels) to trans
2019-10-31 19:31:12 +01:00
Jean-Yves Gaulier
ce13112105 PHRAS-2808_disable-cterms_4.1
new : checkbox in admin/field to disable cterms generation.
fix : when cterms is cleared (during reindex), rejected terms are kept
WIP
2019-10-31 18:12:26 +01:00
aynsix
bd53e98b0d port to 4.1 fix ES index NUL 2019-08-15 16:09:35 +04:00
Nicolas Maillat
71f0e676f9 PHRAS-2473 Populate improv, sql query optimization.
PHRAS-2473 Populate time improvement with a sql query optimization
2019-03-18 15:08:16 +01:00
jygaulier
cbed6488c6 PHRAS-2126_Array-to-String-err-idx_4.1 (#2658)
* PHRAS-2126_Array-to-String-err-idx_4.1
fix : es error message during indexation is now dumped (not always a string)
fix : es file "size" is now type "long"

* PHRAS-2126_Array-to-String-err-idx_4.1
fix : bad gps coordinate are ignored by es indexation.

* PHRAS-2126_Array-to-String-err-idx_4.1
fix : gps coordinate can de negative.
2018-07-03 17:32:22 +02:00
jygaulier
88035173c5 PHRAS-2126_Array-to-String-err-idx_4.1 (#2656)
fix : es error message during indexation is now dumped (not always a string)
fix : es file "size" is now type "long"
2018-07-02 18:41:40 +02:00
aina-esokia
c905ca303f use composite position 2018-05-03 17:25:37 +04:00
Jean-Yves Gaulier
3f785e7ba3 PHRAS-483_SHA-UID_master
add index (not analysed) & search on fields "sha256" and "uuid"
e.g. : uuid:"4d006e01-bc38-4aac-9a5b-2c90ffe3a8a2"
e.g. : sha256:a7f3ec01c4c5efcadc639d494d432006f13b28b9a576afaee4d3b7508c4be074
2018-04-26 17:35:01 +02:00
Nicolas Maillat
47c897b420 PHRAS-1809 2018-04-18 20:16:22 +02:00
Jean-Yves Gaulier
4164b6dd42 PHRAS-1809_Geoinfos-in-index
Add a "location" field in records (type="geo_point"), populated with same values as "Longitude" and "Latitude" technical fields.
2018-04-18 18:06:31 +02:00
aynsix
30755e9c46 PHRAS-1840-FIX-searchengine:index -p (#2456)
* FIX searchengine:index -p populate

* delete character nul of the metadata value
2018-02-06 14:21:25 +01:00
aynsix
df85aa8827 PHRAS-1797 porting searchengine:index to 4.1 (#2454)
* portage commande searchengine:index vers 4.1

* FIX Indexer

* Update DataboxFetcherFactory.php
2018-01-30 18:50:57 +01:00
jygaulier
a70bf2fc70 PHRAS-1304_AUTO-COMPLETION_MASTER (#2061)
* PHRAS-1304_AUTO-COMPLETION_MASTER
ported from 4.0

* PHRAS-1304_AUTO-COMPLETION_MASTER
fix

* PHRAS-1304_AUTO-COMPLETION_MASTER
fix

* PHRAS-1304_AUTO-COMPLETION_MASTER
bump php version to 5.5.31 (5.5.21 is obsolete in cicleci)

* PHRAS-1304_AUTO-COMPLETION_MASTER
bump php version to 5.5.31 : php.ini moved in circelci

* PHRAS-1304_AUTO-COMPLETION_MASTER
add zmq & date to php for circleci

* PHRAS-1304_AUTO-COMPLETION_MASTER
add zmq

* PHRAS-1304_AUTO-COMPLETION_MASTER
bump amqp

* PHRAS-1304_AUTO-COMPLETION_MASTER
downgrade amqp to 1.2 to test compilation against old librabbit 0.4 (ubuntu)

* PHRAS-1304_AUTO-COMPLETION_MASTER
add amqp.so to php.ini, (re)bump amqp to 1.6

* PHRAS-1304_AUTO-COMPLETION_MASTER
build rabittmq from git

* PHRAS-1304_AUTO-COMPLETION_MASTER
build rabittmq from git again

* PHRAS-1304_AUTO-COMPLETION_MASTER
build rabittmq from git again and again

* PHRAS-1304_AUTO-COMPLETION_MASTER
fix test on media rotation 600*400 -> 400*599 !!!

* PHRAS-1304_AUTO-COMPLETION_MASTER
restore facebook sdk to 4.0.1 due to mistake

* PHRAS-1304_AUTO-COMPLETION_MASTER
deleted unwanted file
2017-02-06 18:26:56 +01:00
Thibaud Fabre
97f2e66698 Merge 4.0 branch 2016-12-05 17:04:54 +01:00
Thibaud Fabre
b5bbb1851f Merge branch 4.0 2016-12-05 15:26:48 +01:00
Jean-Yves Gaulier
229c80fe74 PHRAS-1260_INDEX-WIDTH-HEIGHT
- new : added size (filesize) of document to es
 - new : methods getWidth(),... to record_adapter
 - fix : template
2016-11-03 15:27:57 +01:00