Commit Graph

723 Commits

Author SHA1 Message Date
Jean-Yves Gaulier
9b202bea31 PHRAS-3023_slow-query-while-indexing_4.1
- fix break with "bin/developer phraseanet:regenerate-sqlite" due to column add in sql result
2020-04-09 21:47:22 +02:00
Jean-Yves Gaulier
ff41be7e0e PHRAS-3023_slow-query-while-indexing_4.1
- fix rid-list fetcher
2020-04-09 19:57:21 +02:00
Jean-Yves Gaulier
4350e0adf0 PHRAS-3023_slow-query-while-indexing_4.1
- fix php 7.2 only syntax
2020-04-09 19:46:25 +02:00
Jean-Yves Gaulier
e1a3535afa PHRAS-3023_slow-query-while-indexing_4.1
- revert php 7.2 only syntax
2020-04-09 19:23:17 +02:00
Jean-Yves Gaulier
cb6a781b02 PHRAS-3023_slow-query-while-indexing_4.1
- fix bound limit depending on order/direction options
- add index on dbox:record.moddate
2020-04-09 19:11:08 +02:00
Nicolas Maillat
45dfa8050f Merge branch 'master' into PHRAS-3015_sb31-crashes-indexer_4.1 2020-04-08 23:39:04 +02:00
Jean-Yves Gaulier
3b99f5bb50 PHRAS-3023_slow-query-while-indexing_4.1
fix : remove double where
2020-04-08 20:06:19 +02:00
Jean-Yves Gaulier
2b4accae91 PHRAS-3023_slow-query-while-indexing_4.1
fix : change fetcher query to paginate with record_id/count (not limit/count)
2020-04-08 19:50:57 +02:00
Jean-Yves Gaulier
662fe95712 PHRAS-3015_sb31-crashes-indexer_4.1
fix : set es:flags_bitfield as long (signed 64 bits)
2020-04-06 19:51:52 +02:00
jygaulier
5df663cad2 Merge branch 'master' into PHRAS-3001_es-geopoint-sources_4.1 2020-03-31 17:54:55 +02:00
Jean-Yves Gaulier
027f7e1571 PHRAS-3001_es-geopoint-sources_4.1
- fix : exif source is a fallback if no good values are found in the configured source field (or if conf is not set)
2020-03-31 17:54:22 +02:00
Jean-Yves Gaulier
9f216813b7 PHRAS-3001_es-geopoint-sources_4.1
- fix : follow the original conf structure (position-fields into provider)
- add : handles "latlng" format
2020-03-31 17:16:57 +02:00
Jean-Yves Gaulier
40b9a7cd0c PHRAS-3003_large-value-32ko_es_4.1
- fix (temporary ?) : text values are kept full in metadata table, but truncated to 32Ko by indexer.
2020-03-30 15:46:04 +02:00
Jean-Yves Gaulier
8ffeb58289 PHRAS-3001_es-geopoint-sources_4.1
WIP
- fix : gps position indexed by es now comes from the metadata fields defined in conf; (not from exif anymore).
- todo/wip : decide conf place, since today we only have an array of geo providers
- todo/wip : does exif apply as fallback if nothing in conf ? or if metadata not set in record ?
2020-03-29 20:11:03 +02:00
Jean-Yves Gaulier
722b1e3750 include Harrys's new templates
fix form restore
fix Version
2020-02-17 20:17:08 +01:00
Jean-Yves Gaulier
4f7be4c0a9 fix bad merge happened cause last rebase (?) 2020-02-17 20:17:08 +01:00
Jean-Yves Gaulier
eeec1ab716 save facets following the order of the admin form. 2020-02-17 20:17:08 +01:00
Jean-Yves Gaulier
3b8d75d39d fix : tech facets did appear twice. 2020-02-17 20:17:08 +01:00
Jean-Yves Gaulier
b1b35cc92b fix malformed query on tech fields ('_' in query) 2020-02-17 20:17:08 +01:00
Jean-Yves Gaulier
20839f1dd7 return facets following the order defined in conf. 2020-02-17 20:17:08 +01:00
Jean-Yves Gaulier
53f17e1897 save modifications in conf, and also write back to databoxes 2020-02-17 20:17:08 +01:00
Jean-Yves Gaulier
8171b7c1f1 PHRAS-2879_facet-order_4.1
fix setup:install (cont' 2)
2020-02-17 20:17:08 +01:00
Jean-Yves Gaulier
4305441a03 PHRAS-2879_facet-order_4.1
fix setup:install (cont')
2020-02-17 20:17:08 +01:00
Jean-Yves Gaulier
6838198a69 PHRAS-2879_facet-order_4.1
fix setup:install.
2020-02-17 20:17:08 +01:00
Jean-Yves Gaulier
2ccdcfed27 PHRAS-2879_facet-order_4.1
save all facet settings in conf, order is preserved in admin/search-engine-settings.
todo : ux to re-order facets
todo : return facets into query results in this setting order.
todo : migration from dbox settings (field struct) to conf ; remove field setting from admin
2020-02-17 20:17:08 +01:00
jygaulier
a2b2658c04 Merge branch 'master' into PHRAS-2831_port-truncation_4.1 2019-11-19 17:34:45 +01:00
Jean-Yves Gaulier
3145049247 PHRAS-2831_port-truncation_4.1
copy elastic/truncation code from 4.0
nb: from already exists
2019-11-19 16:45:46 +01:00
Harrys Ravalomanana
5e4da5f28f PHRAS-2805 #comment Port41 of Facet-case-sensibility 2019-11-14 15:02:04 +04:00
Nicolas Maillat
8279fb64ec Merge branch 'master' into PHRAS-2815_generate-cterms-multi-db_4.1 2019-11-08 17:37:17 +01:00
Jean-Yves Gaulier
cba5f8a1a2 PHRAS-2815_generate-cterms-multi-db_4.1
fix : the "generate cterms" setting is applied by db
how : the "global_structure" (fields merged) now also contains field settings by db
2019-11-07 17:24:57 +01:00
Jean-Yves Gaulier
da532cc36a PHRAS-2748_bad-chars-cterms_4.1
fix : remove bad ascii chars (0...31 except tab; cr; lf) from cterms values
todo ? : also cleanup bad chars from prod/editing and api/editing ?
2019-11-05 17:59:03 +01:00
Nicolas Maillat
d36517982c Merge branch 'master' into PHRAS-2785_facets_on_date_restitued_in_wicked_way 2019-11-05 12:14:41 +01:00
Jean-Yves Gaulier
21bb2ffae4 PHRAS-2808-2806_disable-cterms_mask-writable-fields_4.1
fix php syntax error during circleci test (ok on devjy ?)
todo : implement "gui_editable" in edit ux (hide field when =false)
todo : 2 new strings (ckbox labels) to trans
2019-11-04 10:35:16 +01:00
Jean-Yves Gaulier
b4e848a5e9 PHRAS-2808-2806_disable-cterms_mask-writable-fields_4.1
new : checkbox in admin/field to allow gui (prod) editing, default=checked.
rename "publish_cterms" to "generate_cterms"
todo : implement "gui_editable" in edit ux (hide field when =false)
todo : 2 new strings (ckbox labels) to trans
2019-10-31 19:31:12 +01:00
Jean-Yves Gaulier
ce13112105 PHRAS-2808_disable-cterms_4.1
new : checkbox in admin/field to disable cterms generation.
fix : when cterms is cleared (during reindex), rejected terms are kept
WIP
2019-10-31 18:12:26 +01:00
Nicolas Maillat
8551469c1f Merge branch 'master' into PHRAS-2785_facets_on_date_restitued_in_wicked_way 2019-10-09 10:52:03 +02:00
Jean-Yves Gaulier
a4631cb434 PHRAS-2751_geoloc-search-403err_master
fix : geoloc search should work again (missed method during PHRAS-2707)
2019-10-08 15:30:19 +02:00
Harrys Ravalomanana
ce67d5f62d PHRAS-2785 #comment Port41 of PHRAS-2758 #time 1h 2019-10-08 16:40:07 +04:00
jygaulier
321e81a0e1 Merge pull request #3143 from aynsix/PHRAS-2707-port-date-with-times
PHRAS-2707 : Port to 4.1 - ES - date format timestamp unix,  stocker/rechercher les dates phraseanet avec heure minutes secondes
2019-08-24 09:07:44 +02:00
aynsix
bd53e98b0d port to 4.1 fix ES index NUL 2019-08-15 16:09:35 +04:00
aynsix
20076df3f8 port to 4.1 date with time on phraseanet 2019-08-15 15:23:03 +04:00
aina-esokia
47d974a466 PHRAS-2497 #comment port to 4.1 Search issue when query mix data from Public and Private field
#time 2h
2019-04-23 12:10:25 +04:00
aina-esokia
eaf8cf076a port to 4.1 search mix type 2019-03-22 12:04:42 +04:00
Nicolas Maillat
71f0e676f9 PHRAS-2473 Populate improv, sql query optimization.
PHRAS-2473 Populate time improvement with a sql query optimization
2019-03-18 15:08:16 +01:00
aina-esokia
d2bdd2ed4a port 4.1: migrate field type text to string 2019-01-11 14:45:33 +04:00
Nicolas Maillat
0be1f5d140 PHRAS-2372 strict thesaurus search when indexing 2019-01-09 17:00:06 +01:00
jygaulier
e2f5afc07b PHRAS-2292_aggregates-as-new-json_MASTER (#2829)
* PHRAS-2292_aggregates-as-new-json_MASTER
wip

* PHRAS-2292_aggregates-as-new-json_MASTER

* PHRAS-2292_aggregates-as-new-json_MASTER
fake commit to test circle (did not run on last commit !)
2018-11-27 10:25:28 +01:00
aina-esokia
2eeb1721e9 port to 4.1 PHRAS-1831 2018-11-05 15:02:55 +04:00
jygaulier
cbed6488c6 PHRAS-2126_Array-to-String-err-idx_4.1 (#2658)
* PHRAS-2126_Array-to-String-err-idx_4.1
fix : es error message during indexation is now dumped (not always a string)
fix : es file "size" is now type "long"

* PHRAS-2126_Array-to-String-err-idx_4.1
fix : bad gps coordinate are ignored by es indexation.

* PHRAS-2126_Array-to-String-err-idx_4.1
fix : gps coordinate can de negative.
2018-07-03 17:32:22 +02:00
jygaulier
88035173c5 PHRAS-2126_Array-to-String-err-idx_4.1 (#2656)
fix : es error message during indexation is now dumped (not always a string)
fix : es file "size" is now type "long"
2018-07-02 18:41:40 +02:00