[DS-1231] Indexing both stored and display-value from input-forms for search
Squashed commit of the following:
commit 426db183fc
Merge: b05c6a38334fce
Author: kstamatis <kstamatis@ekt.gr>
Date: Sat Sep 15 08:52:12 2012 -0700
Merge pull request #2 from abollini/DS-1231
Ds 1231
commit 8334fceed0
Author: Andrea Bollini <bollini@cilea.it>
Date: Sat Sep 15 17:31:08 2012 +0200
Use the default input set if the item is not yet archived
commit c6be362592
Author: Andrea Bollini <bollini@cilea.it>
Date: Sat Sep 15 17:23:48 2012 +0200
Minor changes
Code formatted using the dspace style eclipse formatter
No store values in the index as the lucene projection is not currently used
use generics to avoid raw type warning
commit 6e6933d174
Merge: 3b1cc06b05c6a3
Author: Andrea Bollini <bollini@cilea.it>
Date: Sat Sep 15 16:19:20 2012 +0200
Merge remote-tracking branch 'EKT/DS-1231' into DS-1231
commit b05c6a3288
Author: Rania Stathopoulou <iostath@ekt.gr>
Date: Fri Sep 14 19:49:27 2012 +0300
Search indexing all values (now getControlledVocabulariesDisplayValueLocalized returns a list of all the values and the DSIndexer manages these values)
A return statement is added if the item has no collection
commit 33da186e6c
Author: Rania Stathopoulou <iostath@ekt.gr>
Date: Thu Sep 13 11:19:56 2012 +0300
Code Indentation
commit c31651bdd8
Author: Rania Stathopoulou <iostath@ekt.gr>
Date: Tue Sep 11 11:54:43 2012 +0300
Code changed in order to index both stored and display-value for all localized input-forms if the user specifies 'inputform' in Search Index Configuration of dspace.cfg, e.g: search.index.12 = language:dc.language:inputform
commit d278958c22
Author: Rania Stathopoulou <iostath@ekt.gr>
Date: Fri Sep 7 12:19:25 2012 +0300
Package name 'gr.ekt.repositories.dspace.utils' removed.
All functions in gr.ekt.repositories.dspace.utils.Utilities.java were transfered in org.dspace.app.util.Util.java
Documentation added for the above functions
commit 8135fd4eb7
Author: EKT <iostath@ekt.gr>
Date: Wed Aug 8 18:40:40 2012 +0300
Unthrown exceptions added
commit fa8796bfeb
Author: EKT <iostath@ekt.gr>
Date: Wed Aug 8 17:06:20 2012 +0300
Indexing both stored and display-value from input-forms for search
Hierarchical LDAP originally assumed that when search.user is not
set, anonymous search is performed. We now assume that if it's
not set, simple LDAP authentication is performed. That retains
configuration backward comaptibility for the two most common cases.
The special case of anonymous search now requires search.anonymous
to be set to true, which means old installations using this setup
will have to add this config property.
Thanks to the previously merged DS-1180, the LDAPHierarchicalAuthentication
method gaind the capabilities of LDAPAuthentication. This commit renames
LDAPHierarchicalAuthentication to LDAPAuthentication and removes the
original LDAPAuthentication.
Copied in Implementation of Elastic Search, and wired it into DSpace.
I changed the ES Node to be a nodeClient, and also one that runs locally
within tomcat's JVM. For OSU, we had used either transport-client, or
node-client, and both of which required that the server also be running a
seperate elastic search instance. By bundling this into DSpace, it should
make this a bit more turn-key to get started using Elastic Search.
By default, Elastic Search is ON with this commit.
[DS-1244] XMLUI's OpenSearch implementation refactored to work with Discovery
Squashed commit of the following:
commit 1268c9af08018afb46d213910d8a96c79d20715c
Author: Andrea Bollini <bollini@cilea.it>
Date: Fri Sep 14 16:11:02 2012 +0200
Fix JSPUI side to work with new classes
also included some bug fix about I18N access in Open Search for JSPUI
commit 885012fcf32943dc1ce2ac7f35bb3810f70363aa
Merge: 12b4d6bd8b1b4c
Author: Andrea Bollini <bollini@cilea.it>
Date: Fri Sep 14 15:28:09 2012 +0200
Merge remote-tracking branch 'sedici/open-search-discovery' into DS-1244
commit d8b1b4ccfe
Merge: 53ad4e358fe789
Author: Nestor Oviedo <nestor@pc-nestor.(none)>
Date: Thu Sep 13 13:50:03 2012 -0300
Merge remote-tracking branch 'origin/open-search-discovery' into open-search-discovery
Conflicts:
dspace-jspui/dspace-jspui-api/src/main/java/org/dspace/app/webui/servlet/OpenSearchServlet.java
Rebase with 7bc92a81ca
Conflict on dspace-jspui/dspace-jspui-api/src/main/java/org/dspace/app/webui/servlet/OpenSearchServlet.java resolved: new version preserved
commit 53ad4e36c6
Author: nestor <nestor@pc-nestor>
Date: Thu Sep 13 10:27:32 2012 -0300
Added license header to DiscoveryOpenSearchGenerator
commit bdb22e0aba
Author: nestor <nestor@pc-nestor>
Date: Thu Sep 6 13:36:01 2012 -0300
DS-1244 - XMLUI's OpenSearch implementation refactored.
It's in order to use either PostgreSQL's indexes or Discovery services
based on the requested URL
commit 58fe789f80
Author: nestor <nestor@pc-nestor>
Date: Thu Sep 13 10:27:32 2012 -0300
Added license header to DiscoveryOpenSearchGenerator
commit efbf7d2126
Author: nestor <nestor@pc-nestor>
Date: Thu Sep 6 13:36:01 2012 -0300
DS-1244 - XMLUI's OpenSearch implementation refactored.
It's in order to use either PostgreSQL's indexes or Discovery services
based on the requested URL
DS-1236 Auto update advance search drop down lists from configuration file
Squashed commit of the following:
commit 612ac62f740fc26cd10d8a338db3537c49b3d4bd
Author: Andrea Bollini <bollini@cilea.it>
Date: Fri Sep 14 10:38:05 2012 +0200
I18N fix, improved configuration and code readability
included the default index in the configuration
refactored the jsp to reduce code for backward compatibility
fixed messages.properties key to use a common strategy to derive it
from the search index
commit 81b3da293e
Author: EKT <kstamatis@ekt.gr>
Date: Fri Sep 14 08:43:33 2012 +0300
Conflicts:
dspace/config/dspace.cfg
Contribution from CILEA funded by the Hub project from HKU
(http://hub.hku.hk)
Faceting, filtering (autocomplete), sidebar facet for the site home page,
community and collections are all implemented.
Changes to the Discovery API/configuration:
1) changed the unique field for the SOLR document, now is used the
concatenation of ID and TYPE-ID (in future we want to index also
object that have not an handle)
2) the prune query has been changed in search.resourcetype:[2 TO 4] so to not remove eventually extra data loaded in the SOLR search core
3) added defaultRpp parameter
Main differences from the XMLUI implementation:
1) facets doesn't have a "...More" link but there are pagination to
scroll facet in the context (search, home page, community, etc.)
2) facets doesn't show the values already selected
3) autocomplete is done against user input and does not dump all the
values (this was a performance issue in XMLUI < 3.0, with 90k items
I see JSON around 2Mb). With the new Discovery improvements the
autocomplete feature in XMLUI seems to be turned off
4) to enable JSPUI discovery you need to add some extra plugins in
dspace.cfg (instructions are provided as comment in the discovery.cfg)
This contribution is supported by the University of Hong Kong that has
adopted the first version of this code since July 2010
Software development by the CILEA SURplus Team (http://www.cilea.it)
This is a full featured provider for the DSpace Browse System that read
data from the Discovery Search SOLR core.
The browse supports:
- all the actual browse system configuration options (item and metadata
browse, pagination, sorting)
- browse of withdrawn items
- browse of private items (XMLUI only)
- search for authors used in the item mapper tool
Major changes:
- add two new search methods to the SearchService that allow you to
specify if you want or not withdrawn items in your result. The old
methods just call these new methods asking for no withdrawn item (this
assure backcompatiliby)
- the SearchServiceImpl now index also withdrawn item, new SolrDoc field
"withdrawn"
- DiscoverResult.Facet now keep information also about authority so
that is possible distinct facets related to homonyms authors, etc.
(this feature can be disabled in the discovery.cfg)
- changed the schema.xml the default should be to ignore field if not
otherwise specified (see also below)
- better support for projection, metadata are stored (not indexed) with
all related informations attached (authority, language). Metadata to
store for projection can be defined in the discovery.cfg
Other notes:
- SolrBrowseDAO/SolrCreateBrowseDAO use settings defined in the main
dspace.cfg (the browse section) this mean that sorting configuration is
not related to the discovery search sorting etc.
- Browse consumer should be disabled (if not only overhead but it still
works), the actual index work is done using the Discovery "plugin"
SolrServiceIndexPlugin (configurated via spring)
- SolrCreateBrowseDAO is able to remove the old tables created by the
DBMS DAO implementations simply using the browse command line script
(dspace index -d -f)
- to build the browse index it is required to run the discovery index
client (dspace update-discovery-index -b)
