Commit Graph

22 Commits

Author SHA1 Message Date
KevinVdV
808bc6fc5d [DS-1243] @mire solr statistics contribution 2012-09-25 15:58:23 +02:00
Andrea Bollini
4fc8b9348b DS-1217 Porting Discovery to the JSPUI
Contribution from CILEA funded by the Hub project from HKU
(http://hub.hku.hk)
Faceting, filtering (autocomplete), sidebar facet for the site home page,
community and collections are all implemented.
Changes to the Discovery API/configuration:
  1) changed the unique field for the SOLR document, now is used the
     concatenation of ID and TYPE-ID (in future we want to index also
     object that have not an handle)
  2) the prune query has been changed in search.resourcetype:[2 TO 4] so to          not remove eventually extra data loaded in the SOLR search core
  3) added defaultRpp parameter

Main differences from the XMLUI implementation:
  1) facets doesn't have a "...More" link but there are pagination to
     scroll facet in the context (search, home page, community, etc.)
  2) facets doesn't show the values already selected
  3) autocomplete is done against user input and does not dump all the
     values (this was a performance issue in XMLUI < 3.0, with 90k items
     I see JSON around 2Mb). With the new Discovery improvements the
     autocomplete feature in XMLUI seems to be turned off
  4) to enable JSPUI discovery you need to add some extra plugins in
     dspace.cfg (instructions are provided as comment in the discovery.cfg)
2012-09-13 12:31:23 +02:00
Andrea Bollini
8bb68ddc81 DS-1218 BrowseDAO based on discovery
This contribution is supported by the University of Hong Kong that has
    adopted the first version of this code since July 2010
    Software development by the CILEA SURplus Team (http://www.cilea.it)

    This is a full featured provider for the DSpace Browse System that read
    data from the Discovery Search SOLR core.
    The browse supports:
    - all the actual browse system configuration options (item and metadata
    browse, pagination, sorting)
    - browse of withdrawn items
    - browse of private items (XMLUI only)
    - search for authors used in the item mapper tool

    Major changes:
    - add two new search methods to the SearchService that allow you to
    specify if you want or not withdrawn items in your result. The old
    methods just call these new methods asking for no withdrawn item (this
    assure backcompatiliby)
    - the SearchServiceImpl now index also withdrawn item, new SolrDoc field
    "withdrawn"
    - DiscoverResult.Facet now keep information also about authority so
    that is possible distinct facets related to homonyms authors, etc.
    (this feature can be disabled in the discovery.cfg)
    - changed the schema.xml the default should be to ignore field if not
    otherwise specified (see also below)
    - better support for projection, metadata are stored (not indexed) with
    all related informations attached (authority, language). Metadata to
    store for projection can be defined in the discovery.cfg

    Other notes:
    - SolrBrowseDAO/SolrCreateBrowseDAO use settings defined in the main
    dspace.cfg (the browse section) this mean that sorting configuration is
    not related to the discovery search sorting etc.
    - Browse consumer should be disabled (if not only overhead but it still
    works), the actual index work is done using the Discovery "plugin"
    SolrServiceIndexPlugin (configurated via spring)
    - SolrCreateBrowseDAO is able to remove the old tables created by the
    DBMS DAO implementations simply using the browse command line script
    (dspace index -d -f)
    - to build the browse index it is required to run the discovery index
    client (dspace update-discovery-index -b)
2012-09-08 15:53:50 +02:00
Lyncode
2442601073 OAI 2.0 (a.k.a XOAI) integrated into DSpace 3.0 (squashed) 2012-09-03 10:38:09 +02:00
KevinVdV
bf34b21bcf [DS-1229] @mire discovery contribution 2012-08-07 09:47:21 +02:00
Ivan Masár
b8cefdce04 fix typos and some whitespace
* fixes typos almost exclusively in comments and strings
* fixes whitespace where combination of tabs and spaces may break indentation
* doesn't touch typos in config property names to prevent breakage
2012-04-20 16:27:02 +02:00
Kevin Van de Velde
f3e349d0b1 [DS-599] SOLR statistics file download displays only bitstreams in the configured bundles (ORIGINAL by default)
git-svn-id: http://scm.dspace.org/svn/repo/dspace/trunk@6788 9c30dcfa-912a-0410-8fc2-9e0234be79fd
2011-10-05 20:38:10 +00:00
Ben Bosman
823a4c48af [DSCR-25] Improved user interface for the discovery search page
git-svn-id: http://scm.dspace.org/svn/repo/dspace/trunk@6556 9c30dcfa-912a-0410-8fc2-9e0234be79fd
2011-08-18 08:57:02 +00:00
Ben Bosman
6d63e00c7c [DS-971] New Discovery configuration system
git-svn-id: http://scm.dspace.org/svn/repo/dspace/trunk@6549 9c30dcfa-912a-0410-8fc2-9e0234be79fd
2011-08-16 09:27:10 +00:00
Tim Donohue
8fcac3ab07 [DS-980] Upgraded solr & lucene to version 3.3.0 - second try (Thanks to Kevin Van de Velde who fixed the issues that caused massive Unit Testing failures. This new version of patch passes all Unit Tests.)
git-svn-id: http://scm.dspace.org/svn/repo/dspace/trunk@6548 9c30dcfa-912a-0410-8fc2-9e0234be79fd
2011-08-15 21:04:17 +00:00
Tim Donohue
bc1b7354ef Undoing commit r6545 (DS-980) as it seems to have broken 80% of Unit Tests. Will recommit once Unit Testing issues are resolved.
git-svn-id: http://scm.dspace.org/svn/repo/dspace/trunk@6546 9c30dcfa-912a-0410-8fc2-9e0234be79fd
2011-08-12 21:55:26 +00:00
Tim Donohue
e40a2c9441 [DS-980] Upgraded solr & lucene to version 3.3.0
git-svn-id: http://scm.dspace.org/svn/repo/dspace/trunk@6545 9c30dcfa-912a-0410-8fc2-9e0234be79fd
2011-08-12 19:49:34 +00:00
Mark Diggory
c13c6022e3 [DSCR-22] Discovery module back end rewrite to support discovery without solr.
git-svn-id: http://scm.dspace.org/svn/repo/dspace/trunk@6463 9c30dcfa-912a-0410-8fc2-9e0234be79fd
2011-07-13 23:20:42 +00:00
Mark Diggory
2550d5c22b [DSCR-19] Case sensitive sidebar facets
git-svn-id: http://scm.dspace.org/svn/repo/dspace/trunk@6139 9c30dcfa-912a-0410-8fc2-9e0234be79fd
2011-03-15 05:52:34 +00:00
Mark Diggory
e27e8cd393 [DSCR-18] Corrections to allow full text indexing provided by Kevin Van de Velde
git-svn-id: http://scm.dspace.org/svn/repo/dspace/trunk@6081 9c30dcfa-912a-0410-8fc2-9e0234be79fd
2011-02-17 16:13:19 +00:00
Mark Diggory
1c2cbb804d Make sure dc.creator is added to dc.contributor.author search index.
git-svn-id: http://scm.dspace.org/svn/repo/dspace/trunk@5763 9c30dcfa-912a-0410-8fc2-9e0234be79fd
2010-11-06 20:43:16 +00:00
Peter Dietz
1ce661dfe8 Changed search/discovery indexing to use solr autoCommit.
This uses less resources and is much faster than lock-stepping document add/update and commit. Added a commit to the end of the updateIndex so that all of the documents added are always committed before the operation finishes.
Issue #DS-615 - Ability to perform maintenance on SOLR with solr.optimize

git-svn-id: http://scm.dspace.org/svn/repo/dspace/trunk@5755 9c30dcfa-912a-0410-8fc2-9e0234be79fd
2010-11-06 00:03:01 +00:00
Ben Bosman
53084f0384 [DS-711] Discovery release for XMLUI
git-svn-id: http://scm.dspace.org/svn/repo/dspace/trunk@5529 9c30dcfa-912a-0410-8fc2-9e0234be79fd
2010-10-21 16:28:37 +00:00
Ben Bosman
36408e2cf8 [DS-615] Optimize solr performance with solr.optimize and autocommit
git-svn-id: http://scm.dspace.org/svn/repo/dspace/trunk@5443 9c30dcfa-912a-0410-8fc2-9e0234be79fd
2010-10-18 13:37:26 +00:00
Mark Diggory
73edd7a585 [DS-440] Adjust SolrLogger and rest of Statistics system to support processing multiple statistics files. Prempt logging spider IPs and prune spider IPs from Solr with utility methods.
git-svn-id: http://scm.dspace.org/svn/repo/dspace/trunk@4745 9c30dcfa-912a-0410-8fc2-9e0234be79fd
2010-02-07 17:44:17 +00:00
Mark Diggory
cfda8ac3a6 [DS-247] Additional Country and City Statistics. Externalize Strings.
git-svn-id: http://scm.dspace.org/svn/repo/dspace/trunk@4525 9c30dcfa-912a-0410-8fc2-9e0234be79fd
2009-11-16 20:45:29 +00:00
Mark Diggory
2d20e3b75b [DS-247] Add Solr statistics configuration and solr webapp overlay to trunk.
git-svn-id: http://scm.dspace.org/svn/repo/dspace/trunk@4359 9c30dcfa-912a-0410-8fc2-9e0234be79fd
2009-10-05 21:48:04 +00:00