Mark H. Wood 522c6fb696 [DS-2463] Escape pattern characters that are significant in regular expressions.

2015-10-18 11:01:21 -04:00

..

agents

[DS-2463] Escape pattern characters that are significant in regular expressions.

2015-10-18 11:01:21 -04:00

domains

DS-1841: adding example files for agent and domain-based spider filtering, borrowed from OSU Libraries, with much thanks

2013-12-12 23:17:52 +00:00

iplists.com-altavista.txt

[DS-440] Adjust SpiderDownloader to download multiple files in a "config/spiders" directory relative ${dspace.dir}

2010-02-07 16:42:56 +00:00

iplists.com-excite.txt

[DS-440] Adjust SpiderDownloader to download multiple files in a "config/spiders" directory relative ${dspace.dir}

2010-02-07 16:42:56 +00:00

iplists.com-google.txt

[DS-440] Adjust SpiderDownloader to download multiple files in a "config/spiders" directory relative ${dspace.dir}

2010-02-07 16:42:56 +00:00

iplists.com-infoseek.txt

[DS-440] Adjust SpiderDownloader to download multiple files in a "config/spiders" directory relative ${dspace.dir}

2010-02-07 16:42:56 +00:00

iplists.com-inktomi.txt

[DS-440] Adjust SpiderDownloader to download multiple files in a "config/spiders" directory relative ${dspace.dir}

2010-02-07 16:42:56 +00:00

iplists.com-lycos.txt

[DS-440] Adjust SpiderDownloader to download multiple files in a "config/spiders" directory relative ${dspace.dir}

2010-02-07 16:42:56 +00:00

iplists.com-misc.txt

[DS-440] Adjust SpiderDownloader to download multiple files in a "config/spiders" directory relative ${dspace.dir}

2010-02-07 16:42:56 +00:00