Files
DSpace/dspace/config/spiders/agents/iplists.com-non_engines

55 lines
1.9 KiB
Plaintext

ia_archiver
http://www\.almaden\.ibm\.com/cs/crawler
dtSearchSpider
Mozilla/4\.7 \(compatible; http://eidetica\.com/spider\)
e-SocietyRobot(http://www\.yama\.info\.waseda\.ac\.jp/~yamana/es/)
Mozilla/4\.0 \(fantomBrowser\)
Mozilla/4\.0 \(stealthBrowser\)
Mozilla/4\.0 \(cloakBrowser\)
Mozilla/4\.0 \(fantomCrew Browser\)
multiBlocker browser - IP blocker for Spam, Fraud \+ Snoop Protection
multiBlocker browser
Mozilla/4\.0 (compatible; MSIE 5\.0; Windows NT; Girafabot; girafabot at girafa dot com; http://www\.girafa\.com)
Googlebot/2\.1 \(\+http://www\.googlebot\.com/bot\.html\)
Mozilla/4\.0 \(compatible; MSIE 6\.0; Googlebot/2\.1 \(\+http://www\.googlebot\.com/bot\.html\); \.NET CLR 1\.0\.3705\)
IncyWincy data gatherer\(webmaster@loopimprovements\.com,http://www\.loopimprovements\.com/robot\.html\)
Mozilla/3\.0 \(compatible; Indy Library\)
Sqworm/2\.9\.72-BETA \(beta_release; 20010821-737; i686-pc-linux-gnu\)
larbin
Mozilla/4\.7 \(compatible; Intelliseek; http://www\.intelliseek\.com\)
sitecheck\.internetseer\.com
LNSpiderguy
LinkWalker
Lite Bot 0916b
MarkWatch/1\.0
flunky
Microsoft URL Control - 5\.01\.4319
NAMEPROTECT
RPT-HTTPClient/0\.3-3
NPBot-1/2\.0 (http://www\.nameprotect\.com/botinfo\.html)
aipbot/1\.0 \(aipbot; http://www\.aipbot\.com; aipbot@aipbot\.com\)
NetMechanic V2\.0
WebFilter Robot 1\.0
PicaLoader 1\.0
Robozilla/1\.0
RPT-HTTPClient/0\.3-3
ScoutAbout
TurnitinBot/1\.4 http://www\.turnitin\.com/robot/crawlerinfo\.html
SlySearch
WebZIP/4\.0 \(http://www\.spidersoft\.com\)
Teleport Pro/1\.28
(Teradex Mapper; mapper@teradex\.com; http://www\.teradex\.com)
tivraSpider/1\.0 (crawler@tivra\.com)
UbiCrawler/v0\.3beta \(http://ubi\.imc\.pi\.cnr\.it/projects/ubicrawler/\)
Webclipping\.com
webrank
websquash\.com \( Add Url Robot \)
lwp-trivial/1\.34
AESOP_com_SpiderMan
ozilla/4\.7 \(compatible; Whizbang\)
TECOMAC-Crawler/0\.3
X-Crawler
cosmos/0\.8\)_\(robot@xyleme\.com\)
Mozilla/4\.0\(compatible; Zealbot 1\.0\)
Zeus 60359 Webster Pro V2\.9 Win32