360Spider
^attach
^CICC
^DA
^lwp
^Memo
^RMA
^VCI
Aboundex
aesop_com_spiderman
AhrefsBot
AIBOT
Alexibot
almaden
Anarchie
anonymouse
Aport
Art-Online
ASPSeek
asterias
autoemailspider
BackDoorbot
BackWeb
Baiduspider
Bandit
BatchFTP
bingbot
Birubot
Black.Hole
BlackWidow
BLEXBot
BlowFish
Bot\ mailto:craftbot@yahoo.com
botALot
Buddy
BuiltbotTough
Bullseye
bumblebee
BunnySlippers
Butterfly
CamontSpider
Cegbfeieh
Cheesebot
CherryPicker
ChinaClaw
clip
clshttp
Cogentbot
Collector
Copier
CopyRightCheck
cosmos
craftbot
Crescent
Custo
Demon
Density
Devil
DIIbot
DISCo
DittoSpyder
dlman
DotBot
download
dragonfly
Drip
DSurf15a
easydl
EasyDL/2.99
ebingbong
eCatch
EirGrabber
email
enhancer
EroCrawler
exabot
Express\ WebPictures
ExpresssWebPictures
extract
eXtractor
ExtractorPro
EyeNetIE
Ezooms
FairShare
fetch
FileHound
FlashGet
flunky
Foobot
FrontPage
GetRight
GetSmart
getweb
GetWeb!
gigabaz
Gigabot
Go!Zilla
Go-Ahead-Got-It
go.?is
go.?zilla
Go\!Zilla
gotit
Grabber
GrabNet
Grafula
grub-client
Harvest
Harvest-NG
hloader
HMView
httpdown
httplib
HTTrack
humanlinks
ia_archiver
ilsebot
Image\ Stripper
Image\ Sucker
image\.coccoc
ImagesStripper
ImagesSucker
Ind[\sy]*Library
IndysLibrary
InfonaviRobot
infotekies
intelliseek
InterGET
Internet\ Ninja
InternetLinkagent
InternetSeer
InternetSeer.com
InternetsNinja
Iria
ISC\ Systems\ iRc
Jakarta
Java
JBH*agent
Jennybot
JetCar
JOC
JS-Kit
JustView
jyxobot
kenjin
Kenjin.Spider
Kenjin\ Spider
keyword
Keyword.Density
kmSearchBot
larbin
leacher
LeechFTP
LexiBot
lftp
libweb
libWeb/clsHTTP
libwww
libwww-perl
likse
Linguee
Link
lnspiderguy
lwp-trivial
LWP::Simple
Mag[-]*Net
markwatch
Mass[s\s]*Downloader
Mata.Hari
MegaIndex
Metasearch
Microsoft.URL
MIDown[\.\s]*tool
MIIxpc
Mirror
missigua
Missigua\ Locator
Mister.*PiX
MistersPiX
MJ12bot
MLBot
moget
Mozilla*MSIECrawler
Mozilla.*Indy
Mozilla.*NEWT
mozilla.newt
Mozilla/3.Mozilla/2.01
MS\ FrontPage*
MSFrontPage
MSIECrawler
msnbot
MSProxy
musobot
nameprotect
Navroad
NearSite
Net.*Vampire
NetAnts
netcraft
NetMechanic
NetSpider
NetsVampire
nextgensearchbot
NICErsPRO
nimblecrawler
Ninja
NjuiceBot
NPbot
Nutch
Octopus
Offline.*Explorer
Offline.*Navigator
Openfind
outfoxbot
PageGrabber
Pagerabber
papa
pavuk
pcBrowser
php.?version.?tracker
PHPCrawl
Ping
PingALink
Pockey
PostRank
ProgramsSharewares1
ProPowerbot
ProWebWalker
psbot
ptd-crawler
Pump
Purebot
PycURL
QRVA
queryn
QueryN.Metasearch
RealDownload
Reaper
Recorder
ReGet
RepoMonkey
sauger
Scooter
Seeker
SemrushBot
Siphon
site.quester
SiteBot
sitecheck.internetseer.com
SiteSnagger
Slurp
SlySearch
SmartDownload
Snake
snapbot
snoopy
sogou
Sogou\ web\ spider
Sosospider
Soup
SpaceBison
Spankbot
spanner
spbot
sproose
SputnikBot
SputnikImageBot
sqworm
Stripper
Sucker
suggybot
SuperBot
SuperHTTP
Surfbot
SurveyBot
suzuran
SWeb
Szukacz
Szukacz/1.4
tAkeOut
Teleport
Telesoft
The.Intraformant
TheNomad
TightTwatbot
Titan
toCrawl/UrlDispatcher
True_Robot
ttCrawler
turingos
turnitinbot
Turnitinbot/1.5
urldispatcher
URLSpiderPro
URLy.Warning
User-Agent
Vacuum
VoidEYE
Voyager
Web[\.\s]Image[\.\s]Collector
Web\ Downloader
Web\ Sucker
WebAuto
WebBandit
Webclipping
webcollage
WebCopier
WebEMailExtrac.*
WebEnhancer
WebFetch
WebGo
WebHook
WebLeacher
WebmasterWorldForumBot
WebMiner
WebMirror
webpictures
WebReaper
WebSauger
WebsImagesCollector
Website
WebsiteseXtractor
WebsitesQuester
webspider
WebsSucker
Webster
Webster.Pro
WebStripper
WebWhacker
WEP\ Search
Wget
whack
Whacker
Widow
wisenutbot
Wonder
WordPress
WWW-Collector-E
WWWOFFLE
x-Tractor
Xaldon
XaldonsWebSpider
Xenu
Yeti
YottosBot
Zeus
zip
zyborg