155 different robots | Hits | Bandwidth | Last visit |
Yandex bot | 1,425,522+2328 | 49.70 GB | 31 Dec 2011 - 21:06 |
Googlebot | 3,498,910+3901 | 905.30 GB | 31 Dec 2011 - 21:06 |
BaiDuSpider | 1,461,571+4610 | 424.60 GB | 31 Dec 2011 - 21:06 |
Unknown robot (identified by 'robot') | 1,556,196+3273 | 120.95 GB | 31 Dec 2011 - 21:06 |
Voila | 581,227+4961 | 51.02 GB | 31 Dec 2011 - 21:06 |
Unknown robot (identified by 'bot*') | 1,123,462+71165 | 225.26 GB | 31 Dec 2011 - 21:05 |
Unknown robot (identified by empty user agent string) | 250,556+2159 | 27.69 GB | 31 Dec 2011 - 21:02 |
Sogou Spider | 156,361+370 | 82.00 GB | 31 Dec 2011 - 21:02 |
BSpider | 53,603+993 | 1.56 GB | 31 Dec 2011 - 21:02 |
Speedy Spider | 62,371+12777 | 10.86 GB | 31 Dec 2011 - 21:02 |
Java (Often spam bot) | 165,207+132 | 14.87 GB | 31 Dec 2011 - 21:00 |
Exabot | 43,882+1497 | 2.10 GB | 31 Dec 2011 - 20:58 |
W3C Link Checker | 17,406+16567 | 920.12 MB | 31 Dec 2011 - 20:57 |
Unknown robot (identified by hit on 'robots.txt') | 0+22991 | 7.86 MB | 31 Dec 2011 - 20:57 |
Unknown robot (identified by '*bot') | 218,062+10348 | 28.65 GB | 31 Dec 2011 - 20:51 |
MJ12bot | 156,968+9825 | 19.43 GB | 31 Dec 2011 - 20:49 |
Unknown robot (identified by 'spider') | 30,017+5110 | 7.84 GB | 31 Dec 2011 - 20:47 |
Unknown robot (identified by 'crawl') | 4,475,940+15675 | 86.60 GB | 31 Dec 2011 - 20:45 |
Y!J Yahoo Japan | 713+816 | 72.64 MB | 31 Dec 2011 - 20:44 |
WGet tools | 1,576,686+747 | 314.86 GB | 31 Dec 2011 - 20:43 |
Perl tool | 281,799 | 170.84 GB | 31 Dec 2011 - 20:39 |
Alexa (IA Archiver) | 7,439+2901 | 382.26 MB | 31 Dec 2011 - 20:31 |
Yahoo Slurp | 3,048,406+7571 | 267.09 GB | 31 Dec 2011 - 20:21 |
Powermarks | 1,970 | 517.29 MB | 31 Dec 2011 - 20:16 |
Google AdSense | 1,103+1 | 643.14 MB | 31 Dec 2011 - 20:16 |
MSNBot-media | 36,579+17503 | 2.59 GB | 31 Dec 2011 - 20:12 |
Nutch | 96,502+5243 | 19.33 GB | 31 Dec 2011 - 20:11 |
IlTrovatore-Setaccio | 54,662 | 158.37 GB | 31 Dec 2011 - 19:05 |
Python-urllib | 31,559+319 | 4.76 GB | 31 Dec 2011 - 18:16 |
Findlinks | 1,449+745 | 32.08 MB | 31 Dec 2011 - 16:55 |
MSIECrawler | 728+308 | 61.68 MB | 31 Dec 2011 - 15:40 |
MSNBot | 500,187+745 | 181.48 GB | 31 Dec 2011 - 15:01 |
HTTrack off-line browser | 816,497+288 | 40.11 GB | 31 Dec 2011 - 14:33 |
FaceBook bot | 3,937+23 | 5.90 GB | 31 Dec 2011 - 14:16 |
MagpieRSS | 32+78 | 703.51 KB | 31 Dec 2011 - 13:38 |
GigaBot | 63,057+426 | 115.64 GB | 31 Dec 2011 - 13:20 |
CFNetwork | 8,138 | 2.22 GB | 31 Dec 2011 - 10:20 |
LinkScan | 3,730 | 358.94 MB | 31 Dec 2011 - 08:01 |
OutfoxBot/YodaoBot | 7,467+588 | 46.07 MB | 31 Dec 2011 - 07:06 |
Unknown robot (identified by 'checker') | 11,240+5 | 10.31 GB | 31 Dec 2011 - 06:45 |
SeznamBot | 1,992+417 | 121.69 MB | 31 Dec 2011 - 05:38 |
WordPress | 11,873+1 | 4.95 GB | 31 Dec 2011 - 03:28 |
Mail.ru bot | 9,018+43 | 3.46 GB | 30 Dec 2011 - 23:35 |
yacy | 40,246+292 | 4.17 GB | 30 Dec 2011 - 17:39 |
ichiro | 77,424+1031 | 13.43 GB | 30 Dec 2011 - 13:35 |
Feedfetcher-Google | 407 | 8.15 MB | 30 Dec 2011 - 12:51 |
Unknown robot (identified by 'discovery') | 116,624+11978 | 21.40 GB | 30 Dec 2011 - 11:32 |
NG 1.x (Exalead) | 1,226 | 83.05 MB | 30 Dec 2011 - 11:03 |
Jakarta commons-httpclient | 3,814+2 | 2.81 GB | 30 Dec 2011 - 07:16 |
Fish search | 154 | 58.88 MB | 30 Dec 2011 - 04:50 |
W3C Validator | 242 | 65.21 MB | 30 Dec 2011 - 04:36 |
LinkChecker | 3,274+1167 | 33.45 MB | 30 Dec 2011 - 04:35 |
Netluchs | 2,890+226 | 2.13 GB | 30 Dec 2011 - 02:50 |
Netcraft | 165 | 297.07 KB | 30 Dec 2011 - 02:41 |
QihooBot | 148 | 2.72 MB | 29 Dec 2011 - 19:31 |
InfoSeek Robot 1.0 | 29,773 | 25.75 GB | 29 Dec 2011 - 00:16 |
Unknown robot (identified by 'sucker') | 2,921+12 | 55.54 MB | 28 Dec 2011 - 19:06 |
Webinator | 2 | 108.22 KB | 28 Dec 2011 - 19:02 |
BBot | 404+16 | 33.97 MB | 28 Dec 2011 - 04:29 |
WWWC Ver 0.2.5 | 2,730 | 7.62 KB | 28 Dec 2011 - 03:12 |
Cursor | 13 | 1.29 MB | 28 Dec 2011 - 00:30 |
archive.org bot | 23,778+167 | 2.85 GB | 27 Dec 2011 - 20:51 |
SurveyBot | 30+30 | 117.89 KB | 27 Dec 2011 - 20:47 |
T-H-U-N-D-E-R-S-T-O-N-E | 7+3 | 910.88 KB | 27 Dec 2011 - 15:12 |
HTMLParser | 1,802 | 96.08 MB | 27 Dec 2011 - 11:37 |
WebCollage | 156 | 1.03 MB | 27 Dec 2011 - 01:58 |
FavIconizer | 57+1 | 267.06 KB | 26 Dec 2011 - 14:46 |
Vagabondo | 70+32 | 17.32 MB | 26 Dec 2011 - 11:21 |
arks | 33 | 13.23 KB | 26 Dec 2011 - 09:03 |
Checkbot | 1,666 | 0 | 26 Dec 2011 - 07:29 |
Custo | 49,278+2621 | 3.54 GB | 26 Dec 2011 - 06:26 |
Ultraseek | 91+150 | 8.04 MB | 26 Dec 2011 - 04:08 |
lwp-trivial | 12+6 | 1.65 MB | 26 Dec 2011 - 02:19 |
JBot Java Web Robot | 14 | 1.26 MB | 25 Dec 2011 - 02:54 |
Heritrix | 43,564+84 | 5.74 GB | 23 Dec 2011 - 21:42 |
Ocelli | 314,679+35 | 28.67 GB | 23 Dec 2011 - 21:34 |
legs | 50,689+1656 | 12.43 GB | 22 Dec 2011 - 23:08 |
Feedburner | 24 | 0 | 22 Dec 2011 - 16:20 |
Harvest | 27+2 | 142.64 KB | 20 Dec 2011 - 15:02 |
Susie | 40 | 698.77 KB | 20 Dec 2011 - 02:47 |
WebReaper | 17,510+31 | 2.30 GB | 19 Dec 2011 - 03:00 |
MOMspider | 0+17 | 5.96 KB | 18 Dec 2011 - 22:59 |
Araneo | 2+3 | 5.58 KB | 18 Dec 2011 - 13:04 |
Web Core / Roots | 94 | 79.08 MB | 18 Dec 2011 - 07:15 |
Motor | 547+4 | 136.63 MB | 17 Dec 2011 - 20:28 |
VORTEX | 71 | 62.77 MB | 15 Dec 2011 - 23:46 |
larbin | 2,322+279 | 43.99 MB | 15 Dec 2011 - 23:15 |
Sleek | 15 | 0 | 15 Dec 2011 - 14:44 |
WebVac | 256,966+30 | 38.24 GB | 14 Dec 2011 - 08:32 |
Emacs-w3 Search Engine | 93 | 7.69 MB | 13 Dec 2011 - 08:41 |
Phantom | 9 | 85.42 KB | 12 Dec 2011 - 05:49 |
bender focused_crawler | 12,986+720 | 1.56 GB | 12 Dec 2011 - 00:17 |
Ask | 3,591+502 | 187.00 MB | 11 Dec 2011 - 10:40 |
Combine System | 4+6 | 97.38 KB | 07 Dec 2011 - 11:03 |
psbot | 20,377+978 | 312.32 MB | 07 Dec 2011 - 00:37 |
Unknown robot (identified by 'hunter') | 23 | 1.77 MB | 06 Dec 2011 - 19:44 |
LinkBot | 49 | 3.95 MB | 04 Dec 2011 - 15:51 |
Webdup | 6,396 | 51.47 MB | 03 Dec 2011 - 12:45 |
SpiderBot | 17+1 | 61.20 KB | 02 Dec 2011 - 16:01 |
SuperBot | 673 | 664.01 MB | 02 Dec 2011 - 06:04 |
Internet Shinchakubin | 4 | 17.10 KB | 28 Nov 2011 - 08:56 |
Voyager | 5 | 3.38 MB | 27 Nov 2011 - 21:06 |
Turn It In | 8,815+32 | 1.15 GB | 25 Nov 2011 - 20:26 |
MojeekBot | 616+381 | 11.29 MB | 20 Nov 2011 - 23:58 |
TITAN | 7 | 55.34 MB | 16 Nov 2011 - 03:54 |
mnoGoSearch search engine software | 17+6 | 43.61 KB | 10 Nov 2011 - 14:51 |
PhpDig | 1+4 | 718 Bytes | 10 Nov 2011 - 14:13 |
WallPaper (alias crawlpaper) | 2 | 15.32 KB | 08 Nov 2011 - 18:25 |
churl | 8 | 256.68 KB | 29 Oct 2011 - 14:55 |
lwp-request | 15 | 3.05 MB | 20 Oct 2011 - 18:09 |
IBM Almaden Research Center WebFountain™ | 10+7 | 34.85 MB | 15 Oct 2011 - 22:10 |
ht://Dig | 1+1 | 3.93 KB | 06 Oct 2011 - 21:47 |
Gulper Bot | 1 | 45.16 KB | 29 Sep 2011 - 19:46 |
FeedValidator | 75 | 650.13 KB | 26 Sep 2011 - 19:37 |
InternetSeer | 3 | 84.88 KB | 24 Sep 2011 - 21:19 |
Muncher | 4 | 1.06 MB | 24 Sep 2011 - 14:14 |
EasyDL | 381 | 32.38 MB | 17 Sep 2011 - 05:49 |
MSRBOT | 2+2 | 29.89 KB | 13 Sep 2011 - 12:43 |
Holmes | 34+99 | 3.34 MB | 03 Sep 2011 - 11:40 |
Unknown robot (identified by 'scanner') | 15+6 | 90.82 KB | 18 Aug 2011 - 00:39 |
ZyBorg | 6 | 474.94 KB | 08 Aug 2011 - 01:39 |
Sunrise | 13 | 12.87 KB | 01 Aug 2011 - 04:04 |
CipinetBot | 2+1 | 12.40 KB | 24 Jul 2011 - 07:16 |
WatchMouse Website Monitor | 1 | 3.58 KB | 14 Jul 2011 - 11:13 |
Pioneer | 1 | 34.94 KB | 08 Jul 2011 - 01:31 |
BecomeBot | 0+1 | 359 Bytes | 06 Jul 2011 - 12:51 |
BetaBot | 116+47 | 1.98 MB | 04 Jul 2011 - 12:03 |
The web archive (IA Archiver) | 3+638 | 711.90 KB | 28 Jun 2011 - 16:44 |
JCrawler | 18+4 | 869.53 KB | 26 Jun 2011 - 23:49 |
YahooSeeker Yahoo! Blog crawler | 24+24 | 3.19 MB | 26 Jun 2011 - 23:41 |
StackRambler | 1,783+51 | 67.45 MB | 22 Jun 2011 - 17:35 |
The Web Moose | 2 | 11.19 KB | 22 Jun 2011 - 00:28 |
Spiderman | 13+7 | 55.60 MB | 04 Jun 2011 - 19:32 |
ASPseek | 288 | 2.34 MB | 26 May 2011 - 18:03 |
Steeler | 55+6 | 4.15 MB | 25 May 2011 - 08:06 |
Grub.org | 25 | 240.48 KB | 19 Apr 2011 - 18:00 |
Crawl libcrawl | 10+6 | 258.46 KB | 19 Mar 2011 - 18:36 |
NG 2.x (Exalead) | 4+2 | 134.40 KB | 18 Mar 2011 - 10:10 |
UdmSearch | 1 | 20.19 KB | 17 Mar 2011 - 01:46 |
Zeus Webster Pro | 4 | 8.13 KB | 12 Mar 2011 - 16:15 |
Digger | 1 | 1.11 KB | 12 Mar 2011 - 12:14 |
Ezresult | 13 | 3.40 MB | 09 Mar 2011 - 11:49 |
Scooter | 9 | 2.44 MB | 05 Mar 2011 - 09:30 |
Yahoo-MMCrawler | 7 | 2.67 MB | 04 Mar 2011 - 12:59 |
NewsGator Online | 1 | 3.58 KB | 18 Feb 2011 - 18:18 |
Fast-Webcrawler | 1 | 3.58 KB | 14 Feb 2011 - 12:48 |
Allrati | 40 | 1.65 MB | 09 Feb 2011 - 14:09 |
FeedCrawl by feed@aobo.com | 2 | 11.30 KB | 07 Feb 2011 - 18:52 |
Tarantula | 2 | 42.29 KB | 03 Feb 2011 - 23:37 |
NutchCVS | 4+1 | 14.67 KB | 27 Jan 2011 - 09:30 |
UniversalFeedParser | 1 | 11.54 KB | 25 Jan 2011 - 09:44 |
Feedster | 1 | 3.58 KB | 16 Jan 2011 - 14:03 |
LinkWalker | 138+1 | 1.88 MB | 13 Jan 2011 - 19:18 |
DeWeb(c) Katalog/Index | 1 | 3.72 KB | 12 Jan 2011 - 16:07 |
Bookmark-Manager | 1 | 0 | 04 Jan 2011 - 11:58 |
Others | 0 | 0 | |
|