161 different robots | Hits | Bandwidth | Last visit |
Googlebot | 2,127,104+3231 | 544.76 GB | 31 Dec 2012 - 20:59 |
Yandex bot | 1,766,976+3250 | 76.63 GB | 31 Dec 2012 - 20:59 |
Unknown robot (identified by 'bot*') | 949,520+35746 | 167.22 GB | 31 Dec 2012 - 20:58 |
BaiDuSpider | 957,632+3782 | 60.35 GB | 31 Dec 2012 - 20:58 |
Voila | 404,763+3942 | 21.50 GB | 31 Dec 2012 - 20:58 |
MSNBot-media | 20,223+15589 | 189.25 MB | 31 Dec 2012 - 20:58 |
Sogou Spider | 209,114+1189 | 3.86 GB | 31 Dec 2012 - 20:57 |
Unknown robot (identified by 'spider') | 76,692+3820 | 13.67 GB | 31 Dec 2012 - 20:56 |
WGet tools | 2,068,553+705 | 382.96 GB | 31 Dec 2012 - 20:56 |
Exabot | 42,495+1472 | 2.13 GB | 31 Dec 2012 - 20:55 |
Unknown robot (identified by 'crawl') | 324,898+10499 | 28.98 GB | 31 Dec 2012 - 20:51 |
Yahoo Slurp | 36,678+1655 | 4.01 GB | 31 Dec 2012 - 20:49 |
Unknown robot (identified by empty user agent string) | 65,579+2551 | 31.30 GB | 31 Dec 2012 - 20:46 |
BSpider | 65,766+1387 | 960.71 MB | 31 Dec 2012 - 20:46 |
yacy | 2,402+477 | 317.90 MB | 31 Dec 2012 - 20:35 |
Unknown robot (identified by hit on 'robots.txt') | 0+26942 | 9.22 MB | 31 Dec 2012 - 20:34 |
WordPress | 9,266 | 1.28 GB | 31 Dec 2012 - 20:30 |
MagpieRSS | 608+250 | 1.62 MB | 31 Dec 2012 - 20:14 |
Unknown robot (identified by '*bot') | 934,256+16487 | 27.78 GB | 31 Dec 2012 - 20:11 |
Alexa (IA Archiver) | 6,285+2094 | 564.83 MB | 31 Dec 2012 - 20:07 |
Nutch | 47,294+4489 | 9.54 GB | 31 Dec 2012 - 20:03 |
Unknown robot (identified by 'robot') | 2,573,949+3142 | 147.58 GB | 31 Dec 2012 - 20:02 |
Python-urllib | 180,307+668 | 14.15 GB | 31 Dec 2012 - 19:41 |
Java (Often spam bot) | 118,280+858 | 10.97 GB | 31 Dec 2012 - 19:08 |
Perl tool | 36,262+20 | 727.85 MB | 31 Dec 2012 - 19:05 |
OutfoxBot/YodaoBot | 49,491+872 | 31.61 MB | 31 Dec 2012 - 18:37 |
ichiro | 24,698+1194 | 3.15 GB | 31 Dec 2012 - 17:35 |
MSNBot | 56,984+626 | 6.37 GB | 31 Dec 2012 - 17:28 |
Mail.ru bot | 22,300+328 | 4.47 GB | 31 Dec 2012 - 17:05 |
MJ12bot | 156,134+10802 | 24.22 GB | 31 Dec 2012 - 15:52 |
SeznamBot | 18,956+729 | 903.37 MB | 31 Dec 2012 - 14:17 |
CFNetwork | 2,694 | 1.42 GB | 31 Dec 2012 - 13:48 |
Heritrix | 61,841+212 | 11.76 GB | 31 Dec 2012 - 13:11 |
Google AdSense | 1,088 | 1009.86 MB | 31 Dec 2012 - 11:19 |
Netluchs | 652+114 | 25.44 MB | 31 Dec 2012 - 09:58 |
LinkChecker | 2,657+656 | 20.33 MB | 31 Dec 2012 - 09:56 |
Jakarta commons-httpclient | 2,024+5 | 224.17 MB | 31 Dec 2012 - 09:02 |
LinkScan | 3,086 | 322.62 MB | 31 Dec 2012 - 07:41 |
psbot | 30,656+1359 | 53.91 MB | 31 Dec 2012 - 07:25 |
Checkbot | 1,428 | 0 | 31 Dec 2012 - 07:10 |
W3C Validator | 115 | 6.40 MB | 31 Dec 2012 - 06:16 |
Web Core / Roots | 117+35 | 29.06 MB | 31 Dec 2012 - 04:41 |
W3C Link Checker | 9,440+9073 | 449.19 MB | 31 Dec 2012 - 02:50 |
larbin | 1,345+273 | 31.76 MB | 31 Dec 2012 - 01:53 |
Phantom | 267 | 9.50 MB | 31 Dec 2012 - 01:25 |
WebFilter | 577+43 | 23.04 MB | 30 Dec 2012 - 23:21 |
Unknown robot (identified by 'checker') | 26,602+6 | 185.17 MB | 30 Dec 2012 - 22:40 |
Findlinks | 544+446 | 14.30 MB | 30 Dec 2012 - 21:24 |
Motor | 164 | 5.55 MB | 30 Dec 2012 - 16:33 |
Powermarks | 940 | 105.59 MB | 30 Dec 2012 - 13:13 |
MojeekBot | 77+77 | 5.15 MB | 30 Dec 2012 - 11:48 |
FaceBook bot | 3,253 | 33.08 MB | 30 Dec 2012 - 04:22 |
Unknown robot (identified by 'discovery') | 288,068+1091 | 36.63 GB | 30 Dec 2012 - 04:12 |
legs | 139,503+846 | 26.03 GB | 29 Dec 2012 - 23:52 |
WWWC Ver 0.2.5 | 242 | 0 | 29 Dec 2012 - 20:49 |
WebCollage | 106 | 1.31 MB | 29 Dec 2012 - 11:08 |
Ingrid | 1 | 989.42 KB | 28 Dec 2012 - 23:51 |
FastCrawler | 2 | 91.81 KB | 28 Dec 2012 - 16:07 |
arks | 28 | 3.58 KB | 28 Dec 2012 - 15:34 |
Feedfetcher-Google | 1,101 | 33.16 MB | 28 Dec 2012 - 15:23 |
Y!J Yahoo Japan | 1,665+1428 | 180.90 MB | 28 Dec 2012 - 02:13 |
HTTrack off-line browser | 480,537+170 | 26.45 GB | 28 Dec 2012 - 01:15 |
NG 1.x (Exalead) | 2,625+1 | 282.61 MB | 27 Dec 2012 - 21:20 |
BBot | 343+14 | 16.50 MB | 27 Dec 2012 - 20:08 |
archive.org bot | 62,711+240 | 15.14 GB | 27 Dec 2012 - 17:08 |
MSIECrawler | 58+12 | 2.98 MB | 27 Dec 2012 - 06:11 |
SurveyBot | 25+25 | 98.35 KB | 27 Dec 2012 - 03:47 |
Vagabondo | 32+23 | 7.67 MB | 26 Dec 2012 - 18:07 |
FavIconizer | 31 | 115.76 KB | 26 Dec 2012 - 11:00 |
StackRambler | 592 | 133.87 MB | 26 Dec 2012 - 08:32 |
Feedburner | 13 | 0 | 24 Dec 2012 - 08:03 |
Steeler | 102+8 | 4.15 MB | 23 Dec 2012 - 21:01 |
eventax | 11+9 | 443.05 KB | 22 Dec 2012 - 18:27 |
Perman surfer | 5+2 | 85.22 KB | 21 Dec 2012 - 22:58 |
WallPaper (alias crawlpaper) | 8 | 144.84 KB | 21 Dec 2012 - 14:14 |
EARTHCOM.info | 1 | 3.59 KB | 19 Dec 2012 - 05:17 |
LinkBot | 137+2 | 6.81 MB | 17 Dec 2012 - 12:48 |
RuLeS | 8 | 1.64 MB | 17 Dec 2012 - 12:33 |
Custo | 60+6 | 21.30 MB | 17 Dec 2012 - 11:09 |
Araneo | 9+7 | 65.10 KB | 14 Dec 2012 - 20:23 |
WebVac | 197,131+27 | 30.01 GB | 13 Dec 2012 - 20:11 |
Ultraseek | 3,281+536 | 1.42 GB | 12 Dec 2012 - 22:02 |
Turn It In | 909+101 | 76.52 MB | 12 Dec 2012 - 14:44 |
Holmes | 6+9 | 142.93 KB | 12 Dec 2012 - 12:18 |
TITAN | 12 | 168.06 KB | 11 Dec 2012 - 05:13 |
Spiderman | 84+35 | 30.26 MB | 10 Dec 2012 - 22:24 |
Unknown robot (identified by 'sucker') | 145,574+18 | 8.22 GB | 07 Dec 2012 - 00:43 |
NG 2.x (Exalead) | 73+10 | 28.20 MB | 06 Dec 2012 - 22:38 |
ASpider (Associative Spider) | 1 | 3.59 KB | 06 Dec 2012 - 17:50 |
Netcraft | 86 | 197.07 KB | 05 Dec 2012 - 23:46 |
InfoSeek Robot 1.0 | 3,916 | 15.85 MB | 05 Dec 2012 - 10:24 |
lwp-request | 8 | 298.65 KB | 05 Dec 2012 - 09:47 |
Boris | 2 | 10.14 KB | 03 Dec 2012 - 22:00 |
HTMLParser | 85 | 3.15 MB | 28 Nov 2012 - 22:36 |
fido | 7 | 286.06 KB | 26 Nov 2012 - 08:28 |
JBot Java Web Robot | 5 | 327.46 KB | 24 Nov 2012 - 04:12 |
Sven | 17+3 | 199.23 KB | 20 Nov 2012 - 03:06 |
JCrawler | 2+8 | 9.98 KB | 19 Nov 2012 - 13:35 |
Tarantula | 2 | 92.72 KB | 18 Nov 2012 - 20:39 |
Sleek | 15 | 0 | 15 Nov 2012 - 18:28 |
Ocelli | 377,525+19 | 31.36 GB | 14 Nov 2012 - 21:34 |
Susie | 14 | 81.63 KB | 13 Nov 2012 - 01:00 |
Fish search | 39 | 4.61 MB | 11 Nov 2012 - 16:25 |
QihooBot | 61 | 1.16 MB | 11 Nov 2012 - 13:47 |
mnoGoSearch search engine software | 5+1 | 55.92 KB | 07 Nov 2012 - 22:59 |
Ask | 100+72 | 1.59 MB | 06 Nov 2012 - 17:15 |
VORTEX | 34 | 277.62 KB | 05 Nov 2012 - 22:26 |
Voyager | 2 | 0 | 03 Nov 2012 - 17:28 |
LinkWalker | 92 | 35.54 MB | 02 Nov 2012 - 15:18 |
lwp-trivial | 3 | 41.80 KB | 29 Oct 2012 - 01:55 |
Webdup | 2 | 71.02 KB | 27 Oct 2012 - 00:05 |
Webinator | 1 | 3.59 KB | 26 Oct 2012 - 09:25 |
T-H-U-N-D-E-R-S-T-O-N-E | 14 | 932.30 KB | 21 Oct 2012 - 15:46 |
FavOrg | 5 | 30.63 KB | 21 Oct 2012 - 07:37 |
Arale | 18+1 | 149.03 KB | 07 Oct 2012 - 15:12 |
Harvest | 0+14 | 4.91 KB | 06 Oct 2012 - 03:24 |
GigaBot | 5,910+125 | 40.02 MB | 04 Oct 2012 - 16:32 |
InfoBot | 161 | 4.92 MB | 14 Aug 2012 - 18:05 |
FeedValidator | 24 | 515.04 KB | 08 Aug 2012 - 13:53 |
MOMspider | 0+11 | 3.86 KB | 05 Aug 2012 - 23:02 |
bender focused_crawler | 1,986+64 | 289.77 MB | 04 Aug 2012 - 06:36 |
churl | 10 | 50.41 KB | 03 Aug 2012 - 05:28 |
MSRBOT | 20+11 | 2.46 MB | 31 Jul 2012 - 16:09 |
The World Wide Web Worm | 1 | 86.82 KB | 17 Jul 2012 - 12:19 |
the World Wide Web Wanderer | 4 | 7.17 KB | 29 Jun 2012 - 15:16 |
Emacs-w3 Search Engine | 116 | 10.51 MB | 22 Jun 2012 - 02:26 |
Unknown robot (identified by 'hunter') | 2 | 20.62 KB | 02 Jun 2012 - 04:32 |
Zeus Webster Pro | 6 | 12.21 KB | 01 Jun 2012 - 14:28 |
BecomeBot | 1 | 318.14 KB | 27 May 2012 - 13:42 |
Speedy Spider | 13,118+2523 | 2.03 GB | 24 May 2012 - 05:05 |
VSE | 6+2 | 174.25 KB | 19 May 2012 - 17:07 |
Pogodak.com | 2 | 111.39 KB | 17 May 2012 - 01:54 |
Internet Shinchakubin | 2 | 42.36 KB | 16 May 2012 - 02:44 |
Aport | 6 | 0 | 14 May 2012 - 18:19 |
JoBo Java Web Robot | 11+4 | 244.64 KB | 13 May 2012 - 15:40 |
Sunrise | 26 | 24.74 KB | 09 May 2012 - 02:46 |
Turtle | 3 | 0 | 06 May 2012 - 19:29 |
ConveraCrawler | 5 | 0 | 06 May 2012 - 15:24 |
SuperBot | 5 | 1.32 MB | 04 May 2012 - 02:21 |
Pioneer | 2 | 4.79 KB | 30 Apr 2012 - 17:16 |
Cursor | 6 | 51.56 KB | 28 Apr 2012 - 18:20 |
Felix IDE | 1 | 2.53 KB | 27 Apr 2012 - 06:49 |
Raven Search | 120 | 1.90 MB | 24 Apr 2012 - 22:01 |
ComputingSite Robi/1.0 | 1 | 3.58 KB | 24 Apr 2012 - 22:00 |
Turtle | 2 | 3.18 KB | 22 Apr 2012 - 00:32 |
ASPseek | 0+1 | 359 Bytes | 17 Apr 2012 - 07:53 |
IBM Almaden Research Center WebFountain™ | 9+7 | 29.78 MB | 13 Apr 2012 - 10:03 |
Kevin | 1 | 208 Bytes | 13 Apr 2012 - 04:26 |
Crawl libcrawl | 0+2 | 718 Bytes | 12 Apr 2012 - 14:52 |
SpiderBot | 11+5 | 586.15 KB | 10 Apr 2012 - 21:58 |
Bobby | 1 | 15.42 KB | 03 Apr 2012 - 03:28 |
WebReaper | 2,636+2 | 7.39 MB | 02 Apr 2012 - 08:26 |
ExactSeek Crawler | 3+3 | 14.29 KB | 23 Mar 2012 - 23:01 |
MapoftheInternet.com | 1 | 3.58 KB | 21 Mar 2012 - 05:49 |
FeedCrawl by feed@aobo.com | 13+5 | 100.39 KB | 20 Mar 2012 - 08:21 |
Seekbot | 20+6 | 164.43 KB | 20 Mar 2012 - 01:14 |
marvin/infoseek | 29 | 6.09 MB | 12 Mar 2012 - 21:05 |
IlTrovatore-Setaccio | 13,040 | 52.56 MB | 02 Mar 2012 - 23:22 |
GetURL | 1 | 3.58 KB | 05 Feb 2012 - 21:57 |
Girafabot | 1 | 477.38 KB | 20 Jan 2012 - 21:43 |
Combine System | 13+5 | 178.64 KB | 08 Jan 2012 - 14:58 |
|