WWW Statistics for Netlib  

Statistics for:  www.netlib.org Last Update:  09 Jan 2011 - 10:32 Reported period: Year 2010

Close window

 

Robots/Spiders visitors

181 different robots Hits Bandwidth Last visit Unknown robot (identified by 'crawl') 10,181,500+30301 117.73 GB 30 Nov 2010 - 20:56 MSNBot 3,657,101+86766 160.65 GB 30 Nov 2010 - 17:31 Yahoo Slurp 3,264,660+9322 435.36 GB 30 Nov 2010 - 21:02 Unknown robot (identified by 'robot') 2,354,648+2011 72.60 GB 30 Nov 2010 - 20:52 Googlebot 2,267,674+3334 324.19 GB 30 Nov 2010 - 21:02 WGet tools 1,422,478+641 258.34 GB 30 Nov 2010 - 21:02 HTTrack off-line browser 1,284,203+360 63.15 GB 29 Nov 2010 - 22:00 Voila 902,065+5202 58.59 GB 30 Nov 2010 - 21:02 Yandex bot 618,808+2510 52.05 GB 30 Nov 2010 - 21:02 Unknown robot (identified by 'bot*') 568,751+34996 118.32 GB 30 Nov 2010 - 21:02 WebVac 290,711+32 36.04 GB 30 Nov 2010 - 21:02 twiceler 213,447+13717 17.58 GB 30 Jul 2010 - 18:58 MSNBot-media 175,867+48560 6.55 GB 30 Nov 2010 - 17:06 Ocelli 222,034+31 19.47 GB 09 Nov 2010 - 07:15 Unknown robot (identified by empty user agent string) 190,166+15105 15.60 GB 30 Nov 2010 - 21:01 Java (Often spam bot) 176,423+302 12.62 GB 30 Nov 2010 - 20:18 Unknown robot (identified by 'discovery') 97,732+14044 26.36 GB 30 Nov 2010 - 21:02 Ask 107,641+2852 9.31 GB 30 Nov 2010 - 20:36 Speedy Spider 88,131+14560 11.38 GB 30 Nov 2010 - 20:27 Unknown robot (identified by '*bot') 98,370+786 4.91 GB 30 Nov 2010 - 20:11 SuperBot 91,224 6.66 GB 23 Nov 2010 - 20:45 Exabot 76,815+1675 3.05 GB 30 Nov 2010 - 19:48 Unknown robot (identified by 'spider') 68,966+4743 17.86 GB 30 Nov 2010 - 20:56 BaiDuSpider 59,052+5425 12.69 GB 30 Nov 2010 - 21:00 Nutch 49,885+4671 6.24 GB 30 Nov 2010 - 20:20 Perl tool 48,703+10 5.03 GB 30 Nov 2010 - 20:46 Unknown robot (identified by 'sucker') 45,605+25 4.89 GB 24 Nov 2010 - 23:47 archive.org bot 43,348+123 5.23 GB 27 Nov 2010 - 09:38 Custo 37,163+2726 3.82 GB 30 Nov 2010 - 17:35 Turn It In 37,963+163 2.76 GB 30 Nov 2010 - 16:16 docomo 36,276+655 7.71 GB 30 Nov 2010 - 19:41 Mail.ru bot 32,748+119 3.24 GB 30 Nov 2010 - 09:09 ichiro 32,558+115 4.52 GB 27 Nov 2010 - 20:23 legs 27,470+3520 3.05 GB 26 Nov 2010 - 01:04 W3C Link Checker 15,598+15126 832.45 MB 30 Nov 2010 - 20:48 Ultraseek 23,113+3369 3.12 GB 30 Nov 2010 - 04:49 MJ12bot 24,896+571 3.83 GB 30 Nov 2010 - 20:44 BSpider 23,042+2050 2.60 GB 30 Nov 2010 - 20:56 Unknown robot (identified by hit on 'robots.txt') 0+21378 7.30 MB 30 Nov 2010 - 19:43 Heritrix 18,093+183 806.80 MB 23 Nov 2010 - 01:47 InfoBot 17,796+22 3.89 GB 08 Oct 2010 - 13:50 psbot 16,889+688 873.00 MB 18 Oct 2010 - 12:03 Python-urllib 16,033+162 3.81 GB 30 Nov 2010 - 20:29 Alexa (IA Archiver) 10,790+1550 644.78 MB 30 Nov 2010 - 20:52 Vagabondo 11,048+375 910.79 MB 23 Nov 2010 - 19:47 WordPress 9,457 3.69 GB 30 Nov 2010 - 20:21 StackRambler 9,070+158 118.50 MB 30 Nov 2010 - 10:34 Findlinks 7,378+79 200.63 MB 30 Nov 2010 - 20:17 OutfoxBot/YodaoBot 3,477+1138 22.25 MB 30 Nov 2010 - 16:32 java 4,231+9 383.47 MB 08 Jan 2010 - 11:41 yacy 3,415+724 585.03 MB 30 Nov 2010 - 20:52 CFNetwork 3,922 3.12 GB 30 Nov 2010 - 19:27 Sogou Spider 3,248+424 83.60 MB 30 Nov 2010 - 18:20 Jakarta commons-httpclient 3,252+20 350.53 MB 30 Nov 2010 - 16:18 larbin 2,633+503 63.83 MB 30 Nov 2010 - 13:15 MSIECrawler 2,575+206 74.23 MB 30 Nov 2010 - 14:03 bot[+:,\.\;\/\\-] 2,632+148 110.42 MB 08 Jan 2010 - 12:39 WWWC Ver 0.2.5 2,491 16.72 KB 30 Nov 2010 - 20:28 Spiderman 1,709+309 175.82 MB 24 Nov 2010 - 13:37 LinkScan 1,962 326.13 MB 30 Nov 2010 - 02:39 Checkbot 1,950 265.86 KB 29 Nov 2010 - 12:25 YahooSeeker Yahoo! Blog crawler 1,773+106 107.85 MB 29 Nov 2010 - 06:33 Gaisbot 1,775+80 13.76 MB 30 Nov 2010 - 08:40 The web archive (IA Archiver) 10+1810 907.24 KB 30 Nov 2010 - 20:30 Yahoo-MMCrawler 1,778+1 8.62 MB 23 Feb 2010 - 12:32 Powermarks 1,705 38.79 MB 30 Nov 2010 - 17:28 LinkChecker 1,422+282 14.45 MB 30 Nov 2010 - 19:00 Google AdSense 1,478 155.52 MB 30 Nov 2010 - 20:30 EasyDL 1,445 95.72 MB 30 Nov 2010 - 14:16 [+:,\.\;\/\\-]bot 1,140+20 48.95 MB 08 Jan 2010 - 11:17 Netluchs 1,068+90 41.89 MB 19 Nov 2010 - 20:43 Unknown robot (identified by 'checker') 954+17 9.37 MB 29 Nov 2010 - 21:19 SeznamBot 521+263 42.56 MB 30 Nov 2010 - 12:38 GigaBot 374+305 7.73 MB 30 Nov 2010 - 08:41 ASPseek 664 5.40 MB 30 Nov 2010 - 18:02 WebReaper 587+8 7.29 MB 13 Oct 2010 - 07:14 lwp-trivial 411+96 8.60 MB 12 Sep 2010 - 03:38 arks 445+42 30.10 MB 02 Nov 2010 - 03:07 Voyager 385+25 12.48 MB 30 Nov 2010 - 10:01 Nagios 410 1.36 MB 19 Nov 2010 - 21:19 BetaBot 248+123 7.71 MB 14 Nov 2010 - 19:31 Unknown robot (identified by 'scanner') 352+9 53.72 MB 30 Nov 2010 - 10:23 Allrati 334 5.36 MB 30 Nov 2010 - 05:07 JoBo Java Web Robot 290+9 2.65 MB 21 Nov 2010 - 08:26 QihooBot 294 28.69 MB 24 Nov 2010 - 19:19 BBot 268 118.20 MB 21 Nov 2010 - 08:09 Motor 263+1 687.07 MB 29 Nov 2010 - 14:23 Webdup 251 1.01 MB 14 Jul 2010 - 06:30 Fish search 231 24.04 MB 29 Nov 2010 - 10:42 Holmes 43+181 1.14 MB 30 Nov 2010 - 08:55 Emacs-w3 Search Engine 210 26.79 MB 25 Nov 2010 - 01:45 NG 1.x (Exalead) 199 11.18 MB 25 Nov 2010 - 17:37 HTMLParser 194 12.02 MB 19 Oct 2010 - 11:07 Feedfetcher-Google 190 7.49 MB 19 Nov 2010 - 05:06 MSRBOT 120+45 62.66 MB 16 Jun 2010 - 17:27 WebCollage 161 5.00 MB 21 Nov 2010 - 17:30 Netcraft 154 244.05 KB 26 Nov 2010 - 21:44 Web Core / Roots 144+2 452.10 MB 30 Nov 2010 - 19:00 FaceBook bot 124+2 5.80 MB 25 Nov 2010 - 11:04 MojeekBot 100+22 2.69 MB 30 Nov 2010 - 15:05 lwp-request 115 3.48 MB 29 Nov 2010 - 15:52 LinkWalker 39+39 18.96 KB 12 Mar 2010 - 03:04 Susie 72 1.70 MB 27 Nov 2010 - 11:03 MagpieRSS 6+64 207.00 KB 19 Nov 2010 - 23:59 W3C Validator 66 830.17 KB 24 Nov 2010 - 22:21 Unknown robot (identified by 'hunter') 64+1 3.77 MB 10 Nov 2010 - 09:26 SurveyBot 31+31 115.95 KB 22 Nov 2010 - 08:05 FavOrg 59 309.82 KB 29 Nov 2010 - 12:08 Crawl libcrawl 37+21 660.94 KB 15 Oct 2010 - 01:07 Feedburner 57 0 15 Nov 2010 - 00:40 Digger 31+21 416.68 KB 08 Nov 2010 - 11:17 LinkBot 52 0 29 Nov 2010 - 17:25 Robozilla 48 1.14 MB 17 Feb 2010 - 15:37 Y!J Yahoo Japan 41+3 2.50 MB 04 Nov 2010 - 08:41 T-H-U-N-D-E-R-S-T-O-N-E 28+8 2.63 MB 29 Sep 2010 - 04:46 WebCopy 31 248.68 KB 02 Jan 2010 - 02:32 ASpider (Associative Spider) 26+1 26.93 MB 19 Sep 2010 - 01:55 FavIconizer 24 490.41 KB 23 Nov 2010 - 21:40 DNAbot 16+8 936.00 KB 27 Jul 2010 - 12:23 Girafabot 0+22 7.71 KB 23 May 2010 - 06:06 Cursor 16+1 865.25 KB 14 Nov 2010 - 00:25 MOMspider 0+15 5.26 KB 14 Nov 2010 - 22:59 Sleek 15 0 15 Nov 2010 - 13:42 NutchCVS 10+3 349.69 KB 03 Jun 2010 - 21:00 Grub.org 11 38.65 KB 26 Nov 2010 - 06:32 FeedValidator 11 38.92 KB 27 Sep 2010 - 16:57 Pioneer 11 151.70 KB 10 Aug 2010 - 12:34 mnoGoSearch search engine software 10+1 33.27 KB 12 Nov 2010 - 11:27 Combine System 7+3 71.48 KB 06 Sep 2010 - 20:05 FeedCrawl by feed@aobo.com 10 54.01 KB 03 Jul 2010 - 14:00 NetSprint 7+1 224.81 KB 08 Jul 2010 - 08:03 TITAN 7 1.03 MB 19 Nov 2010 - 09:04 JBot Java Web Robot 6 2.34 KB 06 Apr 2010 - 07:22 Scooter 6 1.42 KB 22 Jun 2010 - 08:20 SpiderBot 4+1 13.91 KB 29 Nov 2010 - 22:17 InternetSeer 4 11.82 KB 29 Oct 2010 - 20:51 marvin/infoseek 4 12.72 KB 11 Jun 2010 - 15:44 RBSE Spider 4 6.78 KB 07 Oct 2010 - 06:00 IBM Almaden Research Center WebFountain™ 2+2 1.49 MB 22 Apr 2010 - 19:44 lmspider 2+2 2.59 KB 01 Oct 2010 - 15:18 Fluid Dynamics Search Engine robot 2+1 5.93 KB 21 Jan 2010 - 07:12 Sunrise 3 967.55 KB 08 May 2010 - 04:17 UCSD Crawl 3 52.86 KB 11 Oct 2010 - 13:48 Hylanda 3 33.27 KB 27 Aug 2010 - 02:17 Perman surfer 2+1 206.40 KB 19 Apr 2010 - 05:42 TailRank 2 445.73 KB 03 Jun 2010 - 09:16 Internet Shinchakubin 2 36.08 KB 14 Aug 2010 - 07:29 Bookmark-Manager 2 0 28 Sep 2010 - 03:19 vse 2 29.27 KB 05 Jan 2010 - 14:47 Tarantula 2 92.72 KB 20 Nov 2010 - 01:14 TestBot 2 1.81 MB 10 Sep 2010 - 15:46 Muncher 2 21.39 KB 07 Aug 2010 - 10:39 BlogPulse ISSpider intelliseek.com 1+1 3.74 KB 21 Oct 2010 - 10:38 VORTEX 2 6.78 KB 28 Feb 2010 - 13:35 NewsGator Online 1 0 23 Aug 2010 - 08:14 gammaSpider, FocusedCrawler 1 144.34 KB 12 Oct 2010 - 09:32 xirq 1 40.80 KB 07 Sep 2010 - 13:30 Knowledge.com 1 3.39 KB 28 Aug 2010 - 04:08 arianna.libero.it 0+1 359 Bytes 04 Jan 2010 - 13:17 ConveraCrawler 1 3.39 KB 01 May 2010 - 13:08 Harvest 0+1 359 Bytes 09 May 2010 - 21:04 EARTHCOM.info 1 3.39 KB 13 May 2010 - 22:18 Sven 1 175.39 KB 21 Aug 2010 - 02:58 Fast-Webcrawler 1 3.39 KB 30 Apr 2010 - 14:00 NHSE Web Forager 1 175.39 KB 11 Oct 2010 - 12:14 aipbot 1 3.39 KB 03 May 2010 - 15:56 BlackWidow 1 3.39 KB 07 May 2010 - 15:54 Flexum Search Engine 1 3.39 KB 11 May 2010 - 22:24 I, Robot 1 2.81 KB 17 Feb 2010 - 15:01 UdmSearch 1 42.50 KB 07 Jul 2010 - 22:14 VSE 0+1 359 Bytes 29 Jun 2010 - 11:30 ComputingSite Robi/1.0 1 14.01 KB 22 Aug 2010 - 15:12 DWCP (Dridus' Web Cataloging Project) 1 38.66 KB 31 May 2010 - 11:00 XYLEME Robot 1 3.39 KB 29 May 2010 - 16:23 NG 2.x (Exalead) 0+1 359 Bytes 27 Jan 2010 - 05:39 WallPaper (alias crawlpaper) 1 8.48 KB 02 Jul 2010 - 13:30 Sift 1 48.29 KB 29 Nov 2010 - 18:48 Digout4u 1 3.39 KB 14 Mar 2010 - 18:30 fido 1 18.02 KB 29 May 2010 - 13:37 Deepindex 1 3.39 KB 31 May 2010 - 16:28 ConveraMultiMediaCrawler 1 3.39 KB 25 Nov 2010 - 18:27 Others 0 5 Bytes

* Robots shown here gave hits or traffic "not viewed" by visitors, so they are not included in other charts. Numbers after + are successful hits on "robots.txt" files.



Advanced Web Statistics 7.0 (build 1.971) - Created by awstats (plugins: hashfiles, decodeutfkeys)