| 141 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 403339+18200 | 13.31 GB | 31 Dec 2004 - 23:59 |
| Unknown robot (identified by 'crawl') | 157889+3673 | 3.39 GB | 31 Dec 2004 - 23:59 |
| Grub.org | 333258+205 | 3.58 GB | 31 Dec 2004 - 23:59 |
| gazz | 13515+74 | 128.79 MB | 31 Dec 2004 - 23:58 |
| Ask | 147270+1592 | 3.88 GB | 31 Dec 2004 - 23:58 |
| Alexa (IA Archiver) | 147396+2704 | 4.92 GB | 31 Dec 2004 - 23:57 |
| Unknown robot (identified by hit on 'robots.txt') | 0+39051 | 12.33 MB | 31 Dec 2004 - 23:46 |
| Holmes | 0+3 | 1.05 KB | 31 Dec 2004 - 22:57 |
| Fast-Webcrawler | 560742+696 | 15.41 GB | 31 Dec 2004 - 22:48 |
| MSIECrawler | 209926+13267 | 5.77 GB | 31 Dec 2004 - 20:56 |
| Phantom | 100 | 0 | 31 Dec 2004 - 20:54 |
| Walhello appie | 29459+27848 | 320.21 MB | 31 Dec 2004 - 20:26 |
| arks | 9356+169 | 15.66 MB | 31 Dec 2004 - 19:57 |
| StackRambler | 218+72 | 4.34 MB | 31 Dec 2004 - 19:19 |
| Harvest | 18863+26 | 1.04 GB | 31 Dec 2004 - 16:51 |
| Netcraft | 123 | 3.60 KB | 31 Dec 2004 - 16:24 |
| Ingrid | 844 | 47.91 MB | 31 Dec 2004 - 15:14 |
| TITAN | 0+12 | 4.21 KB | 31 Dec 2004 - 11:42 |
| Google AdSense | 270+158 | 47.35 MB | 31 Dec 2004 - 11:28 |
| Digger | 12+4 | 181.75 KB | 31 Dec 2004 - 11:11 |
| WebCopy | 9786 | 42.24 MB | 31 Dec 2004 - 10:43 |
| Ultraseek | 134750+4050 | 15.00 GB | 31 Dec 2004 - 07:24 |
| LinkScan | 2047 | 499.54 KB | 31 Dec 2004 - 04:33 |
| Combine System | 66+53 | 433.12 KB | 31 Dec 2004 - 04:17 |
| LinkWalker | 3293+348 | 5.08 MB | 31 Dec 2004 - 03:22 |
| Emacs-w3 Search Engine | 144 | 14.06 MB | 30 Dec 2004 - 10:04 |
| larbin | 24331+892 | 177.31 MB | 30 Dec 2004 - 04:54 |
| Webinator | 48 | 6.44 MB | 30 Dec 2004 - 01:14 |
| LinkChecker | 819 | 3.28 MB | 29 Dec 2004 - 23:17 |
| InfoSeek Robot 1.0 | 8293+870 | 74.23 MB | 29 Dec 2004 - 17:59 |
| WWWC Ver 0.2.5 | 567 | 34.30 MB | 29 Dec 2004 - 01:01 |
| Templeton | 54 | 368.78 KB | 28 Dec 2004 - 11:08 |
| Internet Shinchakubin | 106 | 867.17 KB | 26 Dec 2004 - 11:52 |
| mnoGoSearch search engine software | 209+28 | 5.21 MB | 25 Dec 2004 - 11:42 |
| Scooter | 11265+2645 | 366.01 MB | 23 Dec 2004 - 03:03 |
| WebReaper | 51562+68 | 2.47 GB | 21 Dec 2004 - 21:46 |
| Python-urllib | 4800+234 | 374.95 MB | 21 Dec 2004 - 15:39 |
| Fish search | 7425 | 84.24 MB | 19 Dec 2004 - 10:44 |
| ht://Dig | 15+49 | 159.05 KB | 17 Dec 2004 - 20:40 |
| NHSE Web Forager | 6 | 506.32 KB | 14 Dec 2004 - 22:39 |
| Pompos | 19068+242 | 1.56 GB | 14 Dec 2004 - 10:55 |
| Calif | 565 | 4.09 MB | 13 Dec 2004 - 17:46 |
| NetMechanic | 14+14 | 4.91 KB | 12 Dec 2004 - 18:09 |
| WebVac | 339717+38 | 10.64 GB | 11 Dec 2004 - 22:42 |
| Aport | 1 | 1.12 KB | 09 Dec 2004 - 13:34 |
| JavaBee | 1 | 11.82 KB | 06 Dec 2004 - 12:19 |
| JoBo Java Web Robot | 642+4 | 15.10 MB | 06 Dec 2004 - 11:01 |
| RuLeS | 7 | 85.63 KB | 04 Dec 2004 - 02:25 |
| Muncher | 12 | 950.41 KB | 30 Nov 2004 - 19:41 |
| UdmSearch | 62+2 | 1.66 MB | 29 Nov 2004 - 04:20 |
| JustView | 4 | 13.80 KB | 27 Nov 2004 - 09:53 |
| Sift | 7 | 286.75 KB | 22 Nov 2004 - 06:13 |
| Perman surfer | 466+39 | 3.48 MB | 19 Nov 2004 - 00:19 |
| Pioneer | 40 | 1.76 MB | 17 Nov 2004 - 22:11 |
| Robozilla | 112 | 344.30 KB | 12 Nov 2004 - 23:54 |
| Boris | 37 | 289.86 KB | 11 Nov 2004 - 19:39 |
| UCSD Crawl | 144 | 1.60 MB | 11 Nov 2004 - 15:09 |
| Web Core / Roots | 14 | 822.22 KB | 11 Nov 2004 - 00:17 |
| ExactSeek Crawler | 1+1 | 3.04 KB | 22 Oct 2004 - 17:26 |
| Nomad | 4 | 160.17 KB | 15 Oct 2004 - 10:45 |
| ComputingSite Robi/1.0 | 1572+34 | 7.55 MB | 13 Oct 2004 - 05:05 |
| MSNBot | 851473+4327 | 9.19 GB | 11 Oct 2004 - 20:04 |
| Googlebot | 1583727+6859 | 20.62 GB | 11 Oct 2004 - 20:04 |
| Voila | 29024+35811 | 1.94 GB | 11 Oct 2004 - 20:03 |
| Unknown robot (identified by 'robot') | 110115+651 | 7.72 GB | 11 Oct 2004 - 20:03 |
| BaiDuSpider | 3515+243 | 55.95 MB | 11 Oct 2004 - 19:13 |
| Unknown robot (identified by 'spider') | 94262+1529 | 3.33 GB | 11 Oct 2004 - 19:10 |
| LinkBot | 311 | 0 | 11 Oct 2004 - 18:30 |
| Mirago | 13+12 | 745.05 KB | 11 Oct 2004 - 18:10 |
| WISENutbot | 262829+59 | 1.65 GB | 11 Oct 2004 - 17:45 |
| ZealBot | 2141 | 5.11 MB | 11 Oct 2004 - 07:49 |
| SurveyBot | 0+40 | 14.02 KB | 11 Oct 2004 - 05:05 |
| MOMspider | 80+51 | 17.88 KB | 11 Oct 2004 - 03:45 |
| psbot | 33317+504 | 139.37 MB | 10 Oct 2004 - 18:06 |
| Checkbot | 5718+1 | 646.58 KB | 10 Oct 2004 - 01:20 |
| SpiderBot | 1+1 | 1.86 KB | 09 Oct 2004 - 20:25 |
| ObjectsSearch | 86+65 | 475.45 KB | 09 Oct 2004 - 16:11 |
| JCrawler | 2+2 | 7.12 KB | 09 Oct 2004 - 00:15 |
| Openfind data gatherer | 41700+7114 | 926.85 MB | 07 Oct 2004 - 22:32 |
| BSpider | 31753+68 | 628.99 MB | 07 Oct 2004 - 18:16 |
| Turn It In | 11246+73 | 161.92 MB | 06 Oct 2004 - 16:15 |
| Motor | 135+84 | 1.40 MB | 06 Oct 2004 - 12:25 |
| GigaBot | 27855+4517 | 1.33 GB | 25 Sep 2004 - 12:50 |
| lycos_ | 18+5 | 996.99 KB | 24 Sep 2004 - 23:19 |
| Snooper | 1+1 | 3.51 KB | 21 Sep 2004 - 02:30 |
| fido | 1 | 28.40 KB | 15 Sep 2004 - 16:58 |
| Suke | 8 | 1.03 MB | 13 Sep 2004 - 10:54 |
| ASpider (Associative Spider) | 22+7 | 187.58 KB | 13 Sep 2004 - 10:15 |
| Yandex bot | 831+46 | 799.05 KB | 13 Sep 2004 - 05:19 |
| JBot Java Web Robot | 9 | 338.37 KB | 07 Sep 2004 - 14:56 |
| RoadHouse Crawling System | 3 | 2.58 MB | 04 Sep 2004 - 02:53 |
| Antibot | 2037+132 | 23.13 MB | 03 Sep 2004 - 07:43 |
| Alkaline | 70+16 | 156.65 KB | 02 Sep 2004 - 05:41 |
| Spiderman | 31+12 | 190.02 KB | 01 Sep 2004 - 20:58 |
| The World Wide Web Worm | 32 | 235.05 KB | 01 Sep 2004 - 08:49 |
| Acme.Spider | 88 | 898.15 KB | 23 Aug 2004 - 02:18 |
| H���ki | 28 | 117.51 KB | 18 Aug 2004 - 11:46 |
| WebWatch | 1 | 0 | 10 Aug 2004 - 21:24 |
| BBot | 18 | 208.87 KB | 03 Aug 2004 - 15:16 |
| echo | 38 | 3.92 MB | 01 Aug 2004 - 09:47 |
| Fluid Dynamics Search Engine robot | 22+17 | 488.31 KB | 30 Jul 2004 - 19:54 |
| GetURL | 1 | 137.39 KB | 29 Jul 2004 - 12:19 |
| w3mir | 3 | 67.19 KB | 22 Jul 2004 - 01:38 |
| Digout4u | 1 | 32.00 KB | 21 Jul 2004 - 15:18 |
| CyberSpyder Link Test | 6+3 | 1.05 KB | 16 Jul 2004 - 13:00 |
| Bobby | 4 | 17.88 KB | 15 Jul 2004 - 07:38 |
| Spry Wizard Robot | 5 | 150.42 KB | 13 Jul 2004 - 22:35 |
| churl | 2 | 43.50 KB | 13 Jul 2004 - 21:05 |
| Bumblebee (relevare.com) | 1066+207 | 17.16 MB | 07 Jul 2004 - 22:34 |
| Yahoo Vertical Crawler | 2333+12 | 47.83 MB | 27 Jun 2004 - 18:36 |
| DWCP (Dridus' Web Cataloging Project) | 10 | 952.41 KB | 23 Jun 2004 - 10:45 |
| Sven | 8 | 1.92 MB | 23 Jun 2004 - 03:04 |
| legs | 2 | 35.74 KB | 20 Jun 2004 - 21:47 |
| Monster | 2 | 9.85 KB | 11 Jun 2004 - 09:23 |
| TitIn | 1 | 36.54 KB | 01 Jun 2004 - 15:44 |
| WebStolperer | 2 | 576.00 KB | 19 May 2004 - 17:52 |
| NDSpider | 1+8 | 5.96 KB | 11 May 2004 - 23:33 |
| Kilroy | 5 | 26.45 KB | 26 Apr 2004 - 18:13 |
| RBSE Spider | 3 | 2.62 MB | 22 Apr 2004 - 00:22 |
| The Jubii Indexing Robot | 7 | 28.82 KB | 19 Apr 2004 - 08:32 |
| HKU WWW Octopus | 1 | 159.83 KB | 19 Apr 2004 - 08:25 |
| RoboCrawl Spider | 19+3 | 188.55 KB | 11 Apr 2004 - 13:10 |
| Big Brother | 8 | 563.61 KB | 31 Mar 2004 - 14:32 |
| gammaSpider, FocusedCrawler | 2 | 1.43 KB | 28 Mar 2004 - 07:49 |
| WebBandit Web Spider | 1 | 3.16 KB | 25 Mar 2004 - 11:56 |
| webcompass | 1 | 738 Bytes | 06 Mar 2004 - 06:24 |
| PhpDig | 10+3 | 0 | 05 Mar 2004 - 17:06 |
| XGET | 2 | 143.49 KB | 01 Mar 2004 - 14:22 |
| AWBot | 1 | 320.00 KB | 27 Feb 2004 - 08:14 |
| bright.net caching robot | 9 | 25.40 KB | 16 Feb 2004 - 16:22 |
| ArchitextSpider | 2 | 704 Bytes | 13 Feb 2004 - 11:58 |
| Gulper Bot | 5+2 | 26.75 KB | 30 Jan 2004 - 18:06 |
| Internet Cruiser Robot | 1 | 13.21 KB | 11 Jan 2004 - 21:40 |
| fast-webcrawler | 5016 | 147.24 MB | 09 Jan 2004 - 12:36 |
| WGet tools | 5175 | 223.35 MB | 09 Jan 2004 - 11:33 |
| ibm | 209 | 2.47 MB | 09 Jan 2004 - 05:23 |
| pka | 2 | 605.23 KB | 08 Jan 2004 - 10:54 |
| eit | 1 | 96.00 KB | 05 Jan 2004 - 19:12 |
| kdd | 1 | 20.81 KB | 05 Jan 2004 - 11:13 |
| cmc | 1 | 5.17 KB | 03 Jan 2004 - 12:09 |
| puu | 1 | 768.00 KB | 02 Jan 2004 - 01:32 |