| 161 different robots | Hits | Bandwidth | Last visit |
|---|
| bingbot | 26,373+337 | 1.18 GB | 31 Dec 2016 - 23:49 |
| BLEXBot | 10,190+399 | 135.88 MB | 29 Dec 2016 - 09:42 |
| Googlebot-Image | 10,444 | 161.93 MB | 31 Dec 2016 - 23:59 |
| MSIE 6 - ( Rogue Robot ) | 8,597 | 184.13 MB | 31 Dec 2016 - 23:07 |
| YandexImages | 4,689 | 8.74 MB | 31 Dec 2016 - 23:49 |
| SemrushBot | 4,271+57 | 203.80 MB | 30 Dec 2016 - 15:17 |
| Unknown robot identified by bot\* | 4,169+16 | 247.56 MB | 30 Dec 2016 - 02:45 |
| Googlebot | 3,932+78 | 70.48 MB | 31 Dec 2016 - 23:38 |
| Yahoo! Slurp | 3,579+90 | 2.86 GB | 31 Dec 2016 - 23:54 |
| AhrefsBot | 3,552+50 | 704.41 MB | 31 Dec 2016 - 23:59 |
| Baiduspider | 2,972+20 | 46.26 MB | 31 Dec 2016 - 23:42 |
| Google Web Preview | 2,599 | 52.86 MB | 31 Dec 2016 - 22:48 |
| spbot | 1,863+3 | 31.68 MB | 22 Dec 2016 - 09:06 |
| MJ12bot | 1,653+191 | 93.74 MB | 31 Dec 2016 - 23:51 |
| Sogou web spider | 90+1194 | 2.20 MB | 30 Dec 2016 - 05:16 |
| BingPreview | 1,188 | 39.04 MB | 31 Dec 2016 - 21:23 |
| BoogleBot | 984+47 | 30.14 MB | 29 Dec 2016 - 20:42 |
| YandexBot | 637+261 | 17.13 MB | 31 Dec 2016 - 23:57 |
| MSIE 5 - ( Rogue Robot ) | 892 | 3.91 MB | 31 Dec 2016 - 05:45 |
| WBSearchBot | 883+1 | 16.18 MB | 17 Dec 2016 - 02:31 |
| MegaIndex.ru | 872+1 | 16.09 MB | 30 Dec 2016 - 07:58 |
| Firefox version 10 and lower - various robots | 834+34 | 19.25 MB | 31 Dec 2016 - 22:49 |
| SeznamBot | 637+224 | 8.81 MB | 31 Dec 2016 - 23:20 |
| istellabot | 563+91 | 7.63 MB | 31 Dec 2016 - 21:49 |
| facebookexternalhit | 645 | 20.23 MB | 31 Dec 2016 - 22:12 |
| vebidoobot | 566+3 | 5.53 MB | 25 Dec 2016 - 20:21 |
| empty user agent string | 505+14 | 10.20 MB | 31 Dec 2016 - 20:36 |
| python | 516+1 | 646.27 KB | 31 Dec 2016 - 07:59 |
| Pcore | 464 | 8.30 MB | 05 Dec 2016 - 09:24 |
| linkdexbot | 427+7 | 21.15 MB | 31 Dec 2016 - 23:15 |
| vegi bot | 412 | 7.26 MB | 05 Dec 2016 - 13:47 |
| msnbot-media | 384 | 27.70 MB | 31 Dec 2016 - 22:04 |
| SiteExplorer | 370+4 | 15.97 MB | 21 Dec 2016 - 16:57 |
| yahoocachesystem | 312 | 8.76 MB | 31 Dec 2016 - 21:35 |
| Dalvik | 271 | 8.39 MB | 30 Dec 2016 - 12:02 |
| smtbot | 263+3 | 4.88 MB | 24 Dec 2016 - 21:51 |
| seoscanners | 143+110 | 3.64 MB | 31 Dec 2016 - 23:37 |
| Mail.RU Bot | 200+42 | 5.72 MB | 24 Dec 2016 - 13:07 |
| Cliqzbot | 118+116 | 1.96 MB | 29 Dec 2016 - 14:02 |
| archive.org_bot | 202+23 | 1.14 MB | 31 Dec 2016 - 15:34 |
| domainappender | 132+88 | 906.90 KB | 31 Dec 2016 - 23:14 |
| Unknown robot (identified by hit on robots.txt) | 0+209 | 25.92 KB | 31 Dec 2016 - 21:52 |
| DotBot | 130+70 | 997.03 KB | 29 Dec 2016 - 16:41 |
| CCBot | 180+3 | 3.33 MB | 10 Dec 2016 - 01:53 |
| Java ( catchall ) | 172+8 | 3.59 MB | 31 Dec 2016 - 09:11 |
| mozilla/4.0 (compatible;) - ( Rogue Robot ) | 171 | 3.51 MB | 30 Dec 2016 - 17:28 |
| electricmonk | 121+11 | 1.67 MB | 31 Dec 2016 - 01:42 |
| coccoc | 65+55 | 1.94 MB | 31 Dec 2016 - 18:16 |
| James BOT | 107+8 | 7.11 MB | 30 Dec 2016 - 04:17 |
| Exabot | 95+17 | 1.41 MB | 31 Dec 2016 - 23:20 |
| Deepnet Explorer | 107 | 635.43 KB | 31 Dec 2016 - 10:21 |
| Mozilla Beta (Windows) - ( Rogue Robot ) | 98 | 586.09 KB | 31 Dec 2016 - 05:33 |
| wordpress | 88 | 85.17 KB | 30 Dec 2016 - 18:14 |
| favicon | 84 | 697.69 KB | 31 Dec 2016 - 18:41 |
| crawl | 64+20 | 2.63 MB | 31 Dec 2016 - 14:25 |
| Wotbox | 82+1 | 1.22 MB | 02 Dec 2016 - 23:42 |
| CFNetwork | 81 | 2.11 MB | 31 Dec 2016 - 08:58 |
| MSIE 2 - ( Rogue Robot ) | 80 | 477.80 KB | 31 Dec 2016 - 05:29 |
| Python-urllib | 70+10 | 3.06 MB | 31 Dec 2016 - 11:41 |
| msie8 - ( Rogue Robot ) | 76 | 947.13 KB | 31 Dec 2016 - 01:45 |
| discover | 67 | 1.98 MB | 31 Dec 2016 - 11:43 |
| SEOkicks-Robot | 55+8 | 1.03 MB | 26 Dec 2016 - 14:31 |
| MSIE 3 - ( Rogue Robot ) | 56 | 329.14 KB | 30 Dec 2016 - 09:11 |
| MSIECrawler | 55 | 326.36 KB | 31 Dec 2016 - 18:13 |
| Wget | 52+1 | 2.53 MB | 27 Dec 2016 - 01:06 |
| dataprovider.com | 48+4 | 1.80 MB | 25 Dec 2016 - 11:52 |
| YandexImageResizer | 51 | 6.15 MB | 30 Dec 2016 - 06:13 |
| spider | 47+2 | 775.64 KB | 27 Dec 2016 - 00:56 |
| Windows 99 - ( Rogue Robot ) | 48 | 5.97 MB | 30 Dec 2016 - 03:28 |
| MojeekBot | 23+25 | 455.66 KB | 31 Dec 2016 - 18:54 |
| Babya Discoverer | 46 | 275.10 KB | 31 Dec 2016 - 05:45 |
| MSIE 4 - ( Rogue Robot ) | 46 | 275.10 KB | 29 Dec 2016 - 11:10 |
| daum | 42+1 | 153.86 KB | 19 Dec 2016 - 06:43 |
| Google Page Speed | 42 | 2.33 MB | 24 Dec 2016 - 18:29 |
| msnbot | 40+1 | 671.49 KB | 02 Dec 2016 - 02:42 |
| ia_archiver | 36+5 | 1.48 MB | 31 Dec 2016 - 20:12 |
| Windows 95 - ( Rogue Robot ) | 41 | 245.20 KB | 31 Dec 2016 - 05:41 |
| core | 32 | 899.11 KB | 27 Dec 2016 - 06:50 |
| checker | 32 | 452.28 KB | 31 Dec 2016 - 04:10 |
| DomainStatsBot | 23+8 | 323.73 KB | 27 Dec 2016 - 14:53 |
| link | 30 | 711.72 KB | 28 Dec 2016 - 08:01 |
| HELLO Crawler | 23+6 | 467.83 KB | 31 Dec 2016 - 11:56 |
| Baiduspider-image | 28 | 1.80 MB | 31 Dec 2016 - 03:51 |
| PhantomJS | 22 | 1.18 MB | 04 Dec 2016 - 22:38 |
| phantom | 21 | 1.17 MB | 09 Dec 2016 - 12:47 |
| GarlikCrawler | 19 | 1.80 MB | 17 Dec 2016 - 11:01 |
| 2345Explorer | 18 | 474.45 KB | 31 Dec 2016 - 13:30 |
| Apache-HttpClient | 17 | 380.84 KB | 27 Dec 2016 - 15:13 |
| SafeDNSBot | 10+6 | 127.61 KB | 28 Dec 2016 - 16:00 |
| Applebot | 9+6 | 135.08 KB | 27 Dec 2016 - 01:25 |
| yeti | 12+2 | 66.72 KB | 25 Dec 2016 - 15:41 |
| mozilla/5.0 - ( Rogue Robot ) | 14 | 676.48 KB | 18 Dec 2016 - 18:48 |
| YandexMobileBot | 13 | 165.05 KB | 24 Dec 2016 - 03:35 |
| Microsoft Office Protocol Discovery | 13 | 0 | 30 Dec 2016 - 14:26 |
| scrapy | 12 | 665.41 KB | 22 Dec 2016 - 03:16 |
| ips-agent | 11+1 | 104.36 KB | 02 Dec 2016 - 10:40 |
| YisouSpider | 11 | 70.81 KB | 17 Dec 2016 - 12:02 |
| MixrankBot | 11 | 132.59 KB | 11 Dec 2016 - 11:07 |
| CheckMarkNetwork | 9 | 53.82 KB | 17 Dec 2016 - 07:53 |
| DuckDuckGo-Favicons-Bot | 9 | 53.82 KB | 31 Dec 2016 - 02:54 |
| roboto | 9 | 25.51 KB | 17 Dec 2016 - 07:53 |
| izsearch | 8+1 | 181.19 KB | 09 Dec 2016 - 06:18 |
| Curl | 9 | 29.90 KB | 30 Dec 2016 - 18:54 |
| qwantify | 9 | 244.97 KB | 30 Dec 2016 - 10:53 |
| gocrawl | 0+9 | 1.12 KB | 30 Dec 2016 - 05:56 |
| ltx71 | 1+7 | 33.39 KB | 30 Dec 2016 - 14:23 |
| seek | 4+4 | 24.42 KB | 22 Dec 2016 - 07:26 |
| Yandex ( catchall ) | 8 | 829.88 KB | 28 Dec 2016 - 15:38 |
| Dispatch | 7 | 885.39 KB | 27 Dec 2016 - 21:09 |
| Nautic Expo using Firefox/1.5 | 7 | 33.95 KB | 09 Dec 2016 - 16:06 |
| siteimprove | 6 | 35.88 KB | 29 Dec 2016 - 20:58 |
| netcraft | 6 | 5.98 KB | 10 Dec 2016 - 07:32 |
| custo | 6 | 158.15 KB | 21 Dec 2016 - 05:21 |
| nutch ( catchall ) | 3+3 | 83.35 KB | 29 Dec 2016 - 16:42 |
| Discordbot | 6 | 641.49 KB | 28 Dec 2016 - 15:50 |
| Gluten Free Crawler | 6 | 302.33 KB | 23 Dec 2016 - 16:10 |
| webcollage | 6 | 146.28 KB | 30 Dec 2016 - 16:46 |
| gigablastopensource | 3+3 | 62.72 KB | 20 Dec 2016 - 05:06 |
| robot | 3+2 | 53.20 KB | 12 Dec 2016 - 03:01 |
| Screaming Frog SEO Spider | 4+1 | 118.33 KB | 12 Dec 2016 - 11:26 |
| bnf.fr_bot | 3+1 | 74.48 KB | 01 Dec 2016 - 01:51 |
| zend_http_client | 4 | 109.76 KB | 06 Dec 2016 - 12:57 |
| Mechanize | 4 | 23.92 KB | 04 Dec 2016 - 03:44 |
| SurveyBot | 2+2 | 12.21 KB | 21 Dec 2016 - 23:46 |
| Mediapartners-Google | 4 | 46.24 KB | 05 Dec 2016 - 00:36 |
| filterdb.iss.net | 2+2 | 12.21 KB | 23 Dec 2016 - 14:52 |
| twitterbot | 2+2 | 29.53 KB | 21 Dec 2016 - 13:45 |
| Googlebot-Video | 4 | 5.27 MB | 11 Dec 2016 - 07:45 |
| TweetmemeBot | 3 | 73.69 KB | 25 Dec 2016 - 01:01 |
| mozilla/4.0 - ( Rogue Robot ) | 3 | 30.08 KB | 08 Dec 2016 - 01:37 |
| trendiction | 0+3 | 381 Bytes | 19 Dec 2016 - 03:10 |
| yacybot | 2+1 | 40.89 KB | 09 Dec 2016 - 10:09 |
| GrapeshotCrawler | 2+1 | 120.48 KB | 28 Dec 2016 - 11:51 |
| bl.uk_lddc_bot | 2+1 | 22.20 KB | 21 Dec 2016 - 05:32 |
| Konqueror | 3 | 16.97 KB | 24 Dec 2016 - 00:45 |
| 360Spider | 2+1 | 39.02 KB | 23 Dec 2016 - 10:27 |
| LWP::Simple | 3 | 17.94 KB | 23 Dec 2016 - 03:05 |
| nutch-1.4 | 1+1 | 53.18 KB | 17 Dec 2016 - 04:23 |
| genieo | 1+1 | 47.81 KB | 28 Dec 2016 - 17:28 |
| Feedfetcher-Google | 2 | 25.98 KB | 05 Dec 2016 - 05:50 |
| TurnitinBot | 1+1 | 4.80 KB | 14 Dec 2016 - 13:39 |
| Gigabot | 1+1 | 6.10 KB | 15 Dec 2016 - 02:52 |
| ssearch_bot | 1+1 | 24.43 KB | 25 Dec 2016 - 18:46 |
| yoozBot | 1+1 | 11.58 KB | 02 Dec 2016 - 09:29 |
| SafeSearch microdata crawler | 2 | 89.88 KB | 19 Dec 2016 - 16:07 |
| heritrix | 1+1 | 6.10 KB | 01 Dec 2016 - 18:01 |
| speedy | 1 | 33.03 KB | 21 Dec 2016 - 09:57 |
| daumoa | 1 | 27.37 KB | 07 Dec 2016 - 01:48 |
| PiplBot | 1 | 29.43 KB | 26 Dec 2016 - 18:34 |
| netnewswire | 1 | 13.21 KB | 02 Dec 2016 - 09:53 |
| psbot | 0+1 | 127 Bytes | 03 Dec 2016 - 06:15 |
| titan | 1 | 25.06 KB | 30 Dec 2016 - 04:14 |
| linkbot | 1 | 4.64 KB | 28 Dec 2016 - 20:17 |
| CRAZYWEBCRAWLER | 1 | 5.98 KB | 24 Dec 2016 - 11:35 |
| ning | 1 | 5.98 KB | 13 Dec 2016 - 18:55 |
| Yahoo Link Preview | 1 | 32.72 KB | 16 Dec 2016 - 13:07 |
| universalfeedparser | 1 | 121.70 KB | 01 Dec 2016 - 18:42 |
| KomodiaBot | 1 | 5.98 KB | 25 Dec 2016 - 10:25 |
| proximic | 0+1 | 127 Bytes | 19 Dec 2016 - 10:45 |
| ODP link checker | 1 | 0 | 23 Dec 2016 - 05:35 |
| ^[1-3]$ | 1 | 42.58 KB | 15 Dec 2016 - 17:10 |
|