| 174 different robots | Hits | Bandwidth | Last visit |
|---|
| AhrefsBot | 3,108+29 | 753.34 MB | 30 Apr 2016 - 23:59 |
| YandexImages | 3,470 | 11.02 MB | 30 Apr 2016 - 23:58 |
| bingbot | 23,976+185 | 641.96 MB | 30 Apr 2016 - 23:58 |
| Googlebot-Image | 6,448 | 39.59 MB | 30 Apr 2016 - 23:57 |
| YandexBot | 2,201+166 | 59.95 MB | 30 Apr 2016 - 23:47 |
| Google Web Preview | 2,904 | 51.08 MB | 30 Apr 2016 - 23:39 |
| Googlebot | 5,246+128 | 94.13 MB | 30 Apr 2016 - 23:30 |
| Googlebot-Mobile | 741 | 10.78 MB | 30 Apr 2016 - 23:22 |
| Yahoo! Slurp | 3,049+138 | 2.85 GB | 30 Apr 2016 - 23:21 |
| BLEXBot | 7,113+180 | 76.85 MB | 30 Apr 2016 - 23:19 |
| Baiduspider | 2,085+82 | 34.93 MB | 30 Apr 2016 - 22:36 |
| CCBot | 53+36 | 970.22 KB | 30 Apr 2016 - 22:18 |
| istellabot | 1,174+193 | 35.26 MB | 30 Apr 2016 - 21:48 |
| facebookexternalhit | 1,472 | 37.80 MB | 30 Apr 2016 - 21:48 |
| Exabot | 219+32 | 1.91 MB | 30 Apr 2016 - 21:46 |
| yahoocachesystem | 435 | 12.08 MB | 30 Apr 2016 - 21:38 |
| BingPreview | 1,174 | 32.85 MB | 30 Apr 2016 - 21:34 |
| Stratagems Kumo | 94+47 | 567.99 KB | 30 Apr 2016 - 21:32 |
| Sogou web spider | 79+26 | 1.43 MB | 30 Apr 2016 - 21:21 |
| Firefox version 10 and lower - various robots | 533+65 | 10.61 MB | 30 Apr 2016 - 21:16 |
| Gluten Free Crawler | 20 | 735.78 KB | 30 Apr 2016 - 21:00 |
| linkdexbot | 481+4 | 26.49 MB | 30 Apr 2016 - 20:53 |
| linkapediabot | 14+7 | 247.13 KB | 30 Apr 2016 - 20:27 |
| empty user agent string | 302+7 | 7.08 MB | 30 Apr 2016 - 20:13 |
| CFNetwork | 24+1 | 1.76 MB | 30 Apr 2016 - 18:09 |
| robot | 418+2 | 7.36 MB | 30 Apr 2016 - 17:32 |
| Uptimebot | 50+31 | 81.59 KB | 30 Apr 2016 - 16:45 |
| wordpress | 200 | 4.03 MB | 30 Apr 2016 - 16:12 |
| MSIE 6 - ( Rogue Robot ) | 3,783+3 | 60.84 MB | 30 Apr 2016 - 15:04 |
| msnbot-media | 212 | 899.08 MB | 30 Apr 2016 - 14:35 |
| ltx71 | 19 | 362.59 KB | 30 Apr 2016 - 14:29 |
| discover | 221 | 5.62 MB | 30 Apr 2016 - 14:24 |
| Yandex ( catchall ) | 7 | 1.01 MB | 30 Apr 2016 - 13:48 |
| MJ12bot | 5,192+287 | 74.18 MB | 30 Apr 2016 - 13:45 |
| Curl | 9+1 | 36.01 KB | 30 Apr 2016 - 13:38 |
| Java ( catchall ) | 213+5 | 5.69 MB | 30 Apr 2016 - 13:27 |
| YandexImageResizer | 64 | 11.12 MB | 30 Apr 2016 - 12:50 |
| Python-urllib | 12+5 | 506.41 KB | 30 Apr 2016 - 11:51 |
| Unknown robot (identified by hit on robots.txt) | 0+234 | 29.02 KB | 30 Apr 2016 - 10:49 |
| Domain Re-Animator Bot | 1,623 | 36.36 MB | 30 Apr 2016 - 10:04 |
| Googlebot-Video | 18 | 20.60 MB | 30 Apr 2016 - 09:22 |
| ia_archiver | 52+21 | 1.68 MB | 30 Apr 2016 - 07:45 |
| SeznamBot | 221+226 | 1.53 MB | 30 Apr 2016 - 07:26 |
| favicon | 109 | 1.70 MB | 30 Apr 2016 - 06:52 |
| msie8 - ( Rogue Robot ) | 88 | 700.00 KB | 30 Apr 2016 - 06:44 |
| twitterbot | 34+28 | 1013.70 KB | 30 Apr 2016 - 05:43 |
| Go-http-client | 82 | 1008.02 KB | 30 Apr 2016 - 05:25 |
| Dalvik | 112 | 2.83 MB | 30 Apr 2016 - 05:22 |
| MSIE 5 - ( Rogue Robot ) | 702 | 4.83 MB | 30 Apr 2016 - 03:26 |
| Windows 95 - ( Rogue Robot ) | 59 | 420.27 KB | 30 Apr 2016 - 03:24 |
| ICC-Crawler | 21+29 | 377.56 KB | 30 Apr 2016 - 03:16 |
| MSIE 4 - ( Rogue Robot ) | 58 | 380.58 KB | 30 Apr 2016 - 03:11 |
| Deepnet Explorer | 108 | 801.67 KB | 30 Apr 2016 - 02:45 |
| Babya Discoverer | 61 | 364.81 KB | 30 Apr 2016 - 02:45 |
| Spiderbot | 0+12 | 1.49 KB | 30 Apr 2016 - 02:38 |
| Mozilla Beta (Windows) - ( Rogue Robot ) | 97 | 580.11 KB | 30 Apr 2016 - 02:07 |
| MSIE 2 - ( Rogue Robot ) | 116 | 895.99 KB | 30 Apr 2016 - 01:17 |
| MSIECrawler | 45 | 269.12 KB | 30 Apr 2016 - 01:07 |
| mozilla/4.0 (compatible;) - ( Rogue Robot ) | 1,251 | 13.68 MB | 30 Apr 2016 - 00:34 |
| Baiduspider-image | 69 | 3.96 MB | 29 Apr 2016 - 21:41 |
| checker | 31 | 438.15 KB | 29 Apr 2016 - 19:43 |
| Windows 99 - ( Rogue Robot ) | 210+3 | 4.80 MB | 29 Apr 2016 - 16:52 |
| archive.org_bot | 921+80 | 12.57 MB | 29 Apr 2016 - 16:29 |
| imagecoccoc | 51+4 | 1.78 MB | 29 Apr 2016 - 15:55 |
| Xenu Link Sleuth | 54 | 1.32 MB | 29 Apr 2016 - 15:00 |
| DuckDuckGo-Favicons-Bot | 10 | 59.80 KB | 29 Apr 2016 - 14:10 |
| Wget | 27 | 1.83 MB | 29 Apr 2016 - 13:58 |
| python | 47+1 | 2.00 MB | 29 Apr 2016 - 13:46 |
| ichiro | 48+5 | 1.33 MB | 29 Apr 2016 - 13:33 |
| coccoc | 113+26 | 3.39 MB | 29 Apr 2016 - 08:06 |
| 360Spider | 6+5 | 117.32 KB | 29 Apr 2016 - 07:17 |
| MSIE 3 - ( Rogue Robot ) | 54 | 390.36 KB | 29 Apr 2016 - 02:25 |
| SafeDNSBot | 11+8 | 105.87 KB | 28 Apr 2016 - 20:41 |
| YisouSpider | 8+3 | 69.81 KB | 28 Apr 2016 - 19:10 |
| crawl | 510+23 | 9.50 MB | 28 Apr 2016 - 16:19 |
| James BOT | 78+8 | 6.39 MB | 28 Apr 2016 - 14:20 |
| Mediapartners-Google | 4 | 43.07 KB | 28 Apr 2016 - 13:50 |
| GrapeshotCrawler | 4+3 | 57.02 KB | 28 Apr 2016 - 13:50 |
| PiplBot | 8 | 159.76 KB | 28 Apr 2016 - 13:26 |
| DeuSu | 12+14 | 292.64 KB | 28 Apr 2016 - 12:01 |
| daum | 68+10 | 1.69 MB | 28 Apr 2016 - 11:44 |
| ng/1. | 1 | 20.31 KB | 28 Apr 2016 - 11:41 |
| qwantify | 341+42 | 6.04 MB | 28 Apr 2016 - 11:32 |
| spider | 2 | 20.45 KB | 28 Apr 2016 - 11:27 |
| commons-httpclient | 3 | 0 | 28 Apr 2016 - 11:19 |
| Unknown robot identified by bot\* | 102,066+41 | 20.75 GB | 28 Apr 2016 - 11:03 |
| Applebot | 21+13 | 284.95 KB | 28 Apr 2016 - 10:48 |
| perl | 1 | 14.47 KB | 28 Apr 2016 - 10:46 |
| rogerbot | 1+1 | 14.59 KB | 28 Apr 2016 - 10:09 |
| CMS Crawler | 1 | 5.98 KB | 28 Apr 2016 - 07:12 |
| Cliqzbot | 11+10 | 297.09 KB | 28 Apr 2016 - 06:42 |
| Google Page Speed | 42 | 2.33 MB | 27 Apr 2016 - 23:15 |
| Validator.nu | 1 | 5.98 KB | 27 Apr 2016 - 23:15 |
| simplepie | 1 | 5.98 KB | 27 Apr 2016 - 22:36 |
| yoozBot | 18+13 | 532.77 KB | 27 Apr 2016 - 18:46 |
| XoviBot | 23 | 774.48 KB | 27 Apr 2016 - 09:18 |
| Microsoft Office Protocol Discovery | 12 | 0 | 27 Apr 2016 - 07:36 |
| wallpaper | 3 | 39.18 KB | 27 Apr 2016 - 05:33 |
| feedburner | 2 | 0 | 27 Apr 2016 - 03:17 |
| mozilla/5.0 - ( Rogue Robot ) | 21 | 275.53 KB | 26 Apr 2016 - 13:49 |
| MegaIndex.ru | 874+1 | 16.11 MB | 26 Apr 2016 - 11:02 |
| SemrushBot | 17+21 | 841.11 KB | 26 Apr 2016 - 10:42 |
| genieo | 2+2 | 12.21 KB | 26 Apr 2016 - 10:22 |
| linkbot | 475+1 | 37.45 MB | 26 Apr 2016 - 08:38 |
| Mojolicious | 8 | 152.44 KB | 26 Apr 2016 - 08:10 |
| semanticbot | 28+2 | 418.68 KB | 26 Apr 2016 - 06:19 |
| 2345Explorer | 5 | 40.02 KB | 25 Apr 2016 - 20:55 |
| zend_http_client | 11 | 253.59 KB | 25 Apr 2016 - 16:24 |
| scrapy | 13 | 304.38 KB | 25 Apr 2016 - 13:58 |
| Screaming Frog SEO Spider | 13+3 | 1.14 MB | 25 Apr 2016 - 13:53 |
| titan | 3 | 50.76 KB | 25 Apr 2016 - 04:05 |
| link | 24 | 445.84 KB | 24 Apr 2016 - 12:15 |
| 007ac9 Crawler | 903+1 | 35.48 MB | 24 Apr 2016 - 11:52 |
| spbot | 2,857+12 | 52.74 MB | 24 Apr 2016 - 11:38 |
| LinkpadBot | 44 | 644.07 KB | 24 Apr 2016 - 06:33 |
| core | 4 | 119.80 KB | 23 Apr 2016 - 09:13 |
| filterdb.iss.net | 5+4 | 37.43 KB | 23 Apr 2016 - 06:26 |
| Feedfetcher-Google | 18 | 306.68 KB | 22 Apr 2016 - 15:13 |
| Dispatch | 4 | 579.09 KB | 22 Apr 2016 - 01:31 |
| ODP link checker | 3 | 5.34 KB | 22 Apr 2016 - 00:33 |
| smtbot | 439 | 9.14 MB | 21 Apr 2016 - 16:24 |
| wonderbot | 23+1 | 333.74 KB | 21 Apr 2016 - 11:55 |
| Mechanize | 1 | 5.98 KB | 21 Apr 2016 - 07:39 |
| mfibot | 34 | 483.96 KB | 21 Apr 2016 - 04:55 |
| Searchie | 26+26 | 353.31 KB | 20 Apr 2016 - 23:30 |
| TelegramBot | 1 | 31.59 KB | 20 Apr 2016 - 22:22 |
| GarlikCrawler | 8 | 837.99 KB | 20 Apr 2016 - 20:12 |
| fido | 152 | 330.35 KB | 20 Apr 2016 - 15:59 |
| ning | 2 | 66.45 KB | 20 Apr 2016 - 14:03 |
| SurveyBot | 2+2 | 12.21 KB | 20 Apr 2016 - 12:29 |
| PhantomJS | 25 | 1.21 MB | 20 Apr 2016 - 05:32 |
| woobot | 67+6 | 461.41 KB | 20 Apr 2016 - 05:32 |
| W3C_Validator | 1 | 5.98 KB | 20 Apr 2016 - 05:32 |
| scoutjet | 1+1 | 4.00 KB | 20 Apr 2016 - 03:36 |
| daumoa | 2 | 31.18 KB | 19 Apr 2016 - 21:04 |
| MojeekBot | 2+1 | 106.03 KB | 19 Apr 2016 - 20:30 |
| CUBOT | 1 | 11.23 KB | 19 Apr 2016 - 17:55 |
| A PHP script | 6 | 175.72 KB | 19 Apr 2016 - 07:59 |
| myse/Nutch | 0+2 | 254 Bytes | 19 Apr 2016 - 07:38 |
| SiteExplorer | 1+1 | 6.10 KB | 18 Apr 2016 - 23:01 |
| izsearch | 1+1 | 8.78 KB | 18 Apr 2016 - 13:50 |
| lipperhey | 44+4 | 1.32 MB | 18 Apr 2016 - 00:57 |
| rambler | 1 | 26.57 KB | 17 Apr 2016 - 10:03 |
| WbSrch/ | 1+1 | 6.10 KB | 16 Apr 2016 - 19:05 |
| crawler4j | 1 | 5.98 KB | 16 Apr 2016 - 02:50 |
| nutch ( catchall ) | 9+9 | 121.74 KB | 15 Apr 2016 - 22:43 |
| ZumBot | 44+2 | 2.34 MB | 15 Apr 2016 - 12:26 |
| YandexMobileBot | 3 | 32.00 KB | 13 Apr 2016 - 15:51 |
| Mail.RU Bot | 371+54 | 24.10 MB | 13 Apr 2016 - 08:06 |
| yeti | 8+2 | 100.64 KB | 13 Apr 2016 - 00:19 |
| seodiver | 4+2 | 117.72 KB | 12 Apr 2016 - 14:28 |
| bit.ly | 1+1 | 27.68 KB | 12 Apr 2016 - 08:55 |
| LWP::Simple | 2 | 11.96 KB | 11 Apr 2016 - 06:24 |
| Discordbot | 1 | 514.31 KB | 10 Apr 2016 - 21:58 |
| spyonweb | 1+1 | 6.10 KB | 10 Apr 2016 - 06:49 |
| PrivacyAwareBot | 84 | 4.66 MB | 09 Apr 2016 - 12:07 |
| msnbot | 1 | 5.98 KB | 08 Apr 2016 - 03:19 |
| DotBot | 356+86 | 5.45 MB | 07 Apr 2016 - 10:14 |
| nutch-1.4 | 1+1 | 6.10 KB | 07 Apr 2016 - 03:24 |
| netcraft | 3 | 5.98 KB | 06 Apr 2016 - 20:47 |
| SafeSearch microdata crawler | 1 | 6.64 KB | 06 Apr 2016 - 12:49 |
| riddler | 152+34 | 2.99 MB | 06 Apr 2016 - 12:26 |
| W3C-checklink | 1+1 | 127 Bytes | 06 Apr 2016 - 11:27 |
| trendiction | 0+2 | 254 Bytes | 05 Apr 2016 - 23:22 |
| Wotbox | 365+1 | 6.05 MB | 05 Apr 2016 - 16:41 |
| roboto | 2 | 8.82 KB | 05 Apr 2016 - 10:00 |
| Digincore | 2 | 11.96 KB | 05 Apr 2016 - 04:24 |
| Konqueror | 2 | 31.26 KB | 04 Apr 2016 - 20:07 |
| nbot | 1 | 32.24 KB | 03 Apr 2016 - 02:50 |
| TurnitinBot | 1,137+2 | 24.87 MB | 02 Apr 2016 - 22:58 |
| ips-agent | 11+1 | 104.36 KB | 02 Apr 2016 - 10:59 |
| vebidoobot | 3 | 17.94 KB | 02 Apr 2016 - 08:48 |
| BingLocalSearch | 1+1 | 6.10 KB | 02 Apr 2016 - 03:22 |
| TweetmemeBot | 1 | 24.31 KB | 01 Apr 2016 - 20:53 |
|