| 153 different robots | Hits | Bandwidth | Last visit |
|---|
| bingbot | 15,643+249 | 371.87 MB | 30 Jun 2016 - 23:59 |
| Google Web Preview | 1,688 | 30.74 MB | 30 Jun 2016 - 23:59 |
| Googlebot-Image | 3,202 | 23.18 MB | 30 Jun 2016 - 23:57 |
| Googlebot | 10,346+81 | 156.28 MB | 30 Jun 2016 - 23:56 |
| empty user agent string | 215+4 | 4.07 MB | 30 Jun 2016 - 23:55 |
| BingPreview | 812 | 35.30 MB | 30 Jun 2016 - 23:55 |
| SemrushBot | 1,250+29 | 78.04 MB | 30 Jun 2016 - 23:51 |
| MJ12bot | 5,520+218 | 71.31 MB | 30 Jun 2016 - 23:47 |
| Googlebot-Mobile | 670 | 10.77 MB | 30 Jun 2016 - 23:45 |
| yahoocachesystem | 175 | 5.36 MB | 30 Jun 2016 - 23:36 |
| istellabot | 867+100 | 10.47 MB | 30 Jun 2016 - 23:32 |
| Yahoo! Slurp | 4,014+76 | 2.81 GB | 30 Jun 2016 - 23:27 |
| Baiduspider | 1,358+15 | 24.77 MB | 30 Jun 2016 - 23:26 |
| MSIE 6 - ( Rogue Robot ) | 2,153 | 21.11 MB | 30 Jun 2016 - 22:57 |
| Firefox version 10 and lower - various robots | 552+45 | 12.99 MB | 30 Jun 2016 - 22:57 |
| facebookexternalhit | 748 | 20.37 MB | 30 Jun 2016 - 22:54 |
| Unknown robot (identified by hit on robots.txt) | 0+189 | 23.44 KB | 30 Jun 2016 - 22:53 |
| crawl | 25+12 | 770.72 KB | 30 Jun 2016 - 22:53 |
| CCBot | 90+65 | 1.44 MB | 30 Jun 2016 - 22:32 |
| linkdexbot | 331+5 | 16.63 MB | 30 Jun 2016 - 21:45 |
| SeznamBot | 1,928+170 | 35.50 MB | 30 Jun 2016 - 21:39 |
| bloglovin | 2 | 25.55 KB | 30 Jun 2016 - 21:35 |
| msnbot-media | 101 | 454.67 MB | 30 Jun 2016 - 21:32 |
| Sogou web spider | 41+21 | 862.70 KB | 30 Jun 2016 - 20:50 |
| qwantify | 356+23 | 9.03 MB | 30 Jun 2016 - 20:09 |
| Mozilla Beta (Windows) - ( Rogue Robot ) | 65 | 487.09 KB | 30 Jun 2016 - 19:41 |
| MSIE 5 - ( Rogue Robot ) | 325 | 2.14 MB | 30 Jun 2016 - 19:35 |
| favicon | 63 | 402.04 KB | 30 Jun 2016 - 19:30 |
| AhrefsBot | 1,377+21 | 294.68 MB | 30 Jun 2016 - 18:54 |
| siteimprove | 2 | 11.96 KB | 30 Jun 2016 - 17:33 |
| spiderman | 19 | 113.63 KB | 30 Jun 2016 - 17:22 |
| Exabot | 48+22 | 483.31 KB | 30 Jun 2016 - 16:49 |
| Dalvik | 60 | 1.35 MB | 30 Jun 2016 - 16:24 |
| ltx71 | 3+2 | 32.16 KB | 30 Jun 2016 - 15:46 |
| daum | 3+3 | 77.49 KB | 30 Jun 2016 - 15:41 |
| Wget | 30+2 | 649.49 KB | 30 Jun 2016 - 14:51 |
| Baiduspider-image | 36 | 2.25 MB | 30 Jun 2016 - 14:45 |
| James BOT | 51+5 | 2.68 MB | 30 Jun 2016 - 14:31 |
| Microsoft Office Protocol Discovery | 4 | 0 | 30 Jun 2016 - 11:31 |
| wordpress | 34 | 104.20 KB | 30 Jun 2016 - 11:06 |
| facebook | 2 | 4.24 KB | 30 Jun 2016 - 11:06 |
| Xenu Link Sleuth | 2 | 5.98 KB | 30 Jun 2016 - 11:02 |
| Curl | 9 | 146.06 KB | 30 Jun 2016 - 10:04 |
| domainappender | 27+18 | 185.50 KB | 30 Jun 2016 - 09:18 |
| MSIE 2 - ( Rogue Robot ) | 37 | 258.12 KB | 30 Jun 2016 - 09:18 |
| Deepnet Explorer | 41 | 297.26 KB | 30 Jun 2016 - 08:50 |
| Babya Discoverer | 27 | 179.90 KB | 30 Jun 2016 - 08:42 |
| MSIECrawler | 23 | 137.55 KB | 30 Jun 2016 - 08:40 |
| Windows 95 - ( Rogue Robot ) | 19 | 113.63 KB | 30 Jun 2016 - 08:32 |
| seoscanners | 2+1 | 12.08 KB | 30 Jun 2016 - 06:27 |
| yeti | 64+9 | 1.19 MB | 30 Jun 2016 - 05:54 |
| 2345Explorer | 3 | 72.71 KB | 30 Jun 2016 - 04:20 |
| Applebot | 60+29 | 1.12 MB | 30 Jun 2016 - 03:26 |
| Nautic Expo using Firefox/1.5 | 5 | 154.28 KB | 30 Jun 2016 - 03:00 |
| Unknown robot identified by bot\* | 36,681+10 | 7.46 GB | 30 Jun 2016 - 02:40 |
| CFNetwork | 53 | 1.20 MB | 30 Jun 2016 - 02:23 |
| checker | 25 | 353.34 KB | 30 Jun 2016 - 01:49 |
| YandexBot | 1,191+91 | 25.39 MB | 30 Jun 2016 - 01:00 |
| Python-urllib | 28+3 | 806.31 KB | 29 Jun 2016 - 23:46 |
| archive.org_bot | 767+29 | 15.12 MB | 29 Jun 2016 - 23:13 |
| twitterbot | 57+41 | 2.21 MB | 29 Jun 2016 - 18:55 |
| mozilla/4.0 - ( Rogue Robot ) | 0+1 | 127 Bytes | 29 Jun 2016 - 18:39 |
| Googlebot-Video | 3 | 1.96 MB | 29 Jun 2016 - 16:33 |
| ia_archiver | 32+17 | 492.11 KB | 29 Jun 2016 - 15:54 |
| robot | 413 | 7.29 MB | 29 Jun 2016 - 14:33 |
| python | 5+1 | 101.43 KB | 29 Jun 2016 - 14:17 |
| mozilla/4.0 (compatible;) - ( Rogue Robot ) | 736 | 9.67 MB | 29 Jun 2016 - 12:39 |
| discover | 178 | 4.79 MB | 29 Jun 2016 - 10:47 |
| MSIE 4 - ( Rogue Robot ) | 27 | 159.55 KB | 29 Jun 2016 - 10:44 |
| SEOkicks-Robot | 16+4 | 151.55 KB | 29 Jun 2016 - 10:12 |
| scrapy | 6 | 87.56 KB | 29 Jun 2016 - 08:07 |
| XoviBot | 24 | 789.30 KB | 29 Jun 2016 - 05:16 |
| Gluten Free Crawler | 5 | 200.71 KB | 28 Jun 2016 - 23:13 |
| PiplBot | 2 | 42.52 KB | 28 Jun 2016 - 20:51 |
| Windows 99 - ( Rogue Robot ) | 95+1 | 8.02 MB | 28 Jun 2016 - 19:23 |
| dataprovider.com | 76+6 | 2.15 MB | 28 Jun 2016 - 17:17 |
| YandexImages | 3,172 | 33.70 MB | 28 Jun 2016 - 16:52 |
| Java ( catchall ) | 151+8 | 3.06 MB | 28 Jun 2016 - 12:29 |
| PhantomJS | 21 | 1.17 MB | 28 Jun 2016 - 10:39 |
| coccoc | 16+13 | 267.25 KB | 28 Jun 2016 - 09:14 |
| TweetmemeBot | 4 | 131.68 KB | 28 Jun 2016 - 06:51 |
| MSIE 3 - ( Rogue Robot ) | 24 | 143.53 KB | 28 Jun 2016 - 04:59 |
| DotBot | 1,856+647 | 20.04 MB | 28 Jun 2016 - 00:23 |
| YandexMobileBot | 276 | 3.14 MB | 27 Jun 2016 - 22:42 |
| 360Spider | 6+2 | 197.76 KB | 27 Jun 2016 - 18:23 |
| DuckDuckGo-Favicons-Bot | 7 | 41.86 KB | 27 Jun 2016 - 17:16 |
| imagecoccoc | 27+3 | 1.36 MB | 27 Jun 2016 - 12:47 |
| SafeSearch microdata crawler | 2 | 39.52 KB | 27 Jun 2016 - 12:18 |
| YisouSpider | 4 | 7.49 KB | 27 Jun 2016 - 10:38 |
| Konqueror | 2 | 106.75 KB | 27 Jun 2016 - 08:24 |
| Feedfetcher-Google | 10 | 1.12 MB | 15 Jun 2016 - 15:03 |
| nutch ( catchall ) | 6+5 | 104.94 KB | 15 Jun 2016 - 13:17 |
| DeuSu | 9+9 | 202.78 KB | 15 Jun 2016 - 13:01 |
| ICC-Crawler | 7+7 | 124.48 KB | 15 Jun 2016 - 12:04 |
| viz/Nutch | 6+4 | 59.96 KB | 15 Jun 2016 - 08:48 |
| Mail.RU Bot | 179+51 | 2.02 MB | 15 Jun 2016 - 05:09 |
| BingLocalSearch | 1+1 | 6.10 KB | 15 Jun 2016 - 01:18 |
| CMS Crawler | 1 | 5.98 KB | 14 Jun 2016 - 11:39 |
| GarlikCrawler | 133+1 | 9.07 MB | 14 Jun 2016 - 11:14 |
| spbot | 1,899+7 | 35.30 MB | 14 Jun 2016 - 09:59 |
| msie8 - ( Rogue Robot ) | 16 | 156.67 KB | 14 Jun 2016 - 07:05 |
| SiteExplorer | 139+2 | 2.73 MB | 14 Jun 2016 - 03:43 |
| daumoa | 4 | 36.96 KB | 14 Jun 2016 - 03:34 |
| scoutjet | 1+1 | 6.48 KB | 14 Jun 2016 - 01:59 |
| zend_http_client | 11 | 350.95 KB | 13 Jun 2016 - 21:39 |
| Uptimebot | 3+4 | 12.46 KB | 13 Jun 2016 - 16:47 |
| seodiver | 2+2 | 53.00 KB | 13 Jun 2016 - 16:38 |
| Yandex ( catchall ) | 2 | 136.56 KB | 13 Jun 2016 - 15:14 |
| microsoft url control | 32 | 635.53 KB | 13 Jun 2016 - 14:14 |
| trendiction | 0+1 | 127 Bytes | 13 Jun 2016 - 12:25 |
| nutch-1.4 | 1+1 | 6.10 KB | 13 Jun 2016 - 07:31 |
| perl | 1 | 40.29 KB | 12 Jun 2016 - 22:32 |
| rogerbot | 1 | 0 | 12 Jun 2016 - 22:31 |
| Dispatch | 1 | 40.29 KB | 12 Jun 2016 - 22:30 |
| SafeDNSBot | 6+4 | 57.62 KB | 12 Jun 2016 - 22:09 |
| MojeekBot | 2+3 | 46.06 KB | 12 Jun 2016 - 09:57 |
| YandexImageResizer | 4 | 208.41 KB | 12 Jun 2016 - 05:48 |
| electricmonk | 1+1 | 6.10 KB | 11 Jun 2016 - 19:11 |
| NRLCorpusBuilder/Nutch | 0+1 | 127 Bytes | 11 Jun 2016 - 09:51 |
| netcraft | 4 | 11.96 KB | 11 Jun 2016 - 00:05 |
| Discordbot | 1 | 2.17 KB | 10 Jun 2016 - 16:46 |
| Screaming Frog SEO Spider | 6+2 | 148.97 KB | 10 Jun 2016 - 08:48 |
| roboto | 2 | 8.82 KB | 10 Jun 2016 - 05:50 |
| genieo | 1+1 | 6.10 KB | 09 Jun 2016 - 23:57 |
| ichiro | 33+4 | 1.05 MB | 09 Jun 2016 - 18:19 |
| LinkCheck | 1 | 8.05 KB | 09 Jun 2016 - 17:17 |
| EmailMarketingRobot | 3 | 92.97 KB | 09 Jun 2016 - 05:54 |
| webcollage | 1 | 33.39 KB | 09 Jun 2016 - 05:28 |
| FirePHP | 1 | 31.72 KB | 09 Jun 2016 - 00:25 |
| Apache-HttpClient | 4 | 35.17 KB | 08 Jun 2016 - 17:55 |
| filterdb.iss.net | 4+4 | 24.42 KB | 08 Jun 2016 - 16:22 |
| SurveyBot | 1+1 | 6.10 KB | 07 Jun 2016 - 12:59 |
| Go-http-client | 1 | 104.20 KB | 07 Jun 2016 - 11:59 |
| mozilla/5.0 - ( Rogue Robot ) | 11 | 687.23 KB | 06 Jun 2016 - 18:04 |
| link | 1 | 26.36 KB | 06 Jun 2016 - 14:23 |
| Yahoo Link Preview | 1 | 5.98 KB | 06 Jun 2016 - 11:10 |
| ZumBot | 23+1 | 1.19 MB | 05 Jun 2016 - 22:56 |
| vBSEO | 1 | 37.79 KB | 05 Jun 2016 - 20:58 |
| smtbot | 101 | 1.78 MB | 05 Jun 2016 - 20:32 |
| Google Page Speed | 84 | 4.66 MB | 04 Jun 2016 - 19:41 |
| KomodiaBot | 1 | 5.98 KB | 04 Jun 2016 - 03:27 |
| yie8 | 8 | 135.22 KB | 03 Jun 2016 - 20:04 |
| ELinks | 3 | 18.49 KB | 03 Jun 2016 - 18:13 |
| riddler | 1+2 | 20.92 KB | 03 Jun 2016 - 08:57 |
| GrapeshotCrawler | 1 | 5.98 KB | 03 Jun 2016 - 07:46 |
| spider | 1 | 5.98 KB | 03 Jun 2016 - 07:38 |
| msnbot | 1 | 5.98 KB | 03 Jun 2016 - 07:38 |
| ips-agent | 11+1 | 104.36 KB | 02 Jun 2016 - 11:19 |
| semanticbot | 1 | 0 | 02 Jun 2016 - 06:50 |
| Spiderbot | 1+2 | 14.62 KB | 02 Jun 2016 - 05:08 |
| gocrawl | 0+1 | 127 Bytes | 01 Jun 2016 - 06:38 |
| ocrawler; | 1 | 5.98 KB | 01 Jun 2016 - 05:21 |
| betabot | 0+1 | 127 Bytes | 01 Jun 2016 - 00:08 |
|