| 143 different robots | Hits | Bandwidth | Last visit |
|---|
| bingbot | 24,212+173 | 478.21 MB | 31 Jul 2017 - 23:59 |
| Baiduspider | 2,328+6 | 68.64 MB | 31 Jul 2017 - 23:58 |
| empty user agent string | 1,089+7 | 38.97 MB | 31 Jul 2017 - 23:58 |
| Unknown robot (identified by hit on robots.txt) | 0+141 | 17.36 KB | 31 Jul 2017 - 23:57 |
| DotBot | 879+636 | 23.04 MB | 31 Jul 2017 - 23:57 |
| YandexBot | 502+253 | 9.70 MB | 31 Jul 2017 - 23:57 |
| Googlebot | 2,793+57 | 55.72 MB | 31 Jul 2017 - 23:56 |
| MSIE 6 - ( Rogue Robot ) | 2,474 | 46.46 MB | 31 Jul 2017 - 23:50 |
| Googlebot-Image | 5,707 | 31.01 MB | 31 Jul 2017 - 23:50 |
| SeznamBot | 2,231+247 | 21.70 MB | 31 Jul 2017 - 23:26 |
| BingPreview | 1,747 | 45.42 MB | 31 Jul 2017 - 23:01 |
| Yahoo! Slurp | 1,618+78 | 33.86 MB | 31 Jul 2017 - 22:59 |
| Firefox version 10 and lower - various robots | 250+26 | 8.60 MB | 31 Jul 2017 - 22:58 |
| MJ12bot | 1,216+204 | 16.68 MB | 31 Jul 2017 - 22:49 |
| James BOT | 69+8 | 3.91 MB | 31 Jul 2017 - 22:41 |
| facebookexternalhit | 463 | 14.81 MB | 31 Jul 2017 - 22:36 |
| coccoc | 59+47 | 1.56 MB | 31 Jul 2017 - 21:53 |
| python | 503 | 1.71 MB | 31 Jul 2017 - 21:52 |
| scrapy | 3 | 37.30 KB | 31 Jul 2017 - 21:45 |
| linkdexbot | 480+6 | 27.57 MB | 31 Jul 2017 - 21:07 |
| SemrushBot | 3,892+108 | 78.16 MB | 31 Jul 2017 - 20:10 |
| MojeekBot | 35+16 | 637.73 KB | 31 Jul 2017 - 19:38 |
| CUBOT | 1 | 21.91 KB | 31 Jul 2017 - 19:35 |
| Baiduspider-image | 87 | 5.27 MB | 31 Jul 2017 - 19:09 |
| Pinterestbot | 198+6 | 2.60 MB | 31 Jul 2017 - 18:55 |
| Google Web Preview | 2,122 | 41.96 MB | 31 Jul 2017 - 18:43 |
| GrapeshotCrawler | 5+3 | 43.97 KB | 31 Jul 2017 - 18:30 |
| yahoocachesystem | 491 | 13.50 MB | 31 Jul 2017 - 17:49 |
| BLEXBot | 33+9 | 1.01 MB | 31 Jul 2017 - 17:32 |
| favicon | 152 | 1.48 MB | 31 Jul 2017 - 17:32 |
| proximic | 3+2 | 31.88 KB | 31 Jul 2017 - 17:30 |
| Applebot | 17+14 | 330.59 KB | 31 Jul 2017 - 16:36 |
| spbot | 2,841+13 | 52.04 MB | 31 Jul 2017 - 16:33 |
| checker | 11 | 155.47 KB | 31 Jul 2017 - 14:05 |
| istellabot | 887+135 | 23.44 MB | 31 Jul 2017 - 13:25 |
| Yandex ( catchall ) | 11 | 469.28 KB | 31 Jul 2017 - 12:28 |
| wordpress | 53 | 0 | 31 Jul 2017 - 11:52 |
| Python-urllib | 38+2 | 1.51 MB | 31 Jul 2017 - 11:04 |
| YandexMobileBot | 52 | 857.65 KB | 31 Jul 2017 - 10:45 |
| Mediatoolkitbot | 0+5 | 635 Bytes | 31 Jul 2017 - 10:39 |
| Windows 99 - ( Rogue Robot ) | 2 | 87.89 KB | 31 Jul 2017 - 09:15 |
| ia_archiver | 62+37 | 1.28 MB | 31 Jul 2017 - 08:47 |
| CFNetwork | 29 | 2.98 MB | 31 Jul 2017 - 08:43 |
| Sogou web spider | 4+3 | 106.87 KB | 31 Jul 2017 - 08:08 |
| daumoa | 1,075 | 3.99 MB | 31 Jul 2017 - 07:03 |
| Java ( catchall ) | 119+59 | 3.55 MB | 31 Jul 2017 - 07:00 |
| Unknown robot identified by bot\* | 220,107+23 | 6.26 GB | 31 Jul 2017 - 05:34 |
| Screaming Frog SEO Spider | 4 | 819.81 KB | 31 Jul 2017 - 03:28 |
| Babya Discoverer | 14 | 118.76 KB | 31 Jul 2017 - 02:49 |
| MSIE 2 - ( Rogue Robot ) | 36 | 477.92 KB | 31 Jul 2017 - 02:49 |
| MSIE 5 - ( Rogue Robot ) | 182 | 2.05 MB | 31 Jul 2017 - 02:49 |
| SafeDNSBot | 7+5 | 99.21 KB | 31 Jul 2017 - 02:45 |
| YandexImageResizer | 67 | 4.95 MB | 31 Jul 2017 - 02:43 |
| Windows 95 - ( Rogue Robot ) | 20 | 228.56 KB | 31 Jul 2017 - 02:40 |
| MSIE 4 - ( Rogue Robot ) | 21 | 157.42 KB | 31 Jul 2017 - 02:20 |
| MSIE 3 - ( Rogue Robot ) | 13 | 151.66 KB | 31 Jul 2017 - 02:17 |
| Mozilla Beta (Windows) - ( Rogue Robot ) | 25 | 257.18 KB | 31 Jul 2017 - 02:07 |
| Deepnet Explorer | 30 | 227.16 KB | 31 Jul 2017 - 02:05 |
| archive.org_bot | 49+26 | 1.57 MB | 31 Jul 2017 - 00:16 |
| TurnitinBot | 1+1 | 14.53 KB | 30 Jul 2017 - 21:12 |
| link | 16 | 338.14 KB | 30 Jul 2017 - 17:16 |
| Konqueror | 45 | 806.31 KB | 30 Jul 2017 - 12:24 |
| Discordbot | 3 | 564.74 KB | 30 Jul 2017 - 09:03 |
| MSIECrawler | 12 | 127.20 KB | 30 Jul 2017 - 05:00 |
| Exabot | 125+20 | 1.49 MB | 30 Jul 2017 - 04:07 |
| Mail.RU Bot | 1,809+196 | 36.02 MB | 30 Jul 2017 - 02:50 |
| YandexImages | 1,984 | 2.31 MB | 30 Jul 2017 - 00:29 |
| Dalvik | 78 | 1.83 MB | 29 Jul 2017 - 21:07 |
| crawl | 688+29 | 341.00 MB | 29 Jul 2017 - 20:31 |
| Go-http-client | 98+3 | 2.25 MB | 29 Jul 2017 - 16:35 |
| dataprovider.com | 12+1 | 396.06 KB | 29 Jul 2017 - 13:47 |
| twitterbot | 2+2 | 21.89 KB | 29 Jul 2017 - 11:40 |
| vebidoobot | 609+1 | 6.35 MB | 29 Jul 2017 - 11:19 |
| SurveyBot | 2+2 | 12.21 KB | 29 Jul 2017 - 10:33 |
| yeti | 106+9 | 2.40 MB | 29 Jul 2017 - 08:39 |
| nutch ( catchall ) | 14+5 | 238.47 KB | 29 Jul 2017 - 07:06 |
| Wget | 31 | 930.09 KB | 29 Jul 2017 - 03:21 |
| LWP::Simple | 3 | 17.94 KB | 29 Jul 2017 - 03:10 |
| GarlikCrawler | 171+6 | 4.29 MB | 28 Jul 2017 - 19:01 |
| DuckDuckGo-Favicons-Bot | 9 | 53.82 KB | 28 Jul 2017 - 17:00 |
| YisouSpider | 10 | 124.45 KB | 28 Jul 2017 - 14:45 |
| Uptimebot | 56+3 | 42.24 KB | 28 Jul 2017 - 12:37 |
| msie8 - ( Rogue Robot ) | 177 | 2.27 MB | 28 Jul 2017 - 08:06 |
| mozilla/4.0 (compatible;) - ( Rogue Robot ) | 96 | 4.65 MB | 28 Jul 2017 - 07:52 |
| trendiction | 3+2 | 625.35 KB | 28 Jul 2017 - 06:32 |
| Prlog | 1+1 | 6.10 KB | 28 Jul 2017 - 05:39 |
| Xenu Link Sleuth | 3 | 0 | 28 Jul 2017 - 05:29 |
| LinkedInBot | 2+2 | 12.21 KB | 27 Jul 2017 - 23:50 |
| Gluten Free Crawler | 12 | 564.20 KB | 27 Jul 2017 - 21:57 |
| LinkCheck | 6 | 32.42 KB | 27 Jul 2017 - 21:41 |
| Googlebot-Video | 6 | 5.01 MB | 27 Jul 2017 - 21:39 |
| SEOkicks-Robot | 23+4 | 483.07 KB | 27 Jul 2017 - 14:11 |
| bubing | 6+5 | 241.69 KB | 27 Jul 2017 - 13:12 |
| CCBot | 502+12 | 6.70 MB | 27 Jul 2017 - 12:48 |
| AhrefsBot | 3,422+35 | 671.55 MB | 27 Jul 2017 - 09:52 |
| phantom | 43 | 2.35 MB | 27 Jul 2017 - 09:21 |
| yie8 | 1 | 9.39 KB | 26 Jul 2017 - 12:51 |
| filterdb.iss.net | 8+4 | 111.18 KB | 26 Jul 2017 - 11:54 |
| PhantomJS | 105 | 5.83 MB | 26 Jul 2017 - 10:37 |
| mozilla/4.0 - ( Rogue Robot ) | 1 | 6.52 KB | 25 Jul 2017 - 17:02 |
| psbot | 45+3 | 561.74 KB | 25 Jul 2017 - 13:10 |
| spider | 8 | 324.80 KB | 25 Jul 2017 - 03:58 |
| siteimprove | 4 | 23.92 KB | 25 Jul 2017 - 02:21 |
| core | 2 | 35.13 KB | 24 Jul 2017 - 20:21 |
| TweetmemeBot | 6 | 210.10 KB | 24 Jul 2017 - 15:39 |
| SiteExplorer | 292+20 | 4.93 MB | 24 Jul 2017 - 08:48 |
| qwantify | 2,271+44 | 41.81 MB | 24 Jul 2017 - 07:46 |
| Findxbot | 353+8 | 21.01 MB | 24 Jul 2017 - 00:12 |
| Microsoft Office Protocol Discovery | 9 | 0 | 23 Jul 2017 - 18:48 |
| robot | 6+3 | 208.48 KB | 23 Jul 2017 - 12:42 |
| MegaIndex.ru | 2+2 | 12.21 KB | 22 Jul 2017 - 11:47 |
| Apache-HttpClient | 4 | 170.09 KB | 22 Jul 2017 - 02:01 |
| BingLocalSearch | 22+2 | 323.39 KB | 21 Jul 2017 - 19:21 |
| gocrawl | 0+2 | 254 Bytes | 21 Jul 2017 - 07:03 |
| DomainStatsBot | 23+5 | 323.76 KB | 20 Jul 2017 - 20:39 |
| linkwalker | 62+1 | 935.25 KB | 20 Jul 2017 - 13:11 |
| yoozBot | 9+6 | 165.19 KB | 20 Jul 2017 - 13:01 |
| Curl | 7 | 89.90 KB | 20 Jul 2017 - 10:59 |
| Pcore | 903 | 16.21 MB | 20 Jul 2017 - 08:45 |
| libwww-perl | 1 | 5.98 KB | 20 Jul 2017 - 00:01 |
| Cliqzbot | 22+23 | 1.03 MB | 19 Jul 2017 - 05:12 |
| universalfeedparser | 1 | 121.33 KB | 18 Jul 2017 - 17:24 |
| FirePHP | 3 | 23.26 KB | 18 Jul 2017 - 08:45 |
| ltx71 | 1+1 | 50.51 KB | 18 Jul 2017 - 04:17 |
| Feedfetcher-Google | 3 | 89.78 KB | 16 Jul 2017 - 18:39 |
| sven | 1+1 | 27.49 KB | 14 Jul 2017 - 22:27 |
| facebook | 1 | 57.38 KB | 14 Jul 2017 - 12:17 |
| 360Spider | 3+1 | 29.73 KB | 13 Jul 2017 - 04:01 |
| DuckDuckBot | 1 | 17.94 KB | 12 Jul 2017 - 15:55 |
| robi | 1 | 14.32 KB | 12 Jul 2017 - 07:00 |
| Google Page Speed | 21 | 1.17 MB | 10 Jul 2017 - 14:24 |
| daum | 6+3 | 66.47 KB | 09 Jul 2017 - 02:55 |
| TestCrawler | 2,392+3 | 33.68 MB | 07 Jul 2017 - 07:19 |
| crawler4j | 1 | 5.98 KB | 07 Jul 2017 - 02:07 |
| Links ( | 2 | 114.12 KB | 07 Jul 2017 - 00:29 |
| netcraft | 2 | 5.98 KB | 06 Jul 2017 - 23:16 |
| Mechanize | 1 | 12.71 KB | 06 Jul 2017 - 14:58 |
| 2345Explorer | 2 | 18.88 KB | 04 Jul 2017 - 23:21 |
| ips-agent | 10+1 | 106.09 KB | 04 Jul 2017 - 20:47 |
| HubSpot Webcrawler | 1 | 5.93 KB | 04 Jul 2017 - 15:27 |
| linkchecker | 2 | 25.42 KB | 04 Jul 2017 - 02:17 |
| A PHP script | 1 | 3.25 KB | 02 Jul 2017 - 07:37 |
| DeuSu | 14+1 | 284.82 KB | 02 Jul 2017 - 03:21 |
|