| 125 different robots | Hits | Bandwidth | Last visit |
|---|
| bingbot | 8,142+171 | 188.20 MB | 31 Dec 2019 - 23:58 |
| msnbot | 966+56 | 19.24 MB | 31 Dec 2019 - 23:57 |
| Googlebot | 3,948+65 | 81.01 MB | 31 Dec 2019 - 23:49 |
| SemrushBot | 5,567+2598 | 89.31 MB | 31 Dec 2019 - 23:47 |
| YandexBot | 1,009+323 | 32.63 MB | 31 Dec 2019 - 23:47 |
| daum | 11+2 | 314.21 KB | 31 Dec 2019 - 23:42 |
| SeznamBot | 1,380+312 | 11.62 MB | 31 Dec 2019 - 23:32 |
| DotBot | 732+42 | 10.30 MB | 31 Dec 2019 - 23:30 |
| MJ12bot | 1,896+311 | 33.96 MB | 31 Dec 2019 - 23:29 |
| Applebot | 1,023+55 | 18.84 MB | 31 Dec 2019 - 23:29 |
| BingPreview | 497 | 10.72 MB | 31 Dec 2019 - 23:21 |
| Mail.RU Bot | 282+184 | 6.03 MB | 31 Dec 2019 - 22:49 |
| Discordbot | 4 | 64.05 KB | 31 Dec 2019 - 22:35 |
| Dalvik | 50 | 1.18 MB | 31 Dec 2019 - 22:33 |
| link | 1,739 | 41.92 MB | 31 Dec 2019 - 22:30 |
| Unknown robot (identified by hit on robots.txt) | 0+139 | 16.79 KB | 31 Dec 2019 - 22:30 |
| Sogou web spider | 161+199 | 1.70 MB | 31 Dec 2019 - 22:01 |
| Go-http-client | 277+1 | 21.00 MB | 31 Dec 2019 - 21:56 |
| AhrefsBot | 7,228+123 | 942.65 MB | 31 Dec 2019 - 21:39 |
| MSIE 6 - ( Rogue Robot ) | 922 | 18.78 MB | 31 Dec 2019 - 21:38 |
| facebookexternalhit | 827 | 25.58 MB | 31 Dec 2019 - 21:37 |
| Firefox version 10 and lower - various robots | 268+8 | 11.17 MB | 31 Dec 2019 - 20:39 |
| Pinterestbot | 631+17 | 13.08 MB | 31 Dec 2019 - 20:30 |
| YandexImages | 278 | 3.01 MB | 31 Dec 2019 - 20:08 |
| checker | 76+1 | 1.04 MB | 31 Dec 2019 - 20:00 |
| Baiduspider ( catchall ) | 309 | 4.34 MB | 31 Dec 2019 - 19:26 |
| Baiduspider | 232+9 | 93.72 MB | 31 Dec 2019 - 19:26 |
| favicon | 58 | 417.51 KB | 31 Dec 2019 - 19:17 |
| The Knowledge AI | 11,011+98 | 1.73 GB | 31 Dec 2019 - 18:01 |
| MSIE 5 - ( Rogue Robot ) | 163 | 2.90 MB | 31 Dec 2019 - 17:56 |
| Googlebot-Image | 1,051 | 13.17 MB | 31 Dec 2019 - 17:00 |
| YandexMobileBot | 44 | 433.45 KB | 31 Dec 2019 - 16:50 |
| MegaIndex.ru | 1,259+1 | 9.39 MB | 31 Dec 2019 - 16:03 |
| MojeekBot | 59+58 | 822.51 KB | 31 Dec 2019 - 15:13 |
| Windows 95 - ( Rogue Robot ) | 18 | 159.13 KB | 31 Dec 2019 - 14:56 |
| Babya Discoverer | 4 | 23.98 KB | 31 Dec 2019 - 14:50 |
| Deepnet Explorer | 7 | 42.16 KB | 31 Dec 2019 - 14:44 |
| MSIE 3 - ( Rogue Robot ) | 20 | 221.80 KB | 31 Dec 2019 - 14:44 |
| Apache-HttpClient | 496+1 | 3.13 MB | 31 Dec 2019 - 13:32 |
| internetarchive | 6 | 0 | 31 Dec 2019 - 12:49 |
| Yahoo! Slurp | 8 | 453.25 KB | 31 Dec 2019 - 12:22 |
| TweetmemeBot | 4 | 36.81 KB | 31 Dec 2019 - 12:20 |
| coccoc | 89+67 | 1.54 MB | 31 Dec 2019 - 11:00 |
| yahoocachesystem | 124 | 5.57 MB | 31 Dec 2019 - 10:25 |
| Python-urllib | 25+4 | 1.02 MB | 31 Dec 2019 - 09:51 |
| python | 249+4 | 994.14 KB | 31 Dec 2019 - 08:10 |
| empty user agent string | 261+6 | 5.43 MB | 31 Dec 2019 - 08:10 |
| DuckDuckGo-Favicons-Bot | 83 | 446.23 KB | 31 Dec 2019 - 07:49 |
| MSIE 2 - ( Rogue Robot ) | 25 | 252.11 KB | 31 Dec 2019 - 03:05 |
| Mozilla Beta (Windows) - ( Rogue Robot ) | 28 | 320.33 KB | 31 Dec 2019 - 03:01 |
| MSIECrawler | 8 | 48.48 KB | 31 Dec 2019 - 03:00 |
| 360Spider | 54+3 | 370.17 KB | 30 Dec 2019 - 22:50 |
| webcollage | 3 | 97.05 KB | 30 Dec 2019 - 20:37 |
| Bytespider | 190+7 | 2.92 MB | 30 Dec 2019 - 16:50 |
| Nimbostratus-Bot | 7 | 42.42 KB | 30 Dec 2019 - 15:46 |
| CFNetwork | 74 | 3.36 MB | 30 Dec 2019 - 14:24 |
| netcraft | 2 | 6.06 KB | 30 Dec 2019 - 09:44 |
| ia_archiver | 339+33 | 6.24 MB | 30 Dec 2019 - 08:26 |
| crawl | 948+18 | 23.44 MB | 30 Dec 2019 - 00:12 |
| core | 37 | 3.98 MB | 29 Dec 2019 - 16:20 |
| Unknown robot identified by bot\* | 117,362+143 | 5.10 GB | 29 Dec 2019 - 12:04 |
| proximic | 0+1 | 107 Bytes | 29 Dec 2019 - 10:08 |
| tracemyfile | 2+2 | 12.51 KB | 29 Dec 2019 - 04:41 |
| Gluten Free Crawler | 5 | 56.00 KB | 29 Dec 2019 - 01:16 |
| Java ( catchall ) | 395 | 8.03 MB | 28 Dec 2019 - 16:55 |
| YisouSpider | 91+6 | 1.38 MB | 28 Dec 2019 - 12:07 |
| GarlikCrawler | 35+2 | 788.50 KB | 27 Dec 2019 - 13:10 |
| YandexImageResizer | 6 | 174.26 KB | 27 Dec 2019 - 12:36 |
| MSIE 4 - ( Rogue Robot ) | 10 | 60.61 KB | 27 Dec 2019 - 04:54 |
| yeti | 84+9 | 4.02 MB | 27 Dec 2019 - 03:06 |
| mozilla/4.0 - ( Rogue Robot ) | 1 | 39.00 KB | 27 Dec 2019 - 01:48 |
| Curl | 32 | 2.01 MB | 26 Dec 2019 - 20:36 |
| fetcher | 18 | 400.88 KB | 26 Dec 2019 - 18:29 |
| nbot | 5 | 0 | 25 Dec 2019 - 23:07 |
| mozilla/5.0 - ( Rogue Robot ) | 4 | 38.45 KB | 25 Dec 2019 - 15:56 |
| facebook | 10 | 740.62 KB | 25 Dec 2019 - 14:59 |
| twitterbot | 3+3 | 61.00 KB | 24 Dec 2019 - 12:50 |
| libwww-perl | 1 | 13.56 KB | 24 Dec 2019 - 07:10 |
| robot | 14+13 | 860.67 KB | 23 Dec 2019 - 11:55 |
| linkdexbot | 57+3 | 4.19 MB | 23 Dec 2019 - 11:18 |
| wordpress | 15 | 27.84 KB | 23 Dec 2019 - 11:14 |
| qwantify | 211+37 | 31.83 MB | 23 Dec 2019 - 02:17 |
| Wget | 25 | 6.70 MB | 22 Dec 2019 - 15:44 |
| 2345Explorer | 1 | 271.28 KB | 22 Dec 2019 - 08:04 |
| ODP link checker | 1 | 5.45 KB | 21 Dec 2019 - 14:26 |
| ltx71 | 16+15 | 329.47 KB | 21 Dec 2019 - 10:20 |
| fastcrawler | 4 | 104.30 KB | 21 Dec 2019 - 01:17 |
| jbot | 36 | 569.10 KB | 20 Dec 2019 - 14:04 |
| bl.uk_lddc_bot | 17+17 | 577.25 KB | 20 Dec 2019 - 13:39 |
| IndeedBot | 1 | 14.39 KB | 18 Dec 2019 - 19:48 |
| Microsoft Office Protocol Discovery | 3 | 0 | 18 Dec 2019 - 12:11 |
| Slackbot-LinkExpanding | 1 | 19.78 KB | 17 Dec 2019 - 11:49 |
| DomainStatsBot | 23+1 | 327.51 KB | 16 Dec 2019 - 13:13 |
| adscanner | 7 | 280.12 KB | 15 Dec 2019 - 18:20 |
| MixrankBot | 11 | 105.89 KB | 15 Dec 2019 - 09:13 |
| panscient | 22+3 | 460.58 KB | 15 Dec 2019 - 08:50 |
| motor | 1 | 8.18 KB | 15 Dec 2019 - 07:36 |
| vebidoobot | 3 | 18.18 KB | 13 Dec 2019 - 22:45 |
| CCBot | 33+6 | 568.99 KB | 13 Dec 2019 - 17:06 |
| Screaming Frog SEO Spider | 1 | 6.06 KB | 13 Dec 2019 - 13:16 |
| Gowikibot | 0+1 | 127 Bytes | 13 Dec 2019 - 12:24 |
| Exabot | 1 | 66.80 KB | 12 Dec 2019 - 21:57 |
| Google Web Preview | 28 | 726.33 KB | 12 Dec 2019 - 14:53 |
| Konqueror | 29 | 1.30 MB | 12 Dec 2019 - 12:16 |
| TelegramBot | 1 | 48.71 KB | 12 Dec 2019 - 02:24 |
| discover | 1+1 | 6.18 KB | 11 Dec 2019 - 17:00 |
| Velen | 1 | 105.56 KB | 10 Dec 2019 - 19:51 |
| spider | 1,342 | 15.92 MB | 10 Dec 2019 - 14:31 |
| Mozilla ( Rogue Robot ) | 1 | 0 | 10 Dec 2019 - 05:44 |
| Googlebot-Video | 2 | 285.20 KB | 09 Dec 2019 - 23:30 |
| Cliqzbot | 17+10 | 464.34 KB | 09 Dec 2019 - 08:42 |
| BLEXBot | 2,001+37 | 28.37 MB | 07 Dec 2019 - 21:22 |
| Yandex ( catchall ) | 1 | 38.39 KB | 07 Dec 2019 - 18:19 |
| dataprovider.com | 21+1 | 851.57 KB | 07 Dec 2019 - 03:19 |
| scrapy | 7+4 | 163.42 KB | 05 Dec 2019 - 16:49 |
| Prlog | 1+1 | 6.18 KB | 05 Dec 2019 - 10:02 |
| SemrushBot-SI | 1 | 44.94 KB | 05 Dec 2019 - 03:29 |
| SurdotlyBot | 1 | 6.06 KB | 05 Dec 2019 - 01:03 |
| bnf.fr_bot | 1+1 | 24.56 KB | 03 Dec 2019 - 16:38 |
| seokicks.de | 16+2 | 208.90 KB | 03 Dec 2019 - 13:56 |
| Lightspeed | 1 | 6.06 KB | 03 Dec 2019 - 09:14 |
| Windows 99 - ( Rogue Robot ) | 1 | 40.22 KB | 03 Dec 2019 - 00:42 |
| TurnitinBot | 1+1 | 10.37 KB | 03 Dec 2019 - 00:05 |
| ning | 2 | 18.17 KB | 02 Dec 2019 - 23:06 |
| DuckDuckBot-Https | 5 | 89.31 KB | 01 Dec 2019 - 08:07 |
|