| 119 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot identified by bot\* | 2,960,653+2959 | 62.54 GB | 31 Mar 2025 - 23:54 |
| Barkrowler | 56,743+151 | 4.70 GB | 31 Mar 2025 - 19:34 |
| facebook | 30,352+4 | 3.91 GB | 31 Mar 2025 - 23:51 |
| PetalBot | 25,630+178 | 869.39 MB | 31 Mar 2025 - 23:34 |
| python | 24,287+44 | 183.77 MB | 31 Mar 2025 - 23:57 |
| Googlebot-Image | 23,532 | 722.18 MB | 31 Mar 2025 - 23:42 |
| scrapy | 23,475+4 | 863.80 MB | 25 Mar 2025 - 14:11 |
| MJ12bot | 14,300+1070 | 1.07 GB | 31 Mar 2025 - 21:08 |
| AhrefsBot | 14,615+666 | 100.29 MB | 31 Mar 2025 - 23:59 |
| Googlebot | 14,628+537 | 727.47 MB | 31 Mar 2025 - 23:28 |
| sift | 13,053+648 | 129.04 MB | 28 Mar 2025 - 00:32 |
| Applebot | 12,600+170 | 134.83 MB | 31 Mar 2025 - 23:05 |
| Bytespider | 11,251 | 2.00 GB | 31 Mar 2025 - 23:59 |
| seek | 7,012+18 | 1.03 GB | 29 Mar 2025 - 13:13 |
| crawl | 5,704+110 | 85.20 MB | 31 Mar 2025 - 22:48 |
| YandexBot | 3,993+1526 | 409.45 MB | 31 Mar 2025 - 23:30 |
| BLEXBot | 4,609+79 | 42.78 MB | 31 Mar 2025 - 17:38 |
| Firefox version 10 and lower - various robots | 4,434+2 | 8.65 GB | 30 Mar 2025 - 18:45 |
| Pinterestbot | 2,599+28 | 23.17 MB | 31 Mar 2025 - 19:53 |
| facebookexternalhit | 2,166+441 | 78.30 MB | 31 Mar 2025 - 22:28 |
| nutch ( catchall ) | 2,224+116 | 37.85 MB | 19 Mar 2025 - 11:59 |
| Unknown robot identified by \*bot | 1,850+466 | 55.67 MB | 31 Mar 2025 - 23:20 |
| Sogou web spider | 2,284+24 | 8.54 MB | 31 Mar 2025 - 22:57 |
| SeznamBot | 1,785+165 | 11.83 MB | 31 Mar 2025 - 23:25 |
| YandexMobileBot | 1,929 | 9.95 MB | 21 Mar 2025 - 20:39 |
| feed | 1,873 | 24.56 MB | 31 Mar 2025 - 23:58 |
| Yandex ( catchall ) | 1,607+4 | 12.61 MB | 31 Mar 2025 - 23:26 |
| empty user agent string | 1,324+17 | 52.73 MB | 31 Mar 2025 - 09:18 |
| CCBot | 937+43 | 10.93 MB | 27 Mar 2025 - 00:54 |
| YandexImages | 896 | 14.83 MB | 31 Mar 2025 - 20:10 |
| Unknown robot (identified by hit on robots.txt) | 0+826 | 69.31 KB | 31 Mar 2025 - 23:31 |
| Google Web Preview | 815 | 18.09 MB | 31 Mar 2025 - 19:12 |
| Go-http-client | 586+129 | 5.12 MB | 31 Mar 2025 - 22:16 |
| Python-urllib | 165+400 | 6.35 MB | 20 Mar 2025 - 11:05 |
| SemrushBot | 173+338 | 902.18 KB | 31 Mar 2025 - 15:22 |
| CFNetwork | 498 | 17.78 MB | 29 Mar 2025 - 22:55 |
| blog | 380 | 3.37 MB | 29 Mar 2025 - 13:09 |
| MojeekBot | 169+190 | 965.47 KB | 26 Mar 2025 - 15:52 |
| archive.org_bot | 335 | 4.63 MB | 30 Mar 2025 - 05:08 |
| zoominfobot | 255+33 | 1.52 MB | 28 Jan 2025 - 23:26 |
| YisouSpider | 241 | 1.50 MB | 31 Mar 2025 - 13:24 |
| yeti | 187+46 | 4.85 MB | 26 Mar 2025 - 21:06 |
| dataprovider.com | 214+5 | 8.53 MB | 30 Mar 2025 - 09:20 |
| Curl | 199 | 4.36 MB | 31 Mar 2025 - 04:23 |
| mozilla/5.0 - ( Rogue Robot ) | 172+19 | 3.19 MB | 29 Mar 2025 - 19:09 |
| core | 168+20 | 4.13 MB | 25 Mar 2025 - 09:48 |
| Baiduspider ( catchall ) | 186 | 1.06 MB | 31 Mar 2025 - 19:57 |
| seokicks.de | 172+2 | 2.43 MB | 21 Feb 2025 - 00:57 |
| trendiction | 88+76 | 1.68 MB | 29 Mar 2025 - 12:56 |
| nbot | 126+36 | 29.83 MB | 21 Mar 2025 - 15:47 |
| MSIE 6 - ( Rogue Robot ) | 148 | 79.22 MB | 21 Mar 2025 - 10:19 |
| DuckDuckBot | 140 | 2.72 MB | 31 Mar 2025 - 23:22 |
| MSIE 5 - ( Rogue Robot ) | 125 | 54.01 MB | 15 Mar 2025 - 10:25 |
| Dalvik | 124 | 1.90 MB | 30 Mar 2025 - 11:30 |
| Windows 99 - ( Rogue Robot ) | 120 | 6.62 MB | 10 Mar 2025 - 11:34 |
| custo | 117 | 652.35 KB | 31 Mar 2025 - 19:34 |
| DuckDuckBot-Https | 53+53 | 194.30 KB | 31 Mar 2025 - 09:18 |
| Discordbot | 98 | 8.11 MB | 31 Mar 2025 - 16:04 |
| motor | 86 | 2.41 MB | 29 Mar 2025 - 20:27 |
| yacybot | 69+13 | 1.58 MB | 29 Mar 2025 - 12:16 |
| Slackbot-LinkExpanding | 64 | 275.68 KB | 28 Mar 2025 - 13:04 |
| 360Spider | 57+5 | 202.38 KB | 30 Mar 2025 - 07:18 |
| Windows 95 - ( Rogue Robot ) | 57 | 2.99 MB | 10 Mar 2025 - 11:34 |
| wordpress | 55 | 152.92 KB | 21 Mar 2025 - 19:14 |
| CheckMarkNetwork | 30+20 | 53.14 KB | 23 Mar 2025 - 00:16 |
| FirePHP | 50 | 51.15 MB | 29 Mar 2025 - 10:32 |
| Screaming Frog SEO Spider | 45+4 | 1.17 MB | 31 Mar 2025 - 06:33 |
| bingbot | 49 | 480.86 KB | 25 Mar 2025 - 04:16 |
| BW | 27+21 | 98.58 KB | 29 Mar 2025 - 22:54 |
| checker | 42 | 194.46 KB | 30 Mar 2025 - 15:38 |
| Apache-HttpClient | 40 | 955.48 KB | 29 Mar 2025 - 21:09 |
| emacs | 40 | 934.04 KB | 03 Mar 2025 - 02:41 |
| spider | 35+1 | 367.00 KB | 31 Mar 2025 - 00:40 |
| rambler | 28 | 575.18 KB | 24 Mar 2025 - 13:57 |
| SurdotlyBot | 25+1 | 89.54 KB | 28 Mar 2025 - 19:49 |
| Java ( catchall ) | 19+5 | 321.70 KB | 31 Mar 2025 - 07:40 |
| filterdb.iss.net | 21 | 124.78 KB | 26 Jan 2025 - 15:32 |
| MSIE 4 - ( Rogue Robot ) | 18 | 23.43 MB | 27 Mar 2025 - 10:24 |
| Yahoo! Slurp | 0+16 | 1.16 KB | 18 Feb 2025 - 23:24 |
| Links ( | 15 | 97.53 KB | 14 Mar 2025 - 17:35 |
| Mediapartners-Google | 14 | 90.76 KB | 11 Jan 2025 - 03:34 |
| TelegramBot | 13 | 132.91 KB | 30 Mar 2025 - 20:30 |
| robot | 10+3 | 224.59 KB | 21 Mar 2025 - 11:27 |
| Wget | 13 | 158.00 KB | 07 Mar 2025 - 05:49 |
| sucker | 6+3 | 55.23 KB | 07 Feb 2025 - 19:12 |
| favicon | 8 | 73.04 KB | 25 Mar 2025 - 20:24 |
| twitterbot | 7 | 103.35 KB | 21 Mar 2025 - 21:19 |
| Baiduspider | 7 | 25.05 KB | 27 Mar 2025 - 01:56 |
| bit.ly | 4+3 | 39.41 KB | 26 Mar 2025 - 03:29 |
| Velen | 2+2 | 58.85 KB | 27 Feb 2025 - 05:30 |
| drupal | 2+2 | 148 Bytes | 29 Mar 2025 - 14:10 |
| link | 4 | 71.75 KB | 22 Mar 2025 - 21:19 |
| MSIE 3 - ( Rogue Robot ) | 4 | 24.98 KB | 18 Feb 2025 - 08:24 |
| internetarchive | 4 | 117.97 KB | 21 Mar 2025 - 04:55 |
| sitemap | 3+1 | 235.11 KB | 27 Mar 2025 - 16:50 |
| Adsbot | 3 | 10.73 KB | 08 Mar 2025 - 20:21 |
| DotBot | 1+2 | 11.23 KB | 08 Jan 2025 - 11:04 |
| hometown | 3 | 45.62 KB | 27 Mar 2025 - 01:26 |
| Mozilla ( Rogue Robot ) | 3 | 26.90 KB | 24 Feb 2025 - 03:12 |
| ning | 3 | 135.69 KB | 03 Mar 2025 - 11:19 |
| scanner | 2 | 7.16 KB | 10 Jan 2025 - 21:07 |
| YandexImageResizer | 2 | 37.27 KB | 28 Jan 2025 - 19:10 |
| XML Sitemaps Generator | 2 | 19.26 KB | 24 Feb 2025 - 00:18 |
| W3C-checklink | 1+1 | 74 Bytes | 22 Jan 2025 - 10:40 |
| TestCrawler | 1+1 | 3.67 KB | 04 Mar 2025 - 07:59 |
| urllib | 2 | 74.32 KB | 20 Feb 2025 - 17:51 |
| Lightspeed | 2 | 80.95 KB | 31 Mar 2025 - 06:14 |
| netcraft | 2 | 7.16 KB | 06 Mar 2025 - 16:35 |
| A PHP script | 1 | 3.58 KB | 28 Jan 2025 - 22:12 |
| LinkCheck | 1 | 65.16 KB | 02 Feb 2025 - 22:55 |
| Nautic Expo using Firefox/1.5 | 1 | 3.58 KB | 05 Jan 2025 - 13:11 |
| MSIECrawler | 1 | 2.97 KB | 26 Jan 2025 - 06:29 |
| SafeDNSBot | 1 | 11.46 KB | 03 Feb 2025 - 11:32 |
| Konqueror | 1 | 11.08 KB | 28 Jan 2025 - 18:53 |
| ELinks | 1 | 5.83 KB | 01 Jan 2025 - 10:55 |
| MSIE 2 - ( Rogue Robot ) | 1 | 5.05 KB | 26 Jan 2025 - 10:21 |
| testbot | 0+1 | 90 Bytes | 09 Jan 2025 - 04:12 |
| linkchecker | 1 | 5.66 KB | 29 Mar 2025 - 07:42 |
| bbot | 1 | 8.59 KB | 31 Jan 2025 - 19:18 |
|