| 140 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot identified by bot\* | 4,199,398+6261 | 138.64 GB | 31 May 2025 - 23:59 |
| Barkrowler | 117,939+543 | 24.51 GB | 31 May 2025 - 23:59 |
| PetalBot | 49,003+272 | 1.78 GB | 31 May 2025 - 23:59 |
| MJ12bot | 46,518+2236 | 6.31 GB | 31 May 2025 - 22:27 |
| facebook | 47,788+4 | 7.50 GB | 31 May 2025 - 23:59 |
| Googlebot-Image | 46,109 | 3.86 GB | 31 May 2025 - 23:46 |
| python | 43,778+99 | 343.04 MB | 31 May 2025 - 23:59 |
| AhrefsBot | 35,049+1224 | 311.64 MB | 31 May 2025 - 21:38 |
| Googlebot | 33,232+1026 | 2.07 GB | 31 May 2025 - 23:48 |
| scrapy | 25,055+44 | 871.25 MB | 15 May 2025 - 00:48 |
| sift | 20,498+1074 | 194.68 MB | 26 May 2025 - 10:47 |
| Applebot | 19,819+283 | 200.62 MB | 31 May 2025 - 23:07 |
| Bytespider | 18,894+3 | 2.51 GB | 31 May 2025 - 22:56 |
| crawl | 17,809+148 | 232.04 MB | 31 May 2025 - 23:59 |
| Unknown robot identified by \*bot | 11,361+2012 | 177.14 MB | 31 May 2025 - 23:57 |
| BLEXBot | 11,332+187 | 124.10 MB | 30 May 2025 - 18:26 |
| YandexBot | 5,499+2631 | 611.33 MB | 31 May 2025 - 23:05 |
| seek | 7,201+30 | 1.04 GB | 25 May 2025 - 10:52 |
| Firefox version 10 and lower - various robots | 5,239+2 | 11.31 GB | 31 May 2025 - 11:42 |
| facebookexternalhit | 3,110+1931 | 104.58 MB | 31 May 2025 - 23:28 |
| Pinterestbot | 4,321+46 | 39.08 MB | 31 May 2025 - 23:11 |
| Sogou web spider | 3,944+43 | 17.66 MB | 31 May 2025 - 23:56 |
| SeznamBot | 2,802+277 | 21.60 MB | 31 May 2025 - 23:53 |
| Yandex ( catchall ) | 2,387+4 | 21.59 MB | 31 May 2025 - 23:05 |
| feed | 2,378 | 43.76 MB | 31 May 2025 - 16:03 |
| nutch ( catchall ) | 2,231+124 | 37.88 MB | 31 May 2025 - 12:01 |
| YandexMobileBot | 2,231 | 11.42 MB | 10 Apr 2025 - 08:32 |
| empty user agent string | 1,772+21 | 81.21 MB | 31 May 2025 - 19:51 |
| Go-http-client | 1,131+218 | 25.10 MB | 31 May 2025 - 04:17 |
| Unknown robot (identified by hit on robots.txt) | 0+1342 | 113.76 KB | 31 May 2025 - 21:46 |
| Google Web Preview | 1,287 | 28.03 MB | 26 May 2025 - 17:52 |
| CCBot | 1,173+77 | 12.51 MB | 21 May 2025 - 01:47 |
| YandexImages | 1,144 | 22.69 MB | 31 May 2025 - 21:30 |
| xget | 1,093+16 | 34.78 MB | 27 Apr 2025 - 08:44 |
| netEstate NE Crawler | 872+19 | 10.61 MB | 08 May 2025 - 14:40 |
| SemrushBot | 441+433 | 5.34 MB | 31 May 2025 - 02:03 |
| MojeekBot | 405+442 | 6.14 MB | 30 May 2025 - 19:38 |
| CFNetwork | 701 | 26.93 MB | 31 May 2025 - 23:28 |
| Curl | 592+40 | 7.82 MB | 31 May 2025 - 14:19 |
| archive.org_bot | 631 | 9.99 MB | 31 May 2025 - 17:31 |
| Python-urllib | 190+401 | 7.28 MB | 26 May 2025 - 08:38 |
| yeti | 334+84 | 8.29 MB | 28 May 2025 - 12:09 |
| blog | 392 | 3.47 MB | 27 Apr 2025 - 19:16 |
| bingbot | 362 | 6.09 MB | 31 May 2025 - 08:20 |
| zoominfobot | 314+43 | 1.87 MB | 31 May 2025 - 18:15 |
| YisouSpider | 357 | 2.23 MB | 24 May 2025 - 05:28 |
| dataprovider.com | 334+8 | 13.53 MB | 09 May 2025 - 16:52 |
| Baiduspider ( catchall ) | 312 | 2.77 MB | 31 May 2025 - 15:57 |
| mozilla/5.0 - ( Rogue Robot ) | 256+23 | 3.98 MB | 28 May 2025 - 17:10 |
| yacybot | 231+45 | 4.55 MB | 28 May 2025 - 02:51 |
| core | 229+35 | 5.65 MB | 31 May 2025 - 03:29 |
| seokicks.de | 258+3 | 3.52 MB | 27 Apr 2025 - 06:17 |
| trendiction | 140+119 | 3.25 MB | 26 May 2025 - 19:48 |
| DuckDuckBot | 224 | 3.13 MB | 31 May 2025 - 07:54 |
| custo | 221 | 1.18 MB | 31 May 2025 - 23:12 |
| DuckDuckBot-Https | 110+110 | 403.22 KB | 23 May 2025 - 08:32 |
| checker | 179 | 454.63 KB | 29 May 2025 - 17:00 |
| MSIE 6 - ( Rogue Robot ) | 175 | 79.62 MB | 31 May 2025 - 02:09 |
| nbot | 126+36 | 29.83 MB | 21 Mar 2025 - 15:47 |
| Dalvik | 157 | 3.11 MB | 30 May 2025 - 23:25 |
| MSIE 5 - ( Rogue Robot ) | 146 | 57.92 MB | 30 May 2025 - 22:43 |
| Discordbot | 142 | 9.17 MB | 26 May 2025 - 06:27 |
| Windows 99 - ( Rogue Robot ) | 132 | 6.71 MB | 31 May 2025 - 00:22 |
| hometown | 122 | 1003.39 KB | 29 Apr 2025 - 16:36 |
| motor | 110 | 3.51 MB | 28 May 2025 - 17:35 |
| 360Spider | 94+9 | 564.61 KB | 29 May 2025 - 11:01 |
| Slackbot-LinkExpanding | 98 | 397.23 KB | 23 May 2025 - 09:56 |
| rambler | 84 | 1.70 MB | 14 May 2025 - 12:59 |
| CheckMarkNetwork | 45+30 | 79.70 KB | 29 May 2025 - 06:42 |
| wordpress | 74 | 197.85 KB | 24 Apr 2025 - 10:29 |
| Screaming Frog SEO Spider | 65+7 | 1.72 MB | 30 May 2025 - 14:44 |
| BW | 42+23 | 152.46 KB | 26 May 2025 - 12:20 |
| Windows 95 - ( Rogue Robot ) | 62 | 3.03 MB | 29 May 2025 - 10:12 |
| spider | 57+3 | 739.12 KB | 04 May 2025 - 20:33 |
| Apache-HttpClient | 58 | 1.38 MB | 31 May 2025 - 21:33 |
| FirePHP | 54 | 51.21 MB | 30 May 2025 - 04:39 |
| Java ( catchall ) | 40+5 | 560.67 KB | 22 May 2025 - 07:12 |
| SurdotlyBot | 43+2 | 153.99 KB | 31 May 2025 - 04:29 |
| emacs | 41 | 941.43 KB | 25 Apr 2025 - 10:08 |
| robot | 28+5 | 506.55 KB | 31 May 2025 - 14:16 |
| BingPreview | 28 | 580.82 KB | 08 Apr 2025 - 16:04 |
| MSIE 4 - ( Rogue Robot ) | 24 | 24.26 MB | 30 May 2025 - 19:57 |
| TelegramBot | 22 | 350.52 KB | 27 May 2025 - 20:30 |
| filterdb.iss.net | 21 | 124.78 KB | 26 Jan 2025 - 15:32 |
| Wget | 19+2 | 607.28 KB | 24 May 2025 - 05:57 |
| Yahoo! Slurp | 0+19 | 1.37 KB | 30 May 2025 - 00:22 |
| Links ( | 15 | 97.53 KB | 14 Mar 2025 - 17:35 |
| Mediapartners-Google | 14 | 90.76 KB | 11 Jan 2025 - 03:34 |
| drupal | 8+6 | 17.24 KB | 23 Apr 2025 - 07:39 |
| link | 11+1 | 125.82 KB | 06 May 2025 - 17:30 |
| twitterbot | 12 | 174.45 KB | 05 May 2025 - 11:12 |
| Baiduspider | 12 | 42.02 KB | 17 May 2025 - 14:27 |
| favicon | 12 | 114.83 KB | 15 May 2025 - 20:33 |
| urllib | 12 | 401.84 KB | 19 Apr 2025 - 01:04 |
| scanner | 11 | 39.36 KB | 14 May 2025 - 18:07 |
| internetarchive | 10 | 267.50 KB | 16 May 2025 - 10:58 |
| Velen | 5+5 | 121.57 KB | 27 May 2025 - 01:11 |
| bit.ly | 5+4 | 42.55 KB | 11 Apr 2025 - 00:20 |
| sucker | 6+3 | 55.23 KB | 07 Feb 2025 - 19:12 |
| ning | 7 | 169.44 KB | 27 Apr 2025 - 19:16 |
| sitemap | 5+1 | 248.50 KB | 30 May 2025 - 16:59 |
| XML Sitemaps Generator | 5 | 48.76 KB | 30 May 2025 - 16:58 |
| MSIE 3 - ( Rogue Robot ) | 5 | 35.73 KB | 30 May 2025 - 07:38 |
| nomad | 4 | 23.18 KB | 07 Apr 2025 - 16:04 |
| netcraft | 4 | 14.30 KB | 31 May 2025 - 12:14 |
| Adsbot | 4 | 14.31 KB | 21 Apr 2025 - 16:06 |
| raven | 4 | 33.71 KB | 27 Apr 2025 - 19:16 |
| turtle | 4 | 28.52 KB | 27 Apr 2025 - 19:16 |
| gama | 4 | 41.95 KB | 27 Apr 2025 - 09:20 |
| pita | 4 | 34.01 KB | 27 Apr 2025 - 19:16 |
| [^a]fish | 3 | 25.51 KB | 04 May 2025 - 14:21 |
| DotBot | 1+2 | 11.23 KB | 08 Jan 2025 - 11:04 |
| Mozilla ( Rogue Robot ) | 3 | 26.90 KB | 24 Feb 2025 - 03:12 |
| collective | 3 | 25.17 KB | 27 Apr 2025 - 19:16 |
| YandexImageResizer | 3 | 369.52 KB | 26 Apr 2025 - 09:47 |
| Nautic Expo using Firefox/1.5 | 2 | 14.66 KB | 04 May 2025 - 07:27 |
| W3C-checklink | 1+1 | 74 Bytes | 22 Jan 2025 - 10:40 |
| wombat | 2 | 16.80 KB | 23 Apr 2025 - 06:13 |
| ICC-Crawler | 1+1 | 25.45 KB | 26 May 2025 - 02:37 |
| TestCrawler | 1+1 | 3.67 KB | 04 Mar 2025 - 07:59 |
| bbot | 2 | 16.81 KB | 06 Apr 2025 - 13:01 |
| Who.is.Bot | 2 | 14.65 KB | 23 May 2025 - 06:56 |
| LinkCheck | 2 | 130.37 KB | 04 May 2025 - 01:50 |
| proximic | 2 | 12.65 KB | 25 May 2025 - 14:48 |
| yak-linkfluence | 2 | 11.60 KB | 23 Apr 2025 - 06:13 |
| Lightspeed | 2 | 80.95 KB | 31 Mar 2025 - 06:14 |
| domainchecker | 2 | 22.16 KB | 20 May 2025 - 21:15 |
| checkbot | 1 | 11.08 KB | 30 May 2025 - 19:09 |
| octopus | 1 | 8.25 KB | 07 Apr 2025 - 15:07 |
| MSIECrawler | 1 | 2.97 KB | 26 Jan 2025 - 06:29 |
| testbot | 0+1 | 90 Bytes | 09 Jan 2025 - 04:12 |
| Konqueror | 1 | 11.08 KB | 28 Jan 2025 - 18:53 |
| monster | 1 | 8.55 KB | 23 Apr 2025 - 08:19 |
| SafeDNSBot | 1 | 11.46 KB | 03 Feb 2025 - 11:32 |
| magpierss | 1 | 55.60 KB | 08 May 2025 - 16:26 |
| ELinks | 1 | 5.83 KB | 01 Jan 2025 - 10:55 |
| netnewswire | 1 | 3.58 KB | 17 May 2025 - 14:26 |
| MSIE 2 - ( Rogue Robot ) | 1 | 5.05 KB | 26 Jan 2025 - 10:21 |
| linkchecker | 1 | 5.66 KB | 29 Mar 2025 - 07:42 |
| A PHP script | 1 | 3.58 KB | 28 Jan 2025 - 22:12 |
|