| 207 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot identified by bot\* | 3,887,168+5913 | 112.77 GB | 31 Dec 2021 - 23:17 |
| bingbot | 242,992+3292 | 7.91 GB | 31 Dec 2021 - 23:46 |
| The Knowledge AI | 125,055+910 | 1.72 GB | 29 Dec 2021 - 23:25 |
| AhrefsBot | 81,615+1301 | 837.66 MB | 31 Dec 2021 - 23:50 |
| PetalBot | 73,545+2005 | 2.12 GB | 27 Dec 2021 - 13:26 |
| Googlebot | 65,522+873 | 1.03 GB | 31 Dec 2021 - 23:43 |
| Pinterestbot | 40,365+476 | 501.91 MB | 31 Dec 2021 - 23:18 |
| YandexBot | 28,350+3676 | 236.17 MB | 31 Dec 2021 - 23:24 |
| SemrushBot | 19,873+8443 | 313.86 MB | 31 Dec 2021 - 23:28 |
| BLEXBot | 27,539+424 | 126.88 MB | 29 Dec 2021 - 10:14 |
| Googlebot-Image | 23,431 | 529.50 MB | 31 Dec 2021 - 23:57 |
| DotBot | 14,333+6361 | 1.61 GB | 31 Dec 2021 - 20:12 |
| nutch ( catchall ) | 20,087+487 | 361.93 MB | 19 Dec 2021 - 04:30 |
| MJ12bot | 18,301+2157 | 160.21 MB | 31 Dec 2021 - 12:44 |
| SeznamBot | 14,890+4847 | 56.87 MB | 31 Dec 2021 - 22:52 |
| Adsbot | 17,719+126 | 76.98 MB | 31 Dec 2021 - 07:05 |
| CCBot | 14,682+1564 | 171.57 MB | 06 Dec 2021 - 23:03 |
| Applebot | 15,237+684 | 534.95 MB | 31 Dec 2021 - 23:59 |
| Barkrowler | 13,290+177 | 97.49 MB | 24 Dec 2021 - 10:29 |
| crawl | 12,627+554 | 182.56 MB | 31 Dec 2021 - 13:58 |
| link | 12,964+59 | 1.25 GB | 25 Dec 2021 - 10:27 |
| DuckDuckBot-Https | 12,829+55 | 137.09 MB | 31 Dec 2021 - 23:15 |
| Baiduspider ( catchall ) | 12,370 | 282.51 MB | 31 Dec 2021 - 11:16 |
| Mail.RU Bot | 7,501+4390 | 110.00 MB | 31 Dec 2021 - 23:06 |
| YandexImages | 10,384 | 257.71 MB | 31 Dec 2021 - 21:45 |
| Java ( catchall ) | 9,925+1 | 21.46 GB | 31 Dec 2021 - 04:45 |
| MSIE 6 - ( Rogue Robot ) | 9,282+4 | 248.25 MB | 31 Dec 2021 - 15:43 |
| seokicks.de | 6,019+76 | 77.57 MB | 31 Dec 2021 - 17:31 |
| empty user agent string | 5,442+450 | 137.36 MB | 30 Dec 2021 - 19:52 |
| DuckDuckBot | 5,873 | 974.04 MB | 31 Dec 2021 - 22:34 |
| zoominfobot | 4,008+1012 | 30.66 MB | 29 Dec 2021 - 12:29 |
| Baiduspider | 4,945+5 | 30.82 MB | 31 Dec 2021 - 13:32 |
| Sogou web spider | 4,849+20 | 26.72 MB | 31 Dec 2021 - 21:40 |
| nbot | 4,455+14 | 146.13 MB | 26 Nov 2021 - 23:14 |
| BingPreview | 4,141 | 197.22 MB | 31 Dec 2021 - 04:48 |
| python | 3,849+166 | 47.95 MB | 31 Dec 2021 - 23:47 |
| MauiBot | 3,685+84 | 49.98 MB | 07 Jun 2021 - 22:54 |
| MegaIndex.ru | 3,545+4 | 35.75 MB | 25 Dec 2021 - 11:35 |
| facebookexternalhit | 3,349+27 | 121.49 MB | 31 Dec 2021 - 23:19 |
| Apache-HttpClient | 3,070+45 | 12.38 MB | 31 Dec 2021 - 03:24 |
| ltx71 | 1,707+1085 | 31.02 MB | 28 Dec 2021 - 15:56 |
| Go-http-client | 2,468+41 | 30.27 MB | 31 Dec 2021 - 23:48 |
| Google Web Preview | 2,356 | 39.47 MB | 25 Dec 2021 - 14:32 |
| Wget | 2,267 | 82.28 MB | 30 Dec 2021 - 19:35 |
| Firefox version 10 and lower - various robots | 2,032+40 | 91.80 MB | 31 Dec 2021 - 08:00 |
| spider | 1,888+47 | 39.86 MB | 17 Dec 2021 - 08:13 |
| netEstate NE Crawler | 1,754+39 | 13.46 MB | 28 Nov 2021 - 20:17 |
| coccoc | 1,108+673 | 20.23 MB | 31 Dec 2021 - 21:13 |
| DuckDuckGo-Favicons-Bot | 1,556 | 3.17 MB | 31 Dec 2021 - 21:39 |
| daum | 1,105+203 | 67.69 MB | 27 Dec 2021 - 18:55 |
| Bytespider | 1,074+146 | 25.62 MB | 23 Dec 2021 - 15:21 |
| MSIE 5 - ( Rogue Robot ) | 1,195 | 34.14 MB | 30 Dec 2021 - 05:44 |
| motor | 1,182 | 11.31 MB | 16 Dec 2021 - 10:02 |
| Unknown robot (identified by hit on robots.txt) | 0+1135 | 129.48 KB | 31 Dec 2021 - 23:51 |
| CFNetwork | 1,132 | 47.91 MB | 31 Dec 2021 - 07:56 |
| core | 1,076 | 20.78 MB | 14 Dec 2021 - 10:25 |
| MojeekBot | 528+490 | 2.55 MB | 30 Dec 2021 - 21:30 |
| LinkpadBot | 974 | 14.89 MB | 11 Jan 2021 - 03:56 |
| qwantify | 822+115 | 13.75 MB | 30 Dec 2021 - 06:57 |
| Python-urllib | 915+12 | 27.72 MB | 30 Dec 2021 - 04:48 |
| favicon | 895 | 1.92 MB | 31 Dec 2021 - 02:32 |
| Linguee Bot | 855+3 | 9.25 MB | 04 Apr 2021 - 18:09 |
| jbot | 768 | 8.33 MB | 28 Dec 2021 - 09:16 |
| robot | 434+204 | 10.68 MB | 24 Dec 2021 - 21:38 |
| yeti | 493+81 | 9.43 MB | 28 Dec 2021 - 16:33 |
| yahoocachesystem | 499 | 25.76 MB | 12 Apr 2021 - 17:54 |
| Lightspeed | 468+3 | 8.77 MB | 30 Dec 2021 - 13:58 |
| YisouSpider | 415+54 | 3.68 MB | 30 Dec 2021 - 12:43 |
| 360Spider | 424 | 1.39 MB | 31 Dec 2021 - 01:53 |
| linkdexbot | 359+38 | 5.19 MB | 25 Dec 2021 - 05:48 |
| Neevabot | 315+78 | 2.20 MB | 30 Dec 2021 - 12:24 |
| Curl | 390+1 | 10.68 MB | 23 Dec 2021 - 08:23 |
| mozilla/5.0 - ( Rogue Robot ) | 365+1 | 5.50 MB | 21 Oct 2021 - 20:43 |
| Dalvik | 365 | 40.77 MB | 31 Dec 2021 - 18:20 |
| DomainStatsBot | 265+40 | 3.83 MB | 24 Dec 2021 - 07:04 |
| wordpress | 295 | 1.30 MB | 31 Dec 2021 - 08:51 |
| twitterbot | 128+113 | 1.45 MB | 29 Dec 2021 - 16:31 |
| Screaming Frog SEO Spider | 208+5 | 4.42 MB | 22 Dec 2021 - 02:16 |
| Googlebot-Video | 187 | 895.25 MB | 25 Nov 2021 - 23:36 |
| Konqueror | 187 | 3.42 MB | 15 Dec 2021 - 22:21 |
| custo | 168+2 | 2.32 MB | 31 Dec 2021 - 21:59 |
| Unknown robot identified by \*bot | 166+3 | 2.00 MB | 25 Dec 2021 - 13:45 |
| ichiro | 157+9 | 3.96 MB | 02 Jun 2021 - 09:30 |
| A PHP script | 164 | 5.48 MB | 24 Dec 2021 - 12:54 |
| Slackbot-LinkExpanding | 151 | 317.68 KB | 24 Dec 2021 - 05:01 |
| htdig | 130+20 | 1.57 MB | 08 Feb 2021 - 19:49 |
| Yahoo! Slurp | 144+2 | 1.68 MB | 11 Nov 2021 - 07:52 |
| smtbot | 134+3 | 906.40 KB | 28 Dec 2021 - 01:42 |
| fetcher | 137 | 2.65 MB | 27 Sep 2021 - 03:06 |
| archive.org_bot | 88+38 | 2.62 MB | 19 Dec 2021 - 03:48 |
| dataprovider.com | 112+4 | 3.97 MB | 13 Dec 2021 - 21:07 |
| yak-linkfluence | 84+22 | 575.87 KB | 24 Dec 2021 - 12:55 |
| facebook | 102 | 3.38 MB | 23 Dec 2021 - 05:29 |
| MixrankBot | 94 | 433.70 KB | 24 Nov 2021 - 13:32 |
| panscient | 80+8 | 532.60 KB | 24 Dec 2021 - 09:54 |
| netcraft | 76 | 76.24 KB | 30 Dec 2021 - 21:52 |
| BW | 42+33 | 124.34 KB | 21 Dec 2021 - 17:02 |
| pingdom | 72 | 3.16 MB | 03 Jul 2021 - 12:34 |
| internetarchive | 70 | 0 | 22 Dec 2021 - 13:55 |
| mozilla/4.0 (compatible;) - ( Rogue Robot ) | 64 | 0 | 18 Apr 2021 - 21:30 |
| 2345Explorer | 64 | 2.16 MB | 27 Oct 2021 - 05:36 |
| linkwalker | 62+1 | 276.40 KB | 19 Dec 2021 - 04:23 |
| TweetmemeBot | 63 | 1.12 MB | 08 Jun 2021 - 19:44 |
| scrapy | 51+3 | 2.46 MB | 24 Sep 2021 - 05:00 |
| gigablastopensource | 39+14 | 707.76 KB | 18 Jul 2021 - 16:08 |
| crawl/Nutch | 47+5 | 354.98 KB | 24 Aug 2021 - 20:16 |
| KomodiaBot | 48 | 704.43 KB | 29 Nov 2021 - 15:09 |
| bbot | 23+23 | 89.33 KB | 23 Sep 2021 - 22:41 |
| Discordbot | 38 | 3.91 MB | 28 Nov 2021 - 11:27 |
| GrapeshotCrawler | 19+19 | 40.91 KB | 27 Sep 2021 - 03:23 |
| discover | 36 | 66.52 KB | 28 Sep 2021 - 03:51 |
| Mozilla Beta (Windows) - ( Rogue Robot ) | 35 | 213.05 KB | 11 Nov 2021 - 03:23 |
| webcollage | 35 | 1.39 MB | 29 Dec 2021 - 14:56 |
| Velen | 35 | 355.36 KB | 10 Nov 2021 - 22:53 |
| Yandex ( catchall ) | 34 | 641.09 KB | 24 Dec 2021 - 01:29 |
| CheckMarkNetwork | 28+5 | 89.75 KB | 11 Nov 2021 - 04:39 |
| SurdotlyBot | 27+6 | 56.50 KB | 20 Dec 2021 - 21:57 |
| Deepnet Explorer | 30 | 180.39 KB | 22 Nov 2021 - 10:42 |
| MSIE 2 - ( Rogue Robot ) | 30 | 177.03 KB | 12 Dec 2021 - 15:52 |
| W3C-checklink | 26+2 | 6.40 KB | 26 Jul 2021 - 14:05 |
| TelegramBot | 27 | 1.13 MB | 29 Dec 2021 - 03:46 |
| Nimbostratus-Bot | 26 | 145.23 KB | 12 Feb 2021 - 04:31 |
| proximic | 9+17 | 59.97 KB | 01 Nov 2021 - 20:51 |
| ips-agent | 18+6 | 63.79 KB | 22 Nov 2021 - 17:37 |
| Microsoft Office Protocol Discovery | 22 | 0 | 09 Nov 2021 - 23:00 |
| MSIE 4 - ( Rogue Robot ) | 22 | 436.42 KB | 27 Jun 2021 - 04:46 |
| SafeDNSBot | 12+9 | 28.37 KB | 10 Oct 2021 - 13:36 |
| MSIE 3 - ( Rogue Robot ) | 21 | 119.15 KB | 22 Aug 2021 - 22:44 |
| Windows 99 - ( Rogue Robot ) | 21 | 807.89 KB | 01 Nov 2021 - 05:27 |
| drupal | 20 | 44.60 KB | 26 Sep 2021 - 01:22 |
| Validator.nu | 19 | 89.15 KB | 07 Feb 2021 - 17:26 |
| Windows 95 - ( Rogue Robot ) | 17 | 152.70 KB | 03 Oct 2021 - 22:27 |
| YandexImageResizer | 17 | 1.95 MB | 09 Oct 2021 - 23:26 |
| Exabot | 16 | 186.80 KB | 26 Jul 2021 - 22:22 |
| Mojolicious | 16 | 476.71 KB | 12 Dec 2021 - 18:40 |
| MSIECrawler | 15 | 114.71 KB | 24 Jun 2021 - 07:44 |
| Jigsaw | 15 | 100.51 KB | 08 Feb 2021 - 16:40 |
| YandexMetrika | 15 | 47.90 KB | 29 Dec 2021 - 18:57 |
| linkbot | 10+5 | 21.68 KB | 29 Nov 2021 - 10:55 |
| Mediapartners-Google | 14 | 601.70 KB | 09 Nov 2021 - 03:29 |
| ubermetrics-technologies.com | 9+5 | 57.62 KB | 29 Sep 2021 - 12:36 |
| serendeputy | 7+7 | 247.47 KB | 16 Dec 2021 - 10:59 |
| SemrushBot-SI | 12 | 84.68 KB | 29 Nov 2021 - 03:26 |
| semanticbot | 7+4 | 131.17 KB | 31 Oct 2021 - 09:44 |
| ia_archiver | 9+2 | 256.71 KB | 29 Dec 2021 - 06:07 |
| AdIdxBot Microsoft Ad Quality control | 11 | 633.83 KB | 31 Dec 2021 - 18:29 |
| adscanner | 10 | 227.79 KB | 24 Dec 2021 - 00:42 |
| PhantomJS | 10 | 158.08 KB | 07 Oct 2021 - 09:43 |
| webcopy | 10 | 111.73 KB | 22 Aug 2021 - 19:22 |
| LinkedInBot | 9 | 261.40 KB | 03 Oct 2021 - 11:57 |
| Gowikibot | 7+2 | 13.76 KB | 18 Apr 2021 - 21:34 |
| perl | 7 | 342.34 KB | 31 Oct 2021 - 09:43 |
| Mediatoolkitbot | 4+3 | 53.17 KB | 31 Oct 2021 - 09:37 |
| yacybot | 3+4 | 16.26 KB | 05 Jun 2021 - 10:49 |
| vebidoobot | 6 | 12.23 KB | 15 Feb 2021 - 19:44 |
| Mozilla ( Rogue Robot ) | 6 | 19.53 KB | 12 Dec 2021 - 09:45 |
| Babya Discoverer | 6 | 37.51 KB | 07 Nov 2021 - 22:57 |
| WbSrch/ | 4+1 | 24.10 KB | 18 Jul 2021 - 10:38 |
| Links ( | 5 | 13.59 KB | 24 Dec 2021 - 06:50 |
| filterdb.iss.net | 4+1 | 59.08 KB | 17 Dec 2021 - 00:03 |
| feed | 5 | 192.02 KB | 10 Aug 2021 - 23:55 |
| testbot | 5 | 9.56 KB | 05 Mar 2021 - 09:24 |
| TkBot | 4 | 7.98 KB | 27 Apr 2021 - 02:34 |
| spyonweb | 2+2 | 4.50 KB | 08 Sep 2021 - 21:46 |
| vuhuvBot | 2+2 | 4.31 KB | 13 Oct 2021 - 22:49 |
| BingLocalSearch | 2+2 | 10.89 KB | 24 Jun 2021 - 10:05 |
| Feedfetcher-Google | 4 | 162.55 KB | 11 Aug 2021 - 06:16 |
| seek | 3+1 | 49.16 KB | 24 Dec 2021 - 12:51 |
| W3C_Validator | 3 | 7.87 KB | 27 Aug 2021 - 16:15 |
| trendiction | 1+2 | 4.07 KB | 09 Dec 2021 - 18:42 |
| bl.uk_lddc_bot | 1+2 | 21.36 KB | 14 Oct 2021 - 01:55 |
| ODP link checker | 3 | 49.76 KB | 12 Nov 2021 - 23:04 |
| Xenu Link Sleuth | 2 | 0 | 29 Dec 2021 - 06:37 |
| LinkCheck | 2 | 121.17 KB | 10 Nov 2021 - 02:03 |
| scanner | 2 | 13.29 KB | 04 Aug 2021 - 08:15 |
| CUBOT | 2 | 42.98 KB | 15 Mar 2021 - 17:42 |
| microsoft-webdav-miniredir | 2 | 0 | 14 Oct 2021 - 22:50 |
| ning | 2 | 403.37 KB | 01 Oct 2021 - 19:00 |
| ICC-Crawler | 1+1 | 6.80 KB | 28 Oct 2021 - 06:26 |
| ng/1. | 2 | 5.72 KB | 13 Apr 2021 - 13:04 |
| sucker | 1+1 | 32.22 KB | 03 Mar 2021 - 22:50 |
| bit.ly | 1+1 | 2.85 KB | 06 Apr 2021 - 20:35 |
| msie8 - ( Rogue Robot ) | 2 | 12.47 KB | 08 Jul 2021 - 05:39 |
| foo | 2 | 13.38 KB | 02 Dec 2021 - 23:36 |
| rogerbot | 1+1 | 2.10 KB | 13 Jul 2021 - 09:11 |
| CMS Crawler | 2 | 11.48 KB | 26 Jan 2021 - 14:24 |
| synthesio | 1 | 28.84 KB | 23 Mar 2021 - 14:54 |
| w3m2 | 1 | 4.00 KB | 24 Dec 2021 - 12:52 |
| validator | 1 | 18.21 KB | 07 Feb 2021 - 17:23 |
| FirePHP | 1 | 1.99 KB | 22 Apr 2021 - 01:44 |
| fido | 1 | 12.80 KB | 26 Nov 2021 - 00:16 |
| geturl | 0+1 | 145 Bytes | 13 Apr 2021 - 04:47 |
| checker | 1 | 13.42 KB | 23 Sep 2021 - 03:06 |
| libwww-perl | 1 | 5.97 KB | 14 Jun 2021 - 07:22 |
| simbot | 1 | 28.81 KB | 03 Mar 2021 - 06:57 |
| Dispatch | 1 | 38.57 KB | 10 Feb 2021 - 15:29 |
| Yahoo Link Preview | 1 | 4.07 KB | 26 Sep 2021 - 18:54 |
| feedvalidator | 1 | 6.12 KB | 07 Feb 2021 - 17:23 |
| XML Sitemaps Generator | 1 | 8.98 KB | 17 Jul 2021 - 11:21 |
| LWP::Simple | 1 | 5.65 KB | 12 Feb 2021 - 05:45 |
| Googlebot-News | 1 | 5.42 KB | 22 Jan 2021 - 06:09 |
| Nautic Expo using Firefox/1.5 | 1 | 5.96 KB | 09 Mar 2021 - 16:08 |
| riddler | 0+1 | 110 Bytes | 11 Jul 2021 - 18:52 |
| PiplBot | 1 | 8.94 KB | 02 Jun 2021 - 04:47 |
| gocrawl | 0+1 | 110 Bytes | 17 Jan 2021 - 06:24 |
| y!j | 0+1 | 110 Bytes | 24 Jan 2021 - 09:49 |
| yammer | 1 | 70.42 KB | 24 Jun 2021 - 12:18 |
|