| 233 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot identified by bot\* | 5,619,960+5107 | 85.39 GB | 31 Dec 2023 - 21:58 |
| AhrefsBot | 226,568+2195 | 3.99 GB | 31 Dec 2023 - 23:54 |
| Bytespider | 123,418+581 | 3.66 GB | 31 Dec 2023 - 23:50 |
| bingbot | 78,143+1268 | 2.21 GB | 31 Dec 2023 - 23:45 |
| Googlebot | 76,123+1139 | 1.09 GB | 31 Dec 2023 - 23:55 |
| python | 73,058+139 | 577.16 MB | 31 Dec 2023 - 23:54 |
| facebookexternalhit | 60,097+230 | 1.39 GB | 31 Dec 2023 - 21:17 |
| Mozilla ( Rogue Robot ) | 51,677+2 | 16.19 GB | 25 Dec 2023 - 08:03 |
| PetalBot | 45,658+1762 | 1.25 GB | 31 Dec 2023 - 02:35 |
| DotBot | 38,649+6654 | 10.32 GB | 31 Dec 2023 - 23:53 |
| Googlebot-Image | 37,048 | 1.28 GB | 31 Dec 2023 - 23:59 |
| CFNetwork | 32,394 | 507.37 MB | 30 Dec 2023 - 15:31 |
| MJ12bot | 28,967+1764 | 1.25 GB | 31 Dec 2023 - 23:57 |
| Unknown robot identified by \*bot | 29,310+62 | 476.08 MB | 31 Dec 2023 - 23:10 |
| SemrushBot | 22,835+4476 | 132.78 MB | 31 Dec 2023 - 22:22 |
| BLEXBot | 25,472+461 | 122.35 MB | 10 Dec 2023 - 14:21 |
| YandexBot | 19,990+5672 | 306.09 MB | 31 Dec 2023 - 23:44 |
| Applebot | 23,733+333 | 310.43 MB | 31 Dec 2023 - 21:48 |
| Pinterestbot | 19,183+346 | 211.12 MB | 31 Dec 2023 - 22:47 |
| Barkrowler | 14,553+99 | 514.45 MB | 31 Dec 2023 - 22:58 |
| crawl | 13,033+268 | 5.94 GB | 31 Dec 2023 - 15:11 |
| Baiduspider ( catchall ) | 12,909 | 299.54 MB | 31 Dec 2023 - 14:02 |
| seek | 12,047+38 | 812.37 MB | 30 Dec 2023 - 21:09 |
| nbot | 11,730+89 | 247.38 MB | 26 Dec 2023 - 20:07 |
| SeznamBot | 9,592+1860 | 67.67 MB | 31 Dec 2023 - 20:52 |
| sift | 11,029+141 | 237.45 MB | 27 Dec 2023 - 08:32 |
| DuckDuckBot | 6,601 | 1.54 GB | 31 Dec 2023 - 23:59 |
| YandexImages | 6,592 | 185.43 MB | 31 Dec 2023 - 23:44 |
| Sogou web spider | 6,012+29 | 17.93 MB | 31 Dec 2023 - 23:50 |
| MegaIndex.ru | 5,429+6 | 45.23 MB | 02 Nov 2023 - 11:40 |
| Unknown robot (identified by hit on robots.txt) | 0+5397 | 592.36 KB | 31 Dec 2023 - 21:30 |
| empty user agent string | 4,919+94 | 249.79 MB | 31 Dec 2023 - 21:14 |
| Mail.RU Bot | 2,823+1873 | 33.89 MB | 21 Dec 2023 - 16:34 |
| Yandex ( catchall ) | 4,582 | 26.66 MB | 31 Dec 2023 - 18:49 |
| archive.org_bot | 4,390+66 | 112.18 MB | 29 Dec 2023 - 02:41 |
| link | 4,102+12 | 42.71 MB | 28 Dec 2023 - 14:09 |
| qwantify | 2,992+734 | 15.39 MB | 25 Dec 2023 - 05:02 |
| Baiduspider | 3,249 | 51.67 MB | 31 Dec 2023 - 18:05 |
| Firefox version 10 and lower - various robots | 2,978+99 | 34.45 MB | 31 Dec 2023 - 17:48 |
| zoominfobot | 2,475+375 | 16.93 MB | 29 Dec 2023 - 00:27 |
| testbot | 2,227+15 | 23.37 MB | 04 Oct 2023 - 08:42 |
| Apache-HttpClient | 1,929+77 | 9.80 MB | 27 Dec 2023 - 13:32 |
| seokicks.de | 1,993+11 | 35.82 MB | 14 Oct 2023 - 21:16 |
| netEstate NE Crawler | 1,671+39 | 11.76 MB | 22 Aug 2023 - 09:17 |
| Go-http-client | 1,586+106 | 37.34 MB | 31 Dec 2023 - 22:17 |
| CCBot | 1,320+92 | 6.87 MB | 08 Dec 2023 - 15:29 |
| motor | 1,390 | 26.66 MB | 29 Dec 2023 - 02:33 |
| coccoc | 683+669 | 16.39 MB | 31 Dec 2023 - 23:49 |
| daum | 877+278 | 35.41 MB | 22 Dec 2023 - 14:39 |
| mozilla/5.0 - ( Rogue Robot ) | 1,131 | 13.90 MB | 13 Dec 2023 - 17:35 |
| Google Web Preview | 1,114 | 24.81 MB | 29 Dec 2023 - 08:24 |
| urllib | 1,041 | 33.99 MB | 20 Oct 2023 - 19:46 |
| MojeekBot | 445+534 | 2.72 MB | 31 Dec 2023 - 02:52 |
| DuckDuckGo-Favicons-Bot | 961 | 2.63 MB | 31 Dec 2023 - 14:31 |
| YandexMobileBot | 942 | 4.74 MB | 10 Dec 2023 - 01:17 |
| YisouSpider | 837+86 | 16.26 MB | 31 Dec 2023 - 09:41 |
| BingPreview | 804 | 59.79 MB | 31 Dec 2023 - 21:33 |
| Dalvik | 748 | 24.90 MB | 31 Dec 2023 - 01:50 |
| Python-urllib | 695+8 | 28.13 MB | 30 Dec 2023 - 17:41 |
| yeti | 492+165 | 10.38 MB | 27 Dec 2023 - 18:37 |
| core | 482+129 | 14.37 MB | 30 Dec 2023 - 20:07 |
| linkdexbot | 549+36 | 4.81 MB | 31 Dec 2023 - 23:45 |
| feed | 557 | 22.26 MB | 23 Dec 2023 - 04:33 |
| Curl | 518+4 | 37.60 MB | 28 Dec 2023 - 07:11 |
| Lightspeed | 447 | 10.43 MB | 24 Nov 2023 - 12:10 |
| dataprovider.com | 433+13 | 19.95 MB | 14 Dec 2023 - 10:58 |
| wordpress | 419 | 3.79 MB | 31 Dec 2023 - 13:33 |
| twitterbot | 260+151 | 3.65 MB | 28 Dec 2023 - 17:51 |
| MSIE 6 - ( Rogue Robot ) | 404 | 6.28 MB | 31 Dec 2023 - 16:36 |
| spider | 290+84 | 4.81 MB | 26 Nov 2023 - 15:00 |
| Links ( | 368 | 4.29 MB | 16 Dec 2023 - 23:51 |
| nutch ( catchall ) | 279+58 | 2.73 MB | 29 Nov 2023 - 18:28 |
| pingdom | 322 | 4.00 MB | 15 Aug 2023 - 15:50 |
| The Knowledge AI | 0+281 | 30.19 KB | 06 Dec 2023 - 04:16 |
| bbot | 249+32 | 5.60 MB | 26 Nov 2023 - 03:47 |
| yak-linkfluence | 250+29 | 1.61 MB | 23 Dec 2023 - 04:33 |
| DomainStatsBot | 258+11 | 4.58 MB | 01 Dec 2023 - 13:45 |
| IonCrawl | 231+28 | 1.29 MB | 30 Nov 2023 - 21:23 |
| Screaming Frog SEO Spider | 248+5 | 3.68 MB | 26 Dec 2023 - 00:32 |
| yacybot | 196+49 | 2.95 MB | 31 Dec 2023 - 04:27 |
| custo | 241 | 1.89 MB | 21 Dec 2023 - 23:27 |
| robot | 123+114 | 1.45 MB | 08 Oct 2023 - 09:32 |
| hometown | 232 | 1.90 MB | 28 Dec 2023 - 18:49 |
| Wget | 195+2 | 5.53 MB | 26 Dec 2023 - 20:50 |
| Neevabot | 122+61 | 3.43 MB | 25 May 2023 - 16:01 |
| PhantomJS | 163 | 4.60 MB | 19 Sep 2023 - 19:10 |
| y!j | 96+60 | 2.01 MB | 31 Dec 2023 - 19:39 |
| A PHP script | 137+18 | 1.62 MB | 22 Dec 2023 - 15:21 |
| 360Spider | 151 | 452.12 KB | 31 Dec 2023 - 15:37 |
| panscient | 140+10 | 1.16 MB | 26 Dec 2023 - 22:03 |
| jbot | 144+4 | 1.09 MB | 17 Jun 2023 - 07:00 |
| Discordbot | 147 | 5.25 MB | 26 Dec 2023 - 21:29 |
| Slackbot-LinkExpanding | 124 | 383.41 KB | 22 Dec 2023 - 07:20 |
| heritrix | 115+6 | 2.77 MB | 24 Nov 2023 - 04:15 |
| emacs | 111 | 2.13 MB | 27 Dec 2023 - 18:57 |
| Googlebot-Video | 101 | 2.32 GB | 30 Dec 2023 - 08:38 |
| gigablastopensource | 91+9 | 2.36 MB | 29 Nov 2023 - 06:35 |
| sitebot | 96 | 287.46 KB | 19 Sep 2023 - 09:05 |
| SurdotlyBot | 89+6 | 279.35 KB | 29 Dec 2023 - 20:35 |
| netnewswire | 92 | 2.17 MB | 30 Oct 2023 - 02:11 |
| libwww-perl | 91 | 3.63 MB | 07 Nov 2023 - 20:00 |
| phantom | 90 | 2.84 MB | 15 Aug 2023 - 15:51 |
| MSIE 5 - ( Rogue Robot ) | 85 | 2.51 MB | 31 Dec 2023 - 22:35 |
| BW | 44+35 | 148.72 KB | 11 Oct 2023 - 23:02 |
| blog | 68+1 | 1.22 MB | 23 Dec 2023 - 04:33 |
| DuckDuckBot-Https | 34+34 | 100.87 KB | 25 Dec 2023 - 16:17 |
| Velen | 56+11 | 568.35 KB | 27 Nov 2023 - 01:10 |
| internetarchive | 66 | 1.52 MB | 23 Dec 2023 - 01:09 |
| ia_archiver | 55 | 1.24 MB | 24 Dec 2023 - 05:40 |
| gama | 55 | 362.62 KB | 17 Feb 2023 - 11:11 |
| netcraft | 52 | 408.89 KB | 08 Dec 2023 - 01:09 |
| scrapy | 44+7 | 192.90 KB | 27 Dec 2023 - 08:14 |
| Feedfetcher-Google | 48 | 856.03 KB | 29 Nov 2023 - 16:57 |
| Ruby script | 48 | 315.29 KB | 20 Sep 2023 - 08:51 |
| trendiction | 42+5 | 777.61 KB | 19 Sep 2023 - 19:25 |
| fetcher | 41+2 | 1.12 MB | 06 Dec 2023 - 19:46 |
| Java ( catchall ) | 38+4 | 997.02 KB | 23 Dec 2023 - 20:41 |
| netvibes | 42 | 1.07 MB | 20 Sep 2023 - 07:41 |
| Xenu Link Sleuth | 41 | 0 | 02 Aug 2023 - 23:43 |
| Yahoo! Slurp | 22+18 | 740.56 KB | 30 Dec 2023 - 20:48 |
| linkbot | 24+12 | 68.68 KB | 07 Sep 2023 - 04:10 |
| ubermetrics-technologies.com | 28+5 | 807.85 KB | 19 Sep 2023 - 23:52 |
| daumoa | 23+9 | 86.49 KB | 20 Dec 2023 - 07:52 |
| SemrushBot-SI | 32 | 680.28 KB | 27 Dec 2023 - 11:00 |
| ips-agent | 18+12 | 70.32 KB | 13 Dec 2023 - 07:38 |
| LinkedInBot | 27+2 | 1.41 MB | 20 Sep 2023 - 06:31 |
| 2345Explorer | 29 | 1.29 MB | 23 Dec 2023 - 00:47 |
| filterdb.iss.net | 26 | 1.29 MB | 25 Oct 2023 - 23:00 |
| TelegramBot | 26 | 386.02 KB | 29 Dec 2023 - 23:00 |
| YandexMetrika | 26 | 1.26 MB | 08 Dec 2023 - 07:38 |
| favicon | 23 | 197.37 KB | 22 Dec 2023 - 19:54 |
| [^a]fish | 23 | 231.71 KB | 27 Oct 2023 - 17:21 |
| rambler | 23 | 420.44 KB | 09 Mar 2023 - 01:27 |
| Mediapartners-Google | 21 | 533.43 KB | 30 Nov 2023 - 22:56 |
| ning | 18 | 188.26 KB | 23 Dec 2023 - 04:33 |
| checker | 12+4 | 32.87 KB | 26 Sep 2023 - 22:18 |
| bit.ly | 9+7 | 129.44 KB | 27 Oct 2023 - 06:00 |
| semanticbot | 11+4 | 155.35 KB | 04 Apr 2023 - 10:07 |
| MSIE 4 - ( Rogue Robot ) | 10+2 | 93.96 KB | 03 Dec 2023 - 11:57 |
| perl | 12 | 353.27 KB | 19 Sep 2023 - 21:25 |
| serendeputy | 7+5 | 255.80 KB | 19 Dec 2023 - 20:31 |
| worm | 11 | 99.16 KB | 19 Sep 2023 - 18:53 |
| Windows 99 - ( Rogue Robot ) | 10+1 | 136.69 KB | 22 Dec 2023 - 20:52 |
| magpie | 6+4 | 92.37 KB | 19 Sep 2023 - 19:21 |
| linkchecker | 10 | 0 | 04 Dec 2023 - 01:54 |
| MixrankBot | 10 | 72.94 KB | 21 Jan 2023 - 08:03 |
| raven | 10 | 97.43 KB | 27 Dec 2023 - 18:57 |
| pita | 10 | 63.18 KB | 23 Dec 2023 - 04:33 |
| drupal | 9 | 85.84 KB | 23 Dec 2023 - 04:34 |
| Mojolicious | 9 | 262.03 KB | 17 Mar 2023 - 03:20 |
| Jigsaw | 8 | 63.82 KB | 20 Nov 2023 - 06:37 |
| mozilla/4.0 (compatible;) - ( Rogue Robot ) | 8 | 69.59 KB | 28 Dec 2023 - 14:09 |
| monster | 8 | 87.40 KB | 20 Sep 2023 - 06:26 |
| CheckMarkNetwork | 5+2 | 16.84 KB | 18 Jun 2023 - 04:37 |
| AdIdxBot Microsoft Ad Quality control | 7 | 146.13 KB | 11 Apr 2023 - 23:43 |
| felix | 6 | 112.59 KB | 20 Sep 2023 - 06:25 |
| webcollage | 6 | 202.14 KB | 07 Nov 2023 - 16:48 |
| nomad | 6 | 94.23 KB | 23 Dec 2023 - 04:33 |
| calif[^r] | 6 | 77.98 KB | 19 Sep 2023 - 19:01 |
| facebook | 6 | 111.28 KB | 19 Sep 2023 - 18:54 |
| suke | 6 | 56.18 KB | 05 Oct 2023 - 11:06 |
| Nautic Expo using Firefox/1.5 | 6 | 16.52 KB | 08 Dec 2023 - 14:47 |
| miva | 5 | 12.05 KB | 22 Dec 2023 - 14:26 |
| scanner | 5 | 16.81 KB | 21 Dec 2023 - 08:02 |
| ICC-Crawler | 4+1 | 143.54 KB | 03 Feb 2023 - 12:22 |
| Mechanize | 5 | 44.01 KB | 19 Sep 2023 - 19:02 |
| grub | 5 | 28.81 KB | 24 Jun 2023 - 07:41 |
| Mediatoolkitbot | 4+1 | 41.92 KB | 20 Sep 2023 - 05:49 |
| dlvr.it | 5 | 325.40 KB | 26 Sep 2023 - 00:57 |
| validator | 4 | 15.13 KB | 28 Jun 2023 - 19:40 |
| legs | 4 | 18.17 KB | 08 Dec 2023 - 14:24 |
| ODP link checker | 4 | 112.49 KB | 19 Oct 2023 - 05:46 |
| wombat | 4 | 16.89 KB | 23 Dec 2023 - 04:33 |
| Validator.nu | 4 | 25.07 KB | 02 Dec 2023 - 09:48 |
| wmir | 4 | 21.35 KB | 22 Dec 2023 - 15:25 |
| octopus | 4 | 54.28 KB | 19 Sep 2023 - 22:07 |
| webcopy | 3 | 2.58 KB | 14 Aug 2023 - 20:56 |
| smtbot | 3 | 50.04 KB | 04 Sep 2023 - 14:35 |
| xydo | 3 | 15.02 KB | 05 Aug 2023 - 01:52 |
| YandexImageResizer | 3 | 1.33 MB | 11 Dec 2023 - 07:16 |
| rojo | 3 | 5.22 KB | 18 Mar 2023 - 05:03 |
| W3C_Validator | 3 | 22.49 KB | 02 Dec 2023 - 09:48 |
| wolp | 3 | 13.94 KB | 13 Oct 2023 - 16:46 |
| ucsd | 3 | 55.49 KB | 08 Dec 2023 - 14:16 |
| Konqueror | 3 | 22.37 KB | 13 Oct 2023 - 21:52 |
| Adsbot | 3 | 8.57 KB | 30 Nov 2023 - 13:17 |
| xirq | 3 | 13.60 KB | 09 Jun 2023 - 14:12 |
| MSIE 2 - ( Rogue Robot ) | 3 | 71.02 KB | 13 Dec 2023 - 01:54 |
| LinkCheck | 3 | 192.18 KB | 10 Nov 2023 - 11:01 |
| discover | 3 | 205.65 KB | 22 Nov 2023 - 05:48 |
| fdse | 3 | 11.46 KB | 18 Aug 2023 - 17:12 |
| Microsoft Office Protocol Discovery | 3 | 0 | 27 Apr 2023 - 15:14 |
| bl.uk_lddc_bot | 1+2 | 21.36 KB | 24 Jul 2023 - 18:00 |
| W3C-checklink | 1+1 | 145 Bytes | 06 Mar 2023 - 03:19 |
| zeus | 2 | 9.77 KB | 23 Dec 2023 - 04:34 |
| hunter | 2 | 37.53 KB | 20 Sep 2023 - 07:09 |
| XML Sitemaps Generator | 2 | 18.54 KB | 03 Dec 2023 - 10:25 |
| sitemap | 2 | 220.63 KB | 03 Dec 2023 - 10:25 |
| ilse | 2 | 5.41 KB | 14 Apr 2023 - 12:18 |
| r6\_ | 1+1 | 15.39 KB | 19 Feb 2023 - 19:50 |
| bloglovin | 2 | 25.55 KB | 15 Dec 2023 - 12:25 |
| rbse | 2 | 6.61 KB | 10 Jun 2023 - 03:14 |
| ELinks | 2 | 10.59 KB | 22 Mar 2023 - 19:13 |
| dwcp | 2 | 4.42 KB | 17 Mar 2023 - 13:51 |
| fido | 2 | 6.22 KB | 13 Oct 2023 - 17:04 |
| wwwc | 2 | 6.98 KB | 29 Sep 2023 - 16:28 |
| ng/1. | 2 | 27.85 KB | 19 Feb 2023 - 18:24 |
| TestCrawler | 1+1 | 43.89 KB | 29 Dec 2023 - 05:45 |
| spry | 2 | 6.24 KB | 24 Nov 2023 - 14:07 |
| yie8 | 2 | 107.63 KB | 24 Jul 2023 - 04:03 |
| regator | 2 | 6.71 KB | 28 Oct 2023 - 09:36 |
| simplepie | 2 | 84.03 KB | 19 Sep 2023 - 20:16 |
| Windows 95 - ( Rogue Robot ) | 1 | 37.09 KB | 12 Oct 2023 - 00:20 |
| jobo | 1 | 7.32 KB | 12 May 2023 - 18:09 |
| Googlebot-Mobile | 1 | 2.58 KB | 14 May 2023 - 02:07 |
| pioneer | 1 | 11.85 KB | 19 Sep 2023 - 18:56 |
| gougou | 1 | 2.58 KB | 26 Jul 2023 - 16:24 |
| churl | 1 | 2.88 KB | 28 Aug 2023 - 23:01 |
| Baiduspider-image | 1 | 119.16 KB | 03 May 2023 - 21:51 |
| arks | 1 | 1.66 KB | 18 Mar 2023 - 05:01 |
| DoCoMo | 1 | 2.58 KB | 27 Mar 2023 - 05:18 |
| CUBOT | 1 | 2.30 KB | 01 Apr 2023 - 02:24 |
| sven | 1 | 7.62 KB | 27 Oct 2023 - 16:34 |
| protopage | 1 | 11.85 KB | 19 Sep 2023 - 19:11 |
| xget | 1 | 2.58 KB | 17 Mar 2023 - 16:34 |
| eccp | 1 | 2.58 KB | 06 Jan 2023 - 08:19 |
| MSIECrawler | 1 | 0 | 19 Jan 2023 - 16:10 |
| sohu ( catchall ) | 1 | 1.89 KB | 18 Aug 2023 - 17:08 |
| Yahoo Link Preview | 1 | 3.05 KB | 16 Jan 2023 - 07:23 |
| microsoft-webdav-miniredir | 1 | 0 | 18 Jun 2023 - 11:37 |
| MSIE 3 - ( Rogue Robot ) | 1 | 32.58 KB | 12 Oct 2023 - 05:00 |
| webindexer | 1 | 56.02 KB | 18 Dec 2023 - 07:07 |
| gazz | 1 | 3.89 KB | 08 Dec 2023 - 14:28 |
|