| 229 different robots | Hits | Bandwidth | Last visit |
|---|
| PetalBot | 61,693+839 | 3.18 GB | 31 Dec 2024 - 23:59 |
| facebook | 15,467+17 | 711.17 MB | 31 Dec 2024 - 23:59 |
| Googlebot-Image | 96,045 | 3.42 GB | 31 Dec 2024 - 23:59 |
| python | 127,283+2619 | 1.34 GB | 31 Dec 2024 - 23:59 |
| Unknown robot (identified by hit on robots.txt) | 0+14387 | 1.17 MB | 31 Dec 2024 - 23:50 |
| Sogou web spider | 8,846+55 | 193.87 MB | 31 Dec 2024 - 23:44 |
| Unknown robot identified by \*bot | 4,704+477 | 48.00 MB | 31 Dec 2024 - 23:40 |
| Unknown robot identified by bot\* | 10,699,197+11622 | 213.84 GB | 31 Dec 2024 - 23:20 |
| Googlebot | 76,484+1801 | 1.13 GB | 31 Dec 2024 - 23:18 |
| Applebot | 46,012+534 | 496.97 MB | 31 Dec 2024 - 23:08 |
| Firefox version 10 and lower - various robots | 7,649+168 | 634.62 MB | 31 Dec 2024 - 22:59 |
| Go-http-client | 79,194+2318 | 3.43 GB | 31 Dec 2024 - 22:32 |
| MJ12bot | 57,387+2560 | 7.09 GB | 31 Dec 2024 - 22:27 |
| Bytespider | 759,202+921 | 33.75 GB | 31 Dec 2024 - 22:26 |
| empty user agent string | 3,749+384 | 505.00 MB | 31 Dec 2024 - 22:23 |
| SeznamBot | 7,376+677 | 52.09 MB | 31 Dec 2024 - 22:01 |
| AhrefsBot | 87,215+2551 | 1.00 GB | 31 Dec 2024 - 21:43 |
| YandexBot | 13,297+6860 | 318.60 MB | 31 Dec 2024 - 21:29 |
| facebookexternalhit | 58,191+923 | 1.81 GB | 31 Dec 2024 - 21:28 |
| crawl | 13,563+291 | 7.00 GB | 31 Dec 2024 - 20:59 |
| bbot | 50+8 | 518.29 KB | 31 Dec 2024 - 20:18 |
| Pinterestbot | 12,311+316 | 128.09 MB | 31 Dec 2024 - 20:00 |
| SemrushBot | 14,195+3341 | 113.87 MB | 31 Dec 2024 - 19:41 |
| CFNetwork | 1,666 | 51.95 MB | 31 Dec 2024 - 19:34 |
| sift | 58,361+1157 | 892.73 MB | 31 Dec 2024 - 18:42 |
| core | 415+68 | 12.69 MB | 31 Dec 2024 - 18:06 |
| mozilla/5.0 - ( Rogue Robot ) | 111+3 | 2.24 MB | 31 Dec 2024 - 16:39 |
| YandexImages | 2,246 | 68.10 MB | 31 Dec 2024 - 15:59 |
| Yandex ( catchall ) | 4,480 | 34.28 MB | 31 Dec 2024 - 15:24 |
| Baiduspider ( catchall ) | 4,617 | 78.31 MB | 31 Dec 2024 - 14:51 |
| MojeekBot | 516+594 | 6.22 MB | 31 Dec 2024 - 14:32 |
| Curl | 1,807 | 51.61 MB | 31 Dec 2024 - 08:55 |
| nutch ( catchall ) | 5,686+754 | 116.99 MB | 31 Dec 2024 - 01:00 |
| yacybot | 650+126 | 17.48 MB | 31 Dec 2024 - 00:48 |
| Discordbot | 205 | 8.60 MB | 31 Dec 2024 - 00:36 |
| Mozilla ( Rogue Robot ) | 1+3 | 10.81 KB | 30 Dec 2024 - 20:29 |
| Java ( catchall ) | 1,358+17 | 68.30 MB | 30 Dec 2024 - 20:25 |
| yeti | 665+202 | 14.72 MB | 30 Dec 2024 - 19:04 |
| DuckDuckBot | 5,550 | 1.05 GB | 30 Dec 2024 - 18:19 |
| favicon | 91 | 1.07 MB | 30 Dec 2024 - 17:07 |
| Apache-HttpClient | 1,380+144 | 8.99 MB | 30 Dec 2024 - 14:51 |
| MSIE 6 - ( Rogue Robot ) | 480 | 14.97 MB | 30 Dec 2024 - 13:07 |
| bingbot | 56,971+791 | 1.36 GB | 30 Dec 2024 - 10:33 |
| Barkrowler | 121,219+239 | 21.15 GB | 30 Dec 2024 - 09:27 |
| zoominfobot | 3,587+436 | 23.45 MB | 30 Dec 2024 - 06:49 |
| TelegramBot | 53 | 650.91 KB | 29 Dec 2024 - 18:35 |
| 360Spider | 200+14 | 704.45 KB | 29 Dec 2024 - 17:00 |
| trendiction | 211+174 | 4.58 MB | 29 Dec 2024 - 15:35 |
| scrapy | 9,865+18 | 178.74 MB | 29 Dec 2024 - 13:37 |
| Mediapartners-Google | 736 | 15.69 MB | 29 Dec 2024 - 10:59 |
| Dalvik | 478 | 24.55 MB | 29 Dec 2024 - 04:40 |
| DuckDuckBot-Https | 3,794+31 | 57.00 MB | 29 Dec 2024 - 03:06 |
| YandexMobileBot | 899 | 5.13 MB | 28 Dec 2024 - 21:27 |
| motor | 373+3 | 16.55 MB | 28 Dec 2024 - 19:22 |
| nbot | 41,853+119 | 3.89 GB | 28 Dec 2024 - 09:05 |
| wordpress | 262 | 1.84 MB | 28 Dec 2024 - 08:34 |
| blog | 78 | 2.02 MB | 28 Dec 2024 - 01:08 |
| Python-urllib | 249+55 | 15.84 MB | 28 Dec 2024 - 01:08 |
| internetarchive | 49 | 1.17 MB | 27 Dec 2024 - 23:55 |
| Screaming Frog SEO Spider | 187+10 | 4.00 MB | 27 Dec 2024 - 16:40 |
| custo | 184 | 1.44 MB | 26 Dec 2024 - 20:01 |
| robot | 182+5 | 6.89 MB | 26 Dec 2024 - 06:29 |
| Google Web Preview | 3,057 | 69.17 MB | 26 Dec 2024 - 01:35 |
| SurdotlyBot | 94+5 | 331.34 KB | 25 Dec 2024 - 05:23 |
| archive.org_bot | 1,817+25 | 46.50 MB | 24 Dec 2024 - 19:12 |
| Windows 99 - ( Rogue Robot ) | 15,176+5 | 2.36 GB | 24 Dec 2024 - 14:14 |
| Windows 95 - ( Rogue Robot ) | 78 | 2.58 MB | 24 Dec 2024 - 14:14 |
| MSIE 5 - ( Rogue Robot ) | 298 | 38.22 MB | 24 Dec 2024 - 14:12 |
| DomainCrawler | 1 | 3.58 KB | 24 Dec 2024 - 12:00 |
| Nautic Expo using Firefox/1.5 | 7 | 90.49 KB | 24 Dec 2024 - 11:36 |
| FirePHP | 106 | 5.19 MB | 23 Dec 2024 - 08:33 |
| urllib | 380 | 14.51 MB | 23 Dec 2024 - 03:52 |
| MSIE 4 - ( Rogue Robot ) | 85+8 | 6.47 MB | 23 Dec 2024 - 00:52 |
| BLEXBot | 18,360+229 | 133.97 MB | 21 Dec 2024 - 21:26 |
| MSIE 3 - ( Rogue Robot ) | 25 | 765.33 KB | 21 Dec 2024 - 02:35 |
| Baiduspider | 2,882 | 24.60 MB | 20 Dec 2024 - 10:12 |
| Slackbot-LinkExpanding | 196 | 687.92 KB | 20 Dec 2024 - 07:00 |
| ELinks | 9 | 132.07 KB | 20 Dec 2024 - 04:11 |
| MSIE 2 - ( Rogue Robot ) | 8 | 53.49 KB | 18 Dec 2024 - 15:14 |
| BW | 78+61 | 282.58 KB | 17 Dec 2024 - 12:47 |
| ltbot | 1 | 23.23 KB | 17 Dec 2024 - 11:07 |
| MSIECrawler | 3 | 16.52 KB | 14 Dec 2024 - 06:48 |
| YisouSpider | 342+52 | 2.64 MB | 14 Dec 2024 - 05:26 |
| Yahoo! Slurp | 18+19 | 401.01 KB | 13 Dec 2024 - 19:08 |
| CheckMarkNetwork | 15+9 | 26.48 KB | 11 Dec 2024 - 19:34 |
| yie8 | 7 | 456.69 KB | 11 Dec 2024 - 06:33 |
| Wget | 860+5 | 14.38 MB | 11 Dec 2024 - 06:19 |
| checker | 591 | 5.16 MB | 08 Dec 2024 - 09:33 |
| libwww-perl | 8 | 90.91 KB | 08 Dec 2024 - 04:53 |
| dataprovider.com | 504+14 | 22.06 MB | 07 Dec 2024 - 21:55 |
| hometown | 94 | 638.77 KB | 06 Dec 2024 - 11:47 |
| netcraft | 38 | 353.93 KB | 04 Dec 2024 - 21:43 |
| A PHP script | 53+5 | 1.07 MB | 04 Dec 2024 - 09:56 |
| CCBot | 1,781+134 | 17.88 MB | 04 Dec 2024 - 08:19 |
| feed | 92 | 1.49 MB | 03 Dec 2024 - 20:45 |
| Lightspeed | 67 | 2.20 MB | 02 Dec 2024 - 15:14 |
| fetcher | 9+3 | 87.04 KB | 30 Nov 2024 - 00:32 |
| link | 5,656+40 | 93.43 MB | 29 Nov 2024 - 23:29 |
| Velen | 43+16 | 510.52 KB | 27 Nov 2024 - 11:40 |
| seek | 49,275+64 | 6.43 GB | 23 Nov 2024 - 22:58 |
| gigablastopensource | 7+3 | 141.07 KB | 23 Nov 2024 - 00:27 |
| ning | 8 | 55.60 KB | 18 Nov 2024 - 18:47 |
| DotBot | 60,298+5185 | 20.01 GB | 16 Nov 2024 - 20:55 |
| linkchecker | 33+5 | 49.08 KB | 08 Nov 2024 - 01:08 |
| LinkCheck | 6 | 270.94 KB | 04 Nov 2024 - 19:51 |
| Jigsaw | 2 | 9.86 KB | 02 Nov 2024 - 07:41 |
| Validator.nu | 2 | 12.20 KB | 02 Nov 2024 - 05:35 |
| W3C_Validator | 3 | 29.62 KB | 02 Nov 2024 - 05:35 |
| butterfly | 133+1 | 2.31 MB | 01 Nov 2024 - 17:58 |
| filterdb.iss.net | 251 | 1.79 MB | 31 Oct 2024 - 05:38 |
| Konqueror | 6 | 47.98 KB | 29 Oct 2024 - 13:38 |
| spider | 1,388+25 | 18.39 MB | 22 Oct 2024 - 14:09 |
| msnbot-media | 1 | 3.58 KB | 21 Oct 2024 - 19:33 |
| nominet | 174+1 | 7.73 MB | 20 Oct 2024 - 20:49 |
| netEstate NE Crawler | 2,588+58 | 34.87 MB | 18 Oct 2024 - 17:14 |
| twitterbot | 164+70 | 2.05 MB | 16 Oct 2024 - 19:49 |
| Googlebot-Video | 47 | 3.72 GB | 13 Oct 2024 - 01:29 |
| DuckDuckGo-Favicons-Bot | 320 | 1.10 MB | 11 Oct 2024 - 16:04 |
| bit.ly | 18+9 | 90.37 KB | 08 Oct 2024 - 16:21 |
| scanner | 26 | 91.53 KB | 05 Oct 2024 - 22:38 |
| Adsbot | 1 | 3.53 KB | 05 Oct 2024 - 02:47 |
| Mail.RU Bot | 1,482+1178 | 19.28 MB | 02 Oct 2024 - 20:48 |
| coccoc | 745+715 | 22.64 MB | 02 Oct 2024 - 17:46 |
| BingPreview | 479 | 17.14 MB | 02 Oct 2024 - 07:08 |
| linkbot | 133+68 | 461.47 KB | 28 Sep 2024 - 14:59 |
| raven | 6 | 44.35 KB | 28 Sep 2024 - 03:15 |
| yak-linkfluence | 226+28 | 4.65 MB | 28 Sep 2024 - 00:15 |
| sohu ( catchall ) | 1 | 2.48 KB | 27 Sep 2024 - 16:51 |
| eccp | 3 | 6.27 KB | 27 Sep 2024 - 16:17 |
| legs | 2 | 15.48 KB | 27 Sep 2024 - 15:59 |
| Baiduspider-image | 3 | 26.88 KB | 27 Sep 2024 - 04:52 |
| collective | 3 | 24.47 KB | 21 Sep 2024 - 19:27 |
| [^a]fish | 13 | 100.74 KB | 20 Sep 2024 - 14:12 |
| emacs | 5 | 31.45 KB | 20 Sep 2024 - 12:40 |
| drupal | 3 | 19.23 KB | 20 Sep 2024 - 12:40 |
| wombat | 3 | 19.23 KB | 20 Sep 2024 - 12:40 |
| pita | 4 | 27.34 KB | 20 Sep 2024 - 12:40 |
| kevin | 1 | 8.32 KB | 20 Sep 2024 - 12:40 |
| PhantomJS | 3 | 64.97 KB | 19 Sep 2024 - 14:27 |
| riddler | 0+7 | 630 Bytes | 15 Sep 2024 - 16:12 |
| seokicks.de | 426+5 | 6.26 MB | 14 Sep 2024 - 18:54 |
| discover | 5 | 55.93 KB | 14 Sep 2024 - 01:26 |
| nhse | 2 | 8.90 KB | 13 Sep 2024 - 16:29 |
| spry | 2 | 5.75 KB | 13 Sep 2024 - 16:16 |
| fido | 2 | 7.03 KB | 13 Sep 2024 - 16:14 |
| miva | 3 | 26.15 KB | 13 Sep 2024 - 15:56 |
| gama | 2 | 6.04 KB | 13 Sep 2024 - 15:43 |
| Seobility | 1+1 | 8.10 KB | 13 Sep 2024 - 04:05 |
| DomainStatsBot | 237+9 | 4.57 MB | 10 Sep 2024 - 22:37 |
| YandexImageResizer | 5 | 823.03 KB | 10 Sep 2024 - 19:43 |
| Offline Explorer | 1 | 8.01 KB | 09 Sep 2024 - 04:26 |
| Links ( | 110 | 970.04 KB | 06 Sep 2024 - 19:33 |
| MixrankBot | 9 | 38.03 KB | 04 Sep 2024 - 22:58 |
| ips-agent | 28+6 | 347.34 KB | 04 Sep 2024 - 10:54 |
| bnf.fr_bot | 2+1 | 31.74 KB | 04 Sep 2024 - 08:12 |
| Mediatoolkitbot | 1+1 | 5.75 KB | 04 Sep 2024 - 03:06 |
| W3C-checklink | 3+3 | 222 Bytes | 04 Sep 2024 - 02:47 |
| mozilla/4.0 (compatible;) - ( Rogue Robot ) | 3 | 0 | 02 Sep 2024 - 17:14 |
| IonCrawl | 68+13 | 436.50 KB | 02 Sep 2024 - 02:28 |
| yodaobot | 2 | 21.62 KB | 01 Sep 2024 - 04:50 |
| daum | 27 | 233.35 KB | 30 Aug 2024 - 16:29 |
| heritrix | 210+6 | 5.98 MB | 27 Aug 2024 - 21:19 |
| bloglovin | 1 | 12.77 KB | 22 Aug 2024 - 15:32 |
| linkdexbot | 159+10 | 3.19 MB | 22 Aug 2024 - 05:35 |
| Ruby script | 6 | 45.85 KB | 21 Aug 2024 - 11:31 |
| webcopy | 9 | 8.04 KB | 18 Aug 2024 - 17:06 |
| arks | 1 | 8.11 KB | 17 Aug 2024 - 20:51 |
| zeus | 2 | 17.64 KB | 16 Aug 2024 - 16:11 |
| Yahoo! Slurp China | 1 | 5.22 KB | 16 Aug 2024 - 15:56 |
| jobo | 3 | 9.55 KB | 16 Aug 2024 - 15:51 |
| jbot | 1 | 5.54 KB | 16 Aug 2024 - 15:28 |
| proximic | 12 | 89.77 KB | 16 Aug 2024 - 08:07 |
| serendeputy | 6+5 | 52.46 KB | 14 Aug 2024 - 17:46 |
| 2345Explorer | 24 | 231.56 KB | 13 Aug 2024 - 14:51 |
| msnbot | 3 | 25.11 KB | 10 Aug 2024 - 05:13 |
| XML Sitemaps Generator | 4 | 37.94 KB | 03 Aug 2024 - 08:34 |
| sitemap | 4 | 336.90 KB | 03 Aug 2024 - 08:26 |
| Microsoft Office Protocol Discovery | 1 | 0 | 03 Aug 2024 - 03:00 |
| XoviBot | 6 | 158.04 KB | 28 Jul 2024 - 03:43 |
| Yahoo Link Preview | 8 | 263.72 KB | 20 Jul 2024 - 13:21 |
| dwcp | 3 | 6.31 KB | 19 Jul 2024 - 14:52 |
| nomad | 8 | 31.61 KB | 16 Jul 2024 - 04:48 |
| perl | 32 | 100.41 KB | 09 Jul 2024 - 15:48 |
| DoCoMo | 1 | 17.54 KB | 08 Jul 2024 - 04:47 |
| LinkedInBot | 6 | 497.87 KB | 07 Jul 2024 - 21:40 |
| microsoft-webdav-miniredir | 2 | 0 | 07 Jul 2024 - 06:15 |
| wolp | 1 | 74.16 KB | 05 Jul 2024 - 16:35 |
| ucsd | 2 | 403.91 KB | 05 Jul 2024 - 16:07 |
| ilse | 1 | 2.15 KB | 05 Jul 2024 - 15:50 |
| special_archiver | 7+1 | 167.65 KB | 05 Jul 2024 - 02:42 |
| panscient | 28+4 | 165.35 KB | 04 Jul 2024 - 08:56 |
| speedy | 1 | 22.13 KB | 03 Jul 2024 - 06:44 |
| daumoa | 0+17 | 1.23 KB | 28 Jun 2024 - 09:20 |
| qwantify | 147+18 | 3.86 MB | 24 Jun 2024 - 09:57 |
| yanga | 1 | 4.05 KB | 21 Jun 2024 - 16:05 |
| xirq | 2 | 4.89 KB | 21 Jun 2024 - 16:03 |
| Xenu Link Sleuth | 2 | 85.58 KB | 21 Jun 2024 - 01:25 |
| y!j | 15+19 | 578.29 KB | 12 Jun 2024 - 14:18 |
| worm | 1 | 2.64 KB | 07 Jun 2024 - 14:59 |
| turtle | 1 | 3.49 KB | 31 May 2024 - 11:51 |
| harvest | 5+3 | 178.38 KB | 31 May 2024 - 07:01 |
| htmlparser | 1 | 0 | 16 May 2024 - 22:12 |
| facebot | 1 | 17.42 KB | 15 May 2024 - 13:00 |
| coolbot | 3 | 132.87 KB | 11 May 2024 - 16:10 |
| rojo | 1 | 10.94 KB | 10 May 2024 - 15:00 |
| webcollage | 3 | 711.48 KB | 26 Apr 2024 - 20:15 |
| sitebot | 1+1 | 3.58 KB | 21 Apr 2024 - 23:08 |
| rambler | 1 | 10.59 KB | 19 Apr 2024 - 01:27 |
| ELinks ( | 1 | 17.25 KB | 15 Apr 2024 - 05:53 |
| wwwc | 1 | 13.13 KB | 12 Apr 2024 - 15:34 |
| ng/1. | 2 | 26.41 KB | 08 Apr 2024 - 13:03 |
| suke | 3 | 21.61 KB | 29 Mar 2024 - 16:12 |
| sven | 1 | 2.51 KB | 29 Mar 2024 - 15:59 |
| Who.is.Bot | 1 | 10.59 KB | 26 Mar 2024 - 17:48 |
| superbot | 1 | 3.49 KB | 20 Mar 2024 - 18:06 |
| ia_archiver | 22 | 490.58 KB | 20 Mar 2024 - 14:58 |
| The Knowledge AI | 0+3 | 270 Bytes | 12 Mar 2024 - 10:27 |
| ubermetrics-technologies.com | 6+3 | 22.76 KB | 05 Mar 2024 - 13:15 |
| slurp | 1 | 1.37 KB | 01 Mar 2024 - 15:10 |
| SafeDNSBot | 1+2 | 3.60 KB | 29 Feb 2024 - 05:22 |
| octopus | 2 | 51.81 KB | 25 Feb 2024 - 14:23 |
| Googlebot-Mobile | 1 | 3.43 KB | 12 Feb 2024 - 01:48 |
| SemrushBot-SI | 4 | 85.05 KB | 07 Feb 2024 - 11:54 |
| My Nutch Spider | 2+1 | 10.91 KB | 22 Jan 2024 - 13:38 |
| YandexMetrika | 26 | 1.26 MB | 11 Jan 2024 - 07:14 |
| ODP link checker | 1 | 5.75 KB | 11 Jan 2024 - 00:52 |
| Feedfetcher-Google | 1 | 13.01 KB | 10 Jan 2024 - 01:26 |
| rbse | 1 | 4.33 KB | 05 Jan 2024 - 15:34 |
| perman | 101+1 | 1.99 MB | 03 Jan 2024 - 09:29 |
|