| 207 different robots | Hits | Bandwidth | Last visit |
|---|
| bingbot | 146,354+3980 | 11.60 GB | 31 Dec 2020 - 23:59 |
| Adsbot | 44,272+88 | 22.12 GB | 31 Dec 2020 - 23:59 |
| AhrefsBot | 63,623+1230 | 17.60 GB | 31 Dec 2020 - 23:56 |
| DuckDuckBot | 1,991+1 | 190.06 MB | 31 Dec 2020 - 23:53 |
| SeznamBot | 26,901+4381 | 373.97 MB | 31 Dec 2020 - 23:51 |
| Mail.RU Bot | 5,872+3763 | 116.46 MB | 31 Dec 2020 - 23:51 |
| Unknown robot (identified by hit on robots.txt) | 0+1665 | 182.33 KB | 31 Dec 2020 - 23:47 |
| Googlebot-Image | 32,629 | 621.19 MB | 31 Dec 2020 - 23:45 |
| MJ12bot | 20,461+2753 | 460.04 MB | 31 Dec 2020 - 23:40 |
| Googlebot | 62,862+856 | 780.47 MB | 31 Dec 2020 - 23:39 |
| facebookexternalhit | 4,586+14 | 152.69 MB | 31 Dec 2020 - 23:33 |
| Unknown robot identified by bot\* | 3,118,346+3983 | 87.16 GB | 31 Dec 2020 - 23:31 |
| PetalBot | 26,065+861 | 372.13 MB | 31 Dec 2020 - 23:26 |
| Applebot | 16,693+676 | 211.31 MB | 31 Dec 2020 - 23:22 |
| YandexBot | 13,897+4300 | 409.60 MB | 31 Dec 2020 - 23:10 |
| internetarchive | 54 | 0 | 31 Dec 2020 - 22:53 |
| BingPreview | 3,229 | 88.32 MB | 31 Dec 2020 - 22:48 |
| Baiduspider | 3,527+11 | 533.92 MB | 31 Dec 2020 - 22:39 |
| Pinterestbot | 13,605+290 | 116.42 MB | 31 Dec 2020 - 22:38 |
| Sogou web spider | 2,217+423 | 12.40 MB | 31 Dec 2020 - 21:59 |
| The Knowledge AI | 98,325+1100 | 31.69 GB | 31 Dec 2020 - 21:27 |
| Barkrowler | 10,237+255 | 1.83 GB | 31 Dec 2020 - 20:45 |
| Go-http-client | 3,498+120 | 127.16 MB | 31 Dec 2020 - 20:42 |
| YisouSpider | 346+46 | 3.73 MB | 31 Dec 2020 - 20:03 |
| coccoc | 1,125+870 | 16.29 MB | 31 Dec 2020 - 19:27 |
| linkdexbot | 831+49 | 16.19 MB | 31 Dec 2020 - 19:25 |
| YandexImages | 5,989 | 112.95 MB | 31 Dec 2020 - 19:13 |
| favicon | 666 | 2.63 MB | 31 Dec 2020 - 18:53 |
| yahoocachesystem | 1,871 | 67.33 MB | 31 Dec 2020 - 18:51 |
| Firefox version 10 and lower - various robots | 1,805+151 | 82.25 MB | 31 Dec 2020 - 18:27 |
| MSIE 6 - ( Rogue Robot ) | 14,903 | 281.07 MB | 31 Dec 2020 - 16:24 |
| MSIE 5 - ( Rogue Robot ) | 3,047 | 71.28 MB | 31 Dec 2020 - 15:05 |
| DuckDuckGo-Favicons-Bot | 1,092 | 2.22 MB | 31 Dec 2020 - 13:00 |
| netcraft | 25 | 78.78 KB | 31 Dec 2020 - 12:12 |
| crawl | 18,748+414 | 1.66 GB | 31 Dec 2020 - 12:02 |
| Bytespider | 1,011+77 | 1.33 GB | 31 Dec 2020 - 11:35 |
| Screaming Frog SEO Spider | 127+4 | 1.98 MB | 31 Dec 2020 - 11:29 |
| CFNetwork | 677 | 33.09 MB | 31 Dec 2020 - 10:07 |
| Google Web Preview | 902 | 18.19 MB | 31 Dec 2020 - 10:02 |
| Baiduspider ( catchall ) | 2,300 | 51.29 MB | 31 Dec 2020 - 09:09 |
| 360Spider | 709+19 | 3.50 MB | 31 Dec 2020 - 06:53 |
| seokicks.de | 5,102+98 | 233.11 MB | 31 Dec 2020 - 06:29 |
| MojeekBot | 455+450 | 1.85 MB | 30 Dec 2020 - 23:28 |
| mozilla/4.0 (compatible;) - ( Rogue Robot ) | 106+1 | 141.77 KB | 30 Dec 2020 - 23:04 |
| Apache-HttpClient | 4,748+22 | 10.71 MB | 30 Dec 2020 - 15:33 |
| robot | 345+321 | 7.73 MB | 30 Dec 2020 - 10:02 |
| Nimbostratus-Bot | 186 | 1.10 MB | 30 Dec 2020 - 04:42 |
| empty user agent string | 33,617+102 | 538.65 MB | 30 Dec 2020 - 04:29 |
| Dalvik | 486 | 22.59 MB | 30 Dec 2020 - 00:12 |
| python | 3,657+196 | 22.07 MB | 29 Dec 2020 - 21:48 |
| DotBot | 17,373+1638 | 14.14 GB | 29 Dec 2020 - 18:03 |
| ubermetrics-technologies.com | 18+9 | 38.27 KB | 29 Dec 2020 - 10:18 |
| yeti | 663+95 | 9.73 MB | 29 Dec 2020 - 08:19 |
| TelegramBot | 27 | 736.60 KB | 29 Dec 2020 - 04:38 |
| Mediapartners-Google | 99 | 3.72 MB | 29 Dec 2020 - 00:53 |
| ltx71 | 825+454 | 103.14 MB | 28 Dec 2020 - 16:05 |
| TweetmemeBot | 112 | 1.46 MB | 28 Dec 2020 - 10:31 |
| SemrushBot | 65,752+18104 | 1.57 GB | 28 Dec 2020 - 09:12 |
| yak-linkfluence | 146+18 | 917.87 KB | 27 Dec 2020 - 20:44 |
| Googlebot-Video | 89 | 4.19 GB | 27 Dec 2020 - 19:25 |
| Python-urllib | 377+15 | 15.55 MB | 27 Dec 2020 - 15:55 |
| Yandex ( catchall ) | 9 | 406.11 KB | 27 Dec 2020 - 11:24 |
| nbot | 52 | 6.67 KB | 27 Dec 2020 - 02:19 |
| jbot | 397 | 1.84 MB | 27 Dec 2020 - 01:23 |
| BW | 44+28 | 114.01 KB | 26 Dec 2020 - 20:22 |
| twitterbot | 80+70 | 1.16 MB | 26 Dec 2020 - 13:40 |
| Microsoft Office Protocol Discovery | 19 | 0 | 26 Dec 2020 - 05:47 |
| spider | 1,533+28 | 20.70 MB | 26 Dec 2020 - 05:00 |
| Gowikibot | 5+7 | 11.13 KB | 25 Dec 2020 - 11:57 |
| MSIE 3 - ( Rogue Robot ) | 122 | 1.07 MB | 25 Dec 2020 - 05:49 |
| MSIE 2 - ( Rogue Robot ) | 251 | 2.85 MB | 25 Dec 2020 - 05:49 |
| Windows 95 - ( Rogue Robot ) | 142 | 1.67 MB | 25 Dec 2020 - 05:47 |
| MSIECrawler | 152 | 1.68 MB | 25 Dec 2020 - 05:47 |
| Babya Discoverer | 153 | 2.23 MB | 25 Dec 2020 - 05:34 |
| Java ( catchall ) | 3,346 | 106.02 MB | 25 Dec 2020 - 05:00 |
| Konqueror | 391 | 5.87 MB | 24 Dec 2020 - 23:23 |
| facebook | 312 | 5.07 MB | 24 Dec 2020 - 17:01 |
| webcollage | 14 | 406.12 KB | 24 Dec 2020 - 13:27 |
| Mozilla Beta (Windows) - ( Rogue Robot ) | 261 | 2.75 MB | 24 Dec 2020 - 06:58 |
| Deepnet Explorer | 244 | 2.45 MB | 24 Dec 2020 - 06:57 |
| MSIE 4 - ( Rogue Robot ) | 127 | 1.18 MB | 24 Dec 2020 - 06:46 |
| LinkCheck | 7 | 296.30 KB | 24 Dec 2020 - 04:56 |
| discover | 9 | 111.75 KB | 23 Dec 2020 - 22:19 |
| Yahoo! Slurp | 192+26 | 3.76 MB | 23 Dec 2020 - 21:05 |
| ips-agent | 25+6 | 73.38 KB | 23 Dec 2020 - 17:37 |
| FirePHP | 3 | 36.22 KB | 23 Dec 2020 - 11:25 |
| Wget | 229+7 | 11.42 MB | 22 Dec 2020 - 14:33 |
| core | 1,437+3 | 16.66 MB | 22 Dec 2020 - 05:45 |
| DuckDuckBot-Https | 3,364+20 | 31.01 MB | 21 Dec 2020 - 14:48 |
| proximic | 3+15 | 22.79 KB | 21 Dec 2020 - 09:24 |
| Lightspeed | 293+2 | 7.23 MB | 20 Dec 2020 - 15:17 |
| Curl | 372 | 14.49 MB | 20 Dec 2020 - 09:41 |
| crawler4j | 0+1 | 110 Bytes | 19 Dec 2020 - 22:05 |
| wordpress | 471 | 3.57 MB | 19 Dec 2020 - 16:58 |
| SurdotlyBot | 22+4 | 46.13 KB | 18 Dec 2020 - 19:00 |
| PhantomJS | 49 | 1.44 MB | 18 Dec 2020 - 13:43 |
| testbot | 1 | 2.08 KB | 17 Dec 2020 - 15:46 |
| yacybot | 47+8 | 663.30 KB | 16 Dec 2020 - 21:35 |
| BLEXBot | 24,026+297 | 90.05 MB | 16 Dec 2020 - 21:32 |
| link | 15,260+65 | 217.15 MB | 16 Dec 2020 - 14:55 |
| YandexImageResizer | 34 | 1.88 MB | 16 Dec 2020 - 10:24 |
| fetcher | 128 | 2.72 MB | 15 Dec 2020 - 13:55 |
| Unknown robot identified by \*bot | 54+1 | 407.23 KB | 14 Dec 2020 - 14:10 |
| GrapeshotCrawler | 14+74 | 38.63 KB | 14 Dec 2020 - 09:23 |
| AdIdxBot Microsoft Ad Quality control | 275 | 8.41 MB | 14 Dec 2020 - 00:05 |
| panscient | 70+6 | 457.00 KB | 13 Dec 2020 - 11:51 |
| ia_archiver | 3,830+236 | 70.85 MB | 10 Dec 2020 - 08:37 |
| vebidoobot | 33 | 68.56 KB | 09 Dec 2020 - 21:28 |
| MegaIndex.ru | 5,541+5 | 45.99 MB | 09 Dec 2020 - 02:44 |
| scrapy | 115+18 | 2.43 MB | 09 Dec 2020 - 01:36 |
| DomainStatsBot | 248+10 | 3.48 MB | 08 Dec 2020 - 17:46 |
| motor | 146 | 1.92 MB | 05 Dec 2020 - 15:35 |
| htmlparser | 6 | 39.98 KB | 04 Dec 2020 - 12:24 |
| CCBot | 1,291+70 | 5.33 MB | 03 Dec 2020 - 06:00 |
| daumoa | 18 | 160.69 KB | 01 Dec 2020 - 12:12 |
| ODP link checker | 2 | 10.90 KB | 30 Nov 2020 - 20:34 |
| MixrankBot | 53 | 195.46 KB | 29 Nov 2020 - 20:56 |
| smtbot | 396+9 | 2.62 MB | 29 Nov 2020 - 04:00 |
| tweetedtimes | 3 | 14.82 KB | 28 Nov 2020 - 15:43 |
| perl | 8 | 280.82 KB | 28 Nov 2020 - 12:49 |
| ng/1. | 2 | 67.39 KB | 28 Nov 2020 - 12:49 |
| Discordbot | 23 | 2.51 MB | 27 Nov 2020 - 10:32 |
| IndeedBot | 3,292+4 | 19.34 MB | 24 Nov 2020 - 04:25 |
| mozilla/5.0 - ( Rogue Robot ) | 31+1 | 472.48 KB | 22 Nov 2020 - 22:51 |
| gocrawl | 0+16 | 1.69 KB | 21 Nov 2020 - 05:46 |
| zoominfobot | 2+2 | 6.44 KB | 20 Nov 2020 - 17:22 |
| GarlikCrawler | 1,087+29 | 495.07 MB | 19 Nov 2020 - 16:10 |
| linkbot | 22+1 | 92.01 KB | 18 Nov 2020 - 23:52 |
| SafeDNSBot | 4+4 | 8.73 KB | 18 Nov 2020 - 17:21 |
| 2345Explorer | 39 | 861.27 KB | 13 Nov 2020 - 10:06 |
| filterdb.iss.net | 57+2 | 1.64 MB | 11 Nov 2020 - 19:06 |
| checker | 147 | 2.05 MB | 11 Nov 2020 - 02:35 |
| Velen | 38 | 345.75 KB | 11 Nov 2020 - 02:33 |
| SemrushBot-SI | 5 | 36.79 KB | 10 Nov 2020 - 02:37 |
| bl.uk_lddc_bot | 2+2 | 31.79 KB | 05 Nov 2020 - 16:33 |
| archive.org_bot | 1,280+97 | 36.61 MB | 03 Nov 2020 - 17:09 |
| Yahoo Link Preview | 13 | 83.21 KB | 01 Nov 2020 - 15:10 |
| adscanner | 35 | 997.55 KB | 29 Oct 2020 - 13:14 |
| CMS Crawler | 6 | 36.36 KB | 28 Oct 2020 - 04:27 |
| bnf.fr_bot | 1+1 | 42.30 KB | 27 Oct 2020 - 09:58 |
| ELinks | 1 | 2.08 KB | 24 Oct 2020 - 22:18 |
| ICC-Crawler | 104+6 | 2.62 MB | 22 Oct 2020 - 18:31 |
| drupal | 14 | 281.46 KB | 17 Oct 2020 - 19:49 |
| cfetch | 1 | 122.08 KB | 09 Oct 2020 - 02:04 |
| yie8 | 2 | 19.38 KB | 08 Oct 2020 - 21:51 |
| Windows 99 - ( Rogue Robot ) | 20 | 5.42 MB | 06 Oct 2020 - 09:22 |
| webcopy | 12 | 5.16 MB | 02 Oct 2020 - 03:59 |
| daum | 271+99 | 5.77 MB | 01 Oct 2020 - 23:59 |
| Mozilla ( Rogue Robot ) | 5 | 95.77 KB | 28 Sep 2020 - 06:05 |
| CheckMarkNetwork | 38+7 | 122.06 KB | 27 Sep 2020 - 08:41 |
| dataprovider.com | 307+13 | 11.69 MB | 23 Sep 2020 - 09:54 |
| BingLocalSearch | 11+4 | 144.97 KB | 22 Sep 2020 - 17:41 |
| harvest | 2 | 0 | 21 Sep 2020 - 08:58 |
| anthill | 2 | 32.68 KB | 21 Sep 2020 - 06:44 |
| YandexMobileBot | 4,298 | 12.67 MB | 13 Sep 2020 - 04:59 |
| Naaraa | 0+1 | 110 Bytes | 08 Sep 2020 - 01:29 |
| vse | 9+6 | 56.27 KB | 07 Sep 2020 - 20:12 |
| tracemyfile | 82+4 | 3.01 MB | 05 Sep 2020 - 13:53 |
| serendeputy | 8+10 | 162.53 KB | 02 Sep 2020 - 16:03 |
| nutch ( catchall ) | 1+4 | 32.54 KB | 25 Aug 2020 - 07:32 |
| KomodiaBot | 40 | 617.52 KB | 22 Aug 2020 - 19:01 |
| Xenu Link Sleuth | 14 | 16.38 KB | 22 Aug 2020 - 06:38 |
| trendiction | 4+3 | 110.12 KB | 14 Aug 2020 - 01:42 |
| heritrix | 7+4 | 105.58 KB | 21 Jul 2020 - 16:27 |
| octopus | 1 | 122.58 KB | 20 Jul 2020 - 14:59 |
| ZumBot | 12+6 | 336.73 KB | 18 Jul 2020 - 18:58 |
| Cliqzbot | 121+93 | 842.11 KB | 11 Jul 2020 - 20:27 |
| MauiBot | 4,683+68 | 3.13 GB | 10 Jul 2020 - 08:32 |
| XoviBot | 6 | 1.59 MB | 09 Jul 2020 - 23:37 |
| seek | 5+3 | 65.66 KB | 05 Jul 2020 - 10:06 |
| semanticbot | 2+1 | 12.66 KB | 02 Jul 2020 - 13:23 |
| ning | 51 | 904.39 KB | 24 Jun 2020 - 18:03 |
| Exabot | 163 | 1.42 MB | 22 Jun 2020 - 04:57 |
| A PHP script | 8 | 100.28 KB | 20 Jun 2020 - 11:03 |
| AlphaBot | 1,927 | 35.26 MB | 10 Jun 2020 - 13:56 |
| universalfeedparser | 1 | 16.62 KB | 07 Jun 2020 - 11:28 |
| fastcrawler | 4 | 101.83 KB | 07 Jun 2020 - 08:52 |
| TurnitinBot | 4+5 | 188.91 KB | 28 May 2020 - 20:30 |
| netEstate NE Crawler | 827+30 | 68.84 MB | 24 May 2020 - 10:48 |
| checkbot | 2 | 12.12 KB | 23 May 2020 - 21:40 |
| Mediatoolkitbot | 1+1 | 2.20 KB | 20 May 2020 - 20:44 |
| y!j | 568+4 | 21.35 MB | 20 May 2020 - 13:24 |
| bbot | 12+4 | 34.72 KB | 18 May 2020 - 05:39 |
| istellabot | 840+190 | 7.56 MB | 12 May 2020 - 19:34 |
| LinkpadBot | 2,300 | 32.65 MB | 12 May 2020 - 15:11 |
| Feedfetcher-Google | 1 | 13.52 KB | 08 May 2020 - 10:16 |
| linkchecker | 2 | 0 | 05 May 2020 - 20:54 |
| msnbot | 4,442+249 | 65.79 MB | 30 Apr 2020 - 18:44 |
| Links ( | 2 | 69.03 KB | 24 Apr 2020 - 19:48 |
| grabber | 1 | 0 | 23 Apr 2020 - 06:55 |
| phantom | 1 | 3.03 KB | 23 Apr 2020 - 03:28 |
| libwww-perl | 1 | 0 | 21 Apr 2020 - 02:23 |
| microsoft-webdav-miniredir | 1 | 0 | 11 Apr 2020 - 13:25 |
| spyonweb | 2+2 | 4.37 KB | 01 Apr 2020 - 15:44 |
| LWP::Simple | 3 | 18.18 KB | 31 Mar 2020 - 04:08 |
| qwantify | 807+24 | 20.07 MB | 30 Mar 2020 - 21:33 |
| Pcore | 6 | 30.64 KB | 21 Mar 2020 - 00:03 |
| foo | 2 | 12.90 KB | 01 Mar 2020 - 01:25 |
| OutclicksBot | 1 | 27.37 KB | 29 Feb 2020 - 23:28 |
| Google Page Speed | 23 | 1.19 MB | 27 Feb 2020 - 05:59 |
| Curl/PHP | 1 | 2.08 KB | 27 Feb 2020 - 05:59 |
| Mappy Crawler | 3+1 | 12.41 KB | 07 Feb 2020 - 22:41 |
| Ruby script | 1 | 3.53 KB | 12 Jan 2020 - 00:01 |
| Jooblebot | 2 | 7.75 KB | 10 Jan 2020 - 12:03 |
| Validator.nu | 1 | 2.08 KB | 05 Jan 2020 - 02:12 |
| custo | 1 | 2.19 KB | 04 Jan 2020 - 12:48 |
| Prlog | 1+1 | 6.18 KB | 02 Jan 2020 - 10:35 |
|