| 217 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot identified by bot\* | 915,887+1568 | 63.31 GB | 29 Dec 2019 - 12:04 |
| bingbot | 214,678+2106 | 6.41 GB | 31 Dec 2019 - 23:58 |
| The Knowledge AI | 106,653+1244 | 4.03 GB | 31 Dec 2019 - 18:01 |
| SemrushBot | 78,547+20119 | 1.58 GB | 31 Dec 2019 - 23:47 |
| AhrefsBot | 58,362+886 | 10.46 GB | 31 Dec 2019 - 21:39 |
| BLEXBot | 58,097+766 | 771.70 MB | 07 Dec 2019 - 21:22 |
| Googlebot | 51,404+763 | 1.29 GB | 31 Dec 2019 - 23:49 |
| adscanner | 24,701+2777 | 606.95 MB | 15 Dec 2019 - 18:20 |
| Googlebot-Image | 25,336 | 241.52 MB | 31 Dec 2019 - 17:00 |
| YandexBot | 20,638+4551 | 2.53 GB | 31 Dec 2019 - 23:47 |
| SeznamBot | 19,908+4140 | 170.82 MB | 31 Dec 2019 - 23:32 |
| MJ12bot | 19,049+3371 | 382.19 MB | 31 Dec 2019 - 23:29 |
| DotBot | 11,116+9307 | 498.54 MB | 31 Dec 2019 - 23:30 |
| MSIE 6 - ( Rogue Robot ) | 15,586 | 260.64 MB | 31 Dec 2019 - 21:38 |
| link | 11,608+2195 | 264.90 MB | 31 Dec 2019 - 22:30 |
| Applebot | 8,579+1593 | 178.17 MB | 31 Dec 2019 - 23:29 |
| crawl | 9,852+290 | 200.63 MB | 30 Dec 2019 - 00:12 |
| Wget | 8,576+1 | 205.34 MB | 22 Dec 2019 - 15:44 |
| daum | 7,389+332 | 325.49 MB | 31 Dec 2019 - 23:42 |
| empty user agent string | 7,590+91 | 524.40 MB | 31 Dec 2019 - 08:10 |
| Mail.RU Bot | 4,621+2976 | 135.66 MB | 31 Dec 2019 - 22:49 |
| BingPreview | 7,215 | 284.92 MB | 31 Dec 2019 - 23:21 |
| facebookexternalhit | 6,980+2 | 189.90 MB | 31 Dec 2019 - 21:37 |
| Apache-HttpClient | 6,942+9 | 47.57 MB | 31 Dec 2019 - 13:32 |
| Baiduspider | 5,281+598 | 1.36 GB | 31 Dec 2019 - 19:26 |
| Sogou web spider | 2,164+3644 | 29.08 MB | 31 Dec 2019 - 22:01 |
| YandexImages | 5,307 | 78.63 MB | 31 Dec 2019 - 20:08 |
| Go-http-client | 4,753+46 | 191.26 MB | 31 Dec 2019 - 21:56 |
| MegaIndex.ru | 4,755+5 | 74.25 MB | 31 Dec 2019 - 16:03 |
| Firefox version 10 and lower - various robots | 4,510+238 | 165.55 MB | 31 Dec 2019 - 20:39 |
| Pinterestbot | 4,252+195 | 86.54 MB | 31 Dec 2019 - 20:30 |
| Java ( catchall ) | 4,343+1 | 119.05 MB | 28 Dec 2019 - 16:55 |
| istellabot | 3,244+544 | 55.33 MB | 06 Aug 2019 - 22:41 |
| DuckDuckBot-Https | 3,608+22 | 34.65 MB | 01 Dec 2019 - 08:07 |
| qwantify | 2,908+289 | 161.50 MB | 23 Dec 2019 - 02:17 |
| Barkrowler | 2,946+66 | 78.61 MB | 03 Jul 2019 - 02:19 |
| ia_archiver | 2,584+371 | 49.09 MB | 30 Dec 2019 - 08:26 |
| YandexMobileBot | 2,843 | 36.51 MB | 31 Dec 2019 - 16:50 |
| spider | 2,664+11 | 39.04 MB | 10 Dec 2019 - 14:31 |
| DomainCrawler | 2,571+3 | 35.54 MB | 15 May 2019 - 19:58 |
| yahoocachesystem | 2,349 | 83.49 MB | 31 Dec 2019 - 10:25 |
| archive.org_bot | 2,285+45 | 47.88 MB | 15 Nov 2019 - 09:59 |
| msnbot | 2,169+122 | 47.16 MB | 31 Dec 2019 - 23:57 |
| GarlikCrawler | 2,183+16 | 78.26 MB | 27 Dec 2019 - 13:10 |
| MSIE 5 - ( Rogue Robot ) | 2,157 | 20.75 MB | 31 Dec 2019 - 17:56 |
| BDCbot | 2,093+1 | 14.62 MB | 19 Mar 2019 - 12:46 |
| netEstate NE Crawler | 1,738+47 | 31.98 MB | 18 May 2019 - 15:51 |
| CCBot | 1,643+117 | 24.03 MB | 13 Dec 2019 - 17:06 |
| Baiduspider ( catchall ) | 1,612 | 54.78 MB | 31 Dec 2019 - 19:26 |
| Exabot | 1,349+185 | 21.79 MB | 12 Dec 2019 - 21:57 |
| coccoc | 793+669 | 12.45 MB | 31 Dec 2019 - 11:00 |
| Unknown robot (identified by hit on robots.txt) | 0+1168 | 144.41 KB | 31 Dec 2019 - 22:30 |
| Linguee Bot | 1,141+1 | 15.67 MB | 05 Jul 2019 - 04:48 |
| core | 1,076+5 | 35.02 MB | 29 Dec 2019 - 16:20 |
| 360Spider | 978+101 | 17.16 MB | 30 Dec 2019 - 22:50 |
| linkdexbot | 941+40 | 59.26 MB | 23 Dec 2019 - 11:18 |
| LinkpadBot | 959 | 22.93 MB | 17 Jul 2019 - 11:17 |
| favicon | 951 | 7.79 MB | 31 Dec 2019 - 19:17 |
| DuckDuckGo-Favicons-Bot | 880 | 5.15 MB | 31 Dec 2019 - 07:49 |
| checker | 861+1 | 11.96 MB | 31 Dec 2019 - 20:00 |
| python | 844+12 | 15.31 MB | 31 Dec 2019 - 08:10 |
| IndeedBot | 838+1 | 18.01 MB | 18 Dec 2019 - 19:48 |
| Cliqzbot | 452+368 | 10.75 MB | 09 Dec 2019 - 08:42 |
| yeti | 677+105 | 26.18 MB | 27 Dec 2019 - 03:06 |
| mozilla/4.0 (compatible;) - ( Rogue Robot ) | 765 | 9.37 MB | 24 Nov 2019 - 02:57 |
| Dalvik | 725 | 43.34 MB | 31 Dec 2019 - 22:33 |
| TurnitinBot | 696+18 | 9.55 MB | 03 Dec 2019 - 00:05 |
| ltx71 | 509+198 | 59.84 MB | 21 Dec 2019 - 10:20 |
| YisouSpider | 603+61 | 8.87 MB | 28 Dec 2019 - 12:07 |
| CFNetwork | 615 | 44.02 MB | 30 Dec 2019 - 14:24 |
| MojeekBot | 323+283 | 4.86 MB | 31 Dec 2019 - 15:13 |
| Bytespider | 584+7 | 12.38 MB | 30 Dec 2019 - 16:50 |
| Python-urllib | 561+16 | 30.53 MB | 31 Dec 2019 - 09:51 |
| smtbot | 453+7 | 9.35 MB | 10 Nov 2019 - 20:56 |
| AlphaBot | 459 | 8.40 MB | 18 Nov 2019 - 07:51 |
| robot | 288+161 | 11.16 MB | 23 Dec 2019 - 11:55 |
| Google Web Preview | 388 | 9.66 MB | 12 Dec 2019 - 14:53 |
| seokicks.de | 332+42 | 4.82 MB | 03 Dec 2019 - 13:56 |
| dataprovider.com | 351+20 | 12.32 MB | 07 Dec 2019 - 03:19 |
| fetcher | 346 | 7.75 MB | 26 Dec 2019 - 18:29 |
| Wotbox | 339+2 | 6.03 MB | 23 Jun 2019 - 19:54 |
| wordpress | 332 | 4.57 MB | 23 Dec 2019 - 11:14 |
| psbot | 287+17 | 3.28 MB | 29 Nov 2019 - 15:54 |
| Konqueror | 301 | 6.85 MB | 12 Dec 2019 - 12:16 |
| Deepnet Explorer | 295 | 2.60 MB | 31 Dec 2019 - 14:44 |
| Curl | 279 | 10.25 MB | 26 Dec 2019 - 20:36 |
| DomainStatsBot | 253+11 | 3.49 MB | 16 Dec 2019 - 13:13 |
| MSIE 2 - ( Rogue Robot ) | 256 | 2.06 MB | 31 Dec 2019 - 03:05 |
| Mozilla Beta (Windows) - ( Rogue Robot ) | 235 | 1.80 MB | 31 Dec 2019 - 03:01 |
| Yahoo! Slurp | 191+27 | 5.72 MB | 31 Dec 2019 - 12:22 |
| mozilla/5.0 - ( Rogue Robot ) | 203 | 7.92 MB | 25 Dec 2019 - 15:56 |
| crawler4j | 191+1 | 3.22 MB | 28 Sep 2019 - 15:43 |
| MSIECrawler | 182 | 1.60 MB | 31 Dec 2019 - 03:00 |
| CheckMarkNetwork | 148+32 | 1.59 MB | 23 Sep 2019 - 21:52 |
| filterdb.iss.net | 145+30 | 3.53 MB | 31 Jul 2019 - 22:50 |
| Windows 95 - ( Rogue Robot ) | 155 | 1.31 MB | 31 Dec 2019 - 14:56 |
| Uptimebot | 122+14 | 50.25 KB | 26 Jun 2019 - 11:04 |
| twitterbot | 70+63 | 1.76 MB | 24 Dec 2019 - 12:50 |
| MSIE 3 - ( Rogue Robot ) | 132 | 1.02 MB | 31 Dec 2019 - 14:44 |
| MSIE 4 - ( Rogue Robot ) | 122+1 | 1.16 MB | 27 Dec 2019 - 04:54 |
| Babya Discoverer | 109 | 721.56 KB | 31 Dec 2019 - 14:50 |
| panscient | 80+29 | 1.49 MB | 15 Dec 2019 - 08:50 |
| PhantomJS | 106 | 3.59 MB | 20 Nov 2019 - 22:24 |
| facebook | 91 | 3.67 MB | 25 Dec 2019 - 14:59 |
| Screaming Frog SEO Spider | 48+40 | 2.05 MB | 13 Dec 2019 - 13:16 |
| scrapy | 76+8 | 2.08 MB | 05 Dec 2019 - 16:49 |
| GrapeshotCrawler | 42+38 | 587.63 KB | 20 Oct 2019 - 19:51 |
| Gluten Free Crawler | 78 | 2.05 MB | 29 Dec 2019 - 01:16 |
| Nimbostratus-Bot | 77 | 466.81 KB | 30 Dec 2019 - 15:46 |
| TweetmemeBot | 75 | 1.91 MB | 31 Dec 2019 - 12:20 |
| Google Page Speed | 75 | 3.59 MB | 28 May 2019 - 05:45 |
| DuckDuckBot | 64 | 2.06 MB | 15 Oct 2019 - 23:13 |
| SurdotlyBot | 46+16 | 280.84 KB | 05 Dec 2019 - 01:03 |
| YandexImageResizer | 59 | 2.54 MB | 27 Dec 2019 - 12:36 |
| CUBOT | 58 | 1.89 MB | 28 Nov 2019 - 14:25 |
| BingLocalSearch | 50+5 | 725.29 KB | 13 Mar 2019 - 05:20 |
| proximic | 12+39 | 285.04 KB | 29 Dec 2019 - 10:08 |
| SafeDNSBot | 26+24 | 233.32 KB | 21 Oct 2019 - 17:08 |
| y!j | 45+1 | 1.06 MB | 20 Aug 2019 - 11:07 |
| trendiction | 33+11 | 655.33 KB | 02 Nov 2019 - 11:47 |
| Lightspeed | 40+3 | 328.67 KB | 03 Dec 2019 - 09:14 |
| [^a]fish | 42 | 2.31 MB | 22 Apr 2019 - 15:19 |
| nutch ( catchall ) | 31+10 | 771.68 KB | 28 Nov 2019 - 07:19 |
| tracemyfile | 31+9 | 753.90 KB | 29 Dec 2019 - 04:41 |
| Microsoft Office Protocol Discovery | 40 | 0 | 18 Dec 2019 - 12:11 |
| 2345Explorer | 39 | 3.55 MB | 22 Dec 2019 - 08:04 |
| Velen | 38 | 1.22 MB | 10 Dec 2019 - 19:51 |
| fastcrawler | 38 | 1.09 MB | 21 Dec 2019 - 01:17 |
| vebidoobot | 36 | 218.26 KB | 13 Dec 2019 - 22:45 |
| bl.uk_lddc_bot | 18+18 | 611.21 KB | 20 Dec 2019 - 13:39 |
| jbot | 36 | 569.10 KB | 20 Dec 2019 - 14:04 |
| ips-agent | 28+7 | 224.60 KB | 04 Nov 2019 - 07:24 |
| internetarchive | 34 | 0 | 31 Dec 2019 - 12:49 |
| Nautic Expo using Firefox/1.5 | 30 | 706.42 KB | 11 Nov 2019 - 09:45 |
| Mediapartners-Google | 30 | 1.06 MB | 01 Jun 2019 - 13:20 |
| netcraft | 26 | 72.75 KB | 30 Dec 2019 - 09:44 |
| LinkCheck | 19+7 | 1.31 MB | 25 Nov 2019 - 09:15 |
| Mozilla ( Rogue Robot ) | 26 | 24.73 KB | 10 Dec 2019 - 05:44 |
| A PHP script | 25 | 830.41 KB | 19 Nov 2019 - 16:10 |
| Yandex ( catchall ) | 24 | 782.46 KB | 07 Dec 2019 - 18:19 |
| KomodiaBot | 24 | 337.99 KB | 07 Nov 2019 - 16:58 |
| siteimprove | 22 | 133.41 KB | 15 Aug 2019 - 23:33 |
| motor | 22 | 839.13 KB | 15 Dec 2019 - 07:36 |
| nbot | 22 | 0 | 25 Dec 2019 - 23:07 |
| bnf.fr_bot | 11+10 | 270.69 KB | 03 Dec 2019 - 16:38 |
| foo | 20 | 126.31 KB | 27 Aug 2019 - 06:49 |
| Discordbot | 20 | 1.34 MB | 31 Dec 2019 - 22:35 |
| seek | 14+5 | 226.41 KB | 22 May 2019 - 17:50 |
| Dispatch | 19 | 455.40 KB | 06 Jun 2019 - 06:10 |
| Windows 99 - ( Rogue Robot ) | 16+2 | 218.10 KB | 03 Dec 2019 - 00:42 |
| TelegramBot | 15 | 512.86 KB | 12 Dec 2019 - 02:24 |
| Prlog | 7+7 | 43.30 KB | 05 Dec 2019 - 10:02 |
| webcollage | 14 | 636.25 KB | 30 Dec 2019 - 20:37 |
| linkchecker | 12+1 | 835.53 KB | 24 Sep 2019 - 14:04 |
| MixrankBot | 11 | 105.89 KB | 15 Dec 2019 - 09:13 |
| OutclicksBot | 11 | 106.37 KB | 31 Oct 2019 - 07:51 |
| zend_http_client | 11 | 238.96 KB | 14 Nov 2019 - 23:24 |
| custo | 10 | 60.64 KB | 10 Feb 2019 - 19:27 |
| libwww-perl | 10 | 217.22 KB | 24 Dec 2019 - 07:10 |
| bidswitchbot | 0+10 | 1.24 KB | 10 May 2019 - 23:29 |
| ning | 10 | 154.69 KB | 02 Dec 2019 - 23:06 |
| HubSpot Webcrawler | 10 | 264.88 KB | 08 Mar 2019 - 12:44 |
| Xenu Link Sleuth | 10 | 6.06 KB | 19 Nov 2019 - 14:23 |
| ubermetrics-technologies.com | 6+3 | 107.33 KB | 28 Aug 2019 - 02:44 |
| drupal | 9 | 140.78 KB | 01 Apr 2019 - 19:53 |
| Who.is.Bot | 8 | 48.52 KB | 17 Jul 2019 - 00:25 |
| CMS Crawler | 8 | 48.50 KB | 13 Nov 2019 - 11:02 |
| ExtLinksBot | 2+5 | 14.75 KB | 09 Mar 2019 - 14:24 |
| Unknown robot identified by \*bot | 5+2 | 148.65 KB | 11 Mar 2019 - 06:04 |
| ICC-Crawler | 3+4 | 43.40 KB | 26 Jun 2019 - 21:14 |
| Gowikibot | 2+4 | 12.62 KB | 13 Dec 2019 - 12:24 |
| Googlebot-Video | 6 | 2.51 MB | 09 Dec 2019 - 23:30 |
| SemrushBot-SI | 6 | 269.65 KB | 05 Dec 2019 - 03:29 |
| yoozBot | 3+3 | 230.61 KB | 05 Jan 2019 - 07:57 |
| LWP::Simple | 6 | 36.38 KB | 11 Sep 2019 - 08:42 |
| Mediatoolkitbot | 2+3 | 20.50 KB | 21 Jan 2019 - 21:07 |
| Yahoo Link Preview | 5 | 206.73 KB | 28 Aug 2019 - 19:37 |
| discover | 2+2 | 12.37 KB | 11 Dec 2019 - 17:00 |
| perl | 4 | 136.53 KB | 14 Jun 2019 - 09:43 |
| linkbot | 4 | 42.94 KB | 08 Nov 2019 - 13:37 |
| spyonweb | 2+2 | 12.38 KB | 09 May 2019 - 01:59 |
| vuhuvBot | 2+2 | 12.25 KB | 21 May 2019 - 09:54 |
| titan | 4 | 110.26 KB | 14 Nov 2019 - 17:02 |
| Spiderbot | 2+1 | 44.61 KB | 03 May 2019 - 01:56 |
| PiplBot | 3 | 85.24 KB | 27 Mar 2019 - 19:17 |
| gocrawl | 0+3 | 381 Bytes | 29 Aug 2019 - 07:04 |
| Links ( | 3 | 5.44 MB | 21 Mar 2019 - 00:19 |
| microsoft-webdav-miniredir | 3 | 0 | 16 Nov 2019 - 16:44 |
| riddler | 2+1 | 135.77 KB | 07 Jan 2019 - 22:44 |
| Streamline3Bot | 3 | 18.19 KB | 25 Aug 2019 - 05:18 |
| Slackbot-LinkExpanding | 2 | 30.32 KB | 17 Dec 2019 - 11:49 |
| bbot | 2 | 20.94 KB | 26 Nov 2019 - 09:56 |
| ODP link checker | 2 | 10.90 KB | 21 Dec 2019 - 14:26 |
| heritrix | 1+1 | 15.31 KB | 11 Oct 2019 - 07:42 |
| SiteExplorer | 0+2 | 254 Bytes | 17 May 2019 - 03:54 |
| laserlikebot | 1+1 | 94.47 KB | 28 Aug 2019 - 12:40 |
| WbSrch/ | 2 | 12.13 KB | 22 May 2019 - 22:58 |
| yak-linkfluence | 0+2 | 254 Bytes | 25 May 2019 - 09:04 |
| semanticbot | 1+1 | 60.13 KB | 18 May 2019 - 10:43 |
| ssearch_bot | 1+1 | 34.94 KB | 05 Mar 2019 - 18:10 |
| seodiver | 1+1 | 13.03 KB | 08 Mar 2019 - 17:11 |
| ng/1. | 2 | 30.35 KB | 14 Jun 2019 - 10:29 |
| yie8 | 2 | 42.55 KB | 03 Oct 2019 - 16:20 |
| Jooblebot | 1 | 6.06 KB | 26 Jun 2019 - 17:01 |
| AdsBot-Google | 1 | 26.57 KB | 15 Jun 2019 - 16:22 |
| phantom | 1 | 1.10 KB | 16 Jun 2019 - 00:53 |
| synthesio | 1 | 15.42 KB | 10 May 2019 - 20:48 |
| mozilla/4.0 - ( Rogue Robot ) | 1 | 39.00 KB | 27 Dec 2019 - 01:48 |
| scanner | 1 | 6.06 KB | 08 Nov 2019 - 23:53 |
| daumoa | 1 | 3.29 KB | 13 Apr 2019 - 04:49 |
| feed | 1 | 8.56 KB | 30 May 2019 - 13:09 |
| httrack | 1 | 14.24 KB | 20 Sep 2019 - 10:34 |
| legs | 1 | 6.06 KB | 23 May 2019 - 11:08 |
| Feedfetcher-Google | 1 | 6.06 KB | 17 Aug 2019 - 17:03 |
| mozilla/5.0 (en-us) - ( Rogue Robot ) | 1 | 26.77 KB | 27 Apr 2019 - 03:33 |
| tweetedtimes | 1 | 60.01 KB | 18 May 2019 - 15:18 |
| msie8 - ( Rogue Robot ) | 1 | 6.06 KB | 24 Mar 2019 - 23:38 |
|