| 247 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot-Image | 61,428 | 396.19 MB | 31 Dec 2018 - 23:57 |
| bingbot | 394,244+1910 | 10.91 GB | 31 Dec 2018 - 23:57 |
| bidswitchbot | 0+20 | 2.48 KB | 31 Dec 2018 - 23:57 |
| siteimprove | 55 | 328.20 KB | 31 Dec 2018 - 23:56 |
| empty user agent string | 18,201+102 | 1.58 GB | 31 Dec 2018 - 23:55 |
| AhrefsBot | 51,513+745 | 9.79 GB | 31 Dec 2018 - 23:53 |
| Googlebot | 60,046+705 | 2.22 GB | 31 Dec 2018 - 23:53 |
| The Knowledge AI | 81,712+1170 | 1.84 GB | 31 Dec 2018 - 23:51 |
| DotBot | 14,225+9031 | 504.87 MB | 31 Dec 2018 - 23:50 |
| YandexBot | 20,325+4935 | 1.21 GB | 31 Dec 2018 - 23:49 |
| SemrushBot | 55,205+7100 | 1.24 GB | 31 Dec 2018 - 23:39 |
| Baiduspider | 14,052+122 | 963.98 MB | 31 Dec 2018 - 23:33 |
| Firefox version 10 and lower - various robots | 6,954+402 | 221.08 MB | 31 Dec 2018 - 23:10 |
| Mail.RU Bot | 6,916+3508 | 173.38 MB | 31 Dec 2018 - 22:59 |
| SeznamBot | 38,436+4118 | 357.74 MB | 31 Dec 2018 - 22:43 |
| MJ12bot | 20,402+3697 | 456.16 MB | 31 Dec 2018 - 21:35 |
| Unknown robot identified by bot\* | 186,738+640 | 5.08 GB | 31 Dec 2018 - 21:20 |
| YandexMobileBot | 2,751 | 34.77 MB | 31 Dec 2018 - 21:15 |
| Exabot | 994+138 | 13.14 MB | 31 Dec 2018 - 21:03 |
| facebookexternalhit | 8,677+16 | 294.81 MB | 31 Dec 2018 - 21:01 |
| 360Spider | 592+54 | 8.36 MB | 31 Dec 2018 - 20:40 |
| archive.org_bot | 351+172 | 6.30 MB | 31 Dec 2018 - 20:33 |
| yahoocachesystem | 3,668 | 161.48 MB | 31 Dec 2018 - 20:21 |
| Baiduspider ( catchall ) | 2,376 | 58.19 MB | 31 Dec 2018 - 20:05 |
| BingPreview | 42,155 | 1.01 GB | 31 Dec 2018 - 20:02 |
| Yahoo! Slurp | 2,695+201 | 48.67 MB | 31 Dec 2018 - 19:49 |
| coccoc | 467+432 | 10.23 MB | 31 Dec 2018 - 18:36 |
| Applebot | 1,653+997 | 31.05 MB | 31 Dec 2018 - 18:32 |
| MSIE 6 - ( Rogue Robot ) | 15,634+14 | 255.20 MB | 31 Dec 2018 - 18:05 |
| favicon | 1,009 | 9.77 MB | 31 Dec 2018 - 17:56 |
| Unknown robot (identified by hit on robots.txt) | 0+1037 | 128.36 KB | 31 Dec 2018 - 17:34 |
| YisouSpider | 135+34 | 1.53 MB | 31 Dec 2018 - 17:06 |
| Dalvik | 562 | 20.51 MB | 31 Dec 2018 - 17:06 |
| YandexImages | 15,446 | 210.76 MB | 31 Dec 2018 - 16:53 |
| Sogou web spider | 474+703 | 6.99 MB | 31 Dec 2018 - 16:40 |
| python | 737+65 | 25.31 MB | 31 Dec 2018 - 16:22 |
| Pinterestbot | 3,595+112 | 51.63 MB | 31 Dec 2018 - 15:04 |
| tracemyfile | 553+19 | 65.32 MB | 31 Dec 2018 - 12:30 |
| DuckDuckGo-Favicons-Bot | 227 | 1.32 MB | 31 Dec 2018 - 12:23 |
| crawl | 3,719+433 | 88.68 MB | 31 Dec 2018 - 12:08 |
| robot | 257+20 | 36.46 MB | 31 Dec 2018 - 11:54 |
| netcraft | 35 | 185.78 KB | 31 Dec 2018 - 11:05 |
| Gluten Free Crawler | 390 | 12.71 MB | 31 Dec 2018 - 09:51 |
| gocrawl | 0+30 | 3.72 KB | 31 Dec 2018 - 06:06 |
| Go-http-client | 2,631+35 | 61.83 MB | 31 Dec 2018 - 05:38 |
| Apache-HttpClient | 2,617+6 | 28.90 MB | 31 Dec 2018 - 04:58 |
| Google Web Preview | 13,237 | 253.10 MB | 31 Dec 2018 - 03:03 |
| Python-urllib | 560+18 | 30.07 MB | 31 Dec 2018 - 02:22 |
| MSIE 3 - ( Rogue Robot ) | 165 | 1.16 MB | 31 Dec 2018 - 02:13 |
| MSIE 5 - ( Rogue Robot ) | 2,374 | 21.82 MB | 31 Dec 2018 - 02:11 |
| Windows 95 - ( Rogue Robot ) | 182 | 1.09 MB | 31 Dec 2018 - 02:11 |
| link | 588 | 23.83 MB | 31 Dec 2018 - 02:11 |
| MSIECrawler | 135 | 800.93 KB | 31 Dec 2018 - 02:08 |
| ia_archiver | 1,309+404 | 32.05 MB | 31 Dec 2018 - 01:34 |
| istellabot | 8,218+1045 | 118.66 MB | 30 Dec 2018 - 23:06 |
| linkdexbot | 4,013+65 | 215.68 MB | 30 Dec 2018 - 19:06 |
| drupal | 26 | 150.38 KB | 30 Dec 2018 - 13:50 |
| seek | 19+8 | 279.69 KB | 30 Dec 2018 - 11:27 |
| CFNetwork | 886 | 40.65 MB | 30 Dec 2018 - 10:07 |
| BLEXBot | 42,615+970 | 598.85 MB | 30 Dec 2018 - 08:08 |
| Wget | 492+1 | 18.69 MB | 30 Dec 2018 - 04:56 |
| WbSrch/ | 1 | 6.06 KB | 30 Dec 2018 - 04:55 |
| DomainCrawler | 8,528+10 | 116.95 MB | 30 Dec 2018 - 04:37 |
| GrapeshotCrawler | 104+62 | 1.58 MB | 30 Dec 2018 - 04:25 |
| proximic | 318+58 | 5.90 MB | 30 Dec 2018 - 03:01 |
| Curl | 613 | 12.22 MB | 30 Dec 2018 - 00:25 |
| 2345Explorer | 44 | 4.06 MB | 29 Dec 2018 - 21:25 |
| Uptimebot | 55+15 | 19.83 KB | 29 Dec 2018 - 16:03 |
| mozilla/5.0 - ( Rogue Robot ) | 990 | 49.25 MB | 29 Dec 2018 - 16:01 |
| Cliqzbot | 545+462 | 12.07 MB | 29 Dec 2018 - 15:11 |
| Yahoo Link Preview | 4 | 86.57 KB | 29 Dec 2018 - 13:00 |
| A PHP script | 30 | 1.03 MB | 29 Dec 2018 - 11:20 |
| MSIE 2 - ( Rogue Robot ) | 320 | 1.98 MB | 29 Dec 2018 - 01:52 |
| MSIE 4 - ( Rogue Robot ) | 142 | 941.03 KB | 29 Dec 2018 - 01:43 |
| twitterbot | 66+66 | 1.09 MB | 28 Dec 2018 - 19:36 |
| seokicks.de | 2,288+63 | 53.09 MB | 28 Dec 2018 - 16:25 |
| mozilla/4.0 (compatible;) - ( Rogue Robot ) | 1,751 | 24.96 MB | 28 Dec 2018 - 12:57 |
| W3C-checklink | 387+1 | 1.87 MB | 28 Dec 2018 - 10:37 |
| daum | 3,392+355 | 103.48 MB | 28 Dec 2018 - 10:30 |
| qwantify | 7,210+328 | 173.09 MB | 28 Dec 2018 - 07:13 |
| MojeekBot | 119+126 | 1.91 MB | 28 Dec 2018 - 03:03 |
| Java ( catchall ) | 21,037+251 | 773.34 MB | 27 Dec 2018 - 22:38 |
| yeti | 1,052+92 | 41.57 MB | 27 Dec 2018 - 20:41 |
| Mozilla Beta (Windows) - ( Rogue Robot ) | 314 | 1.95 MB | 27 Dec 2018 - 15:33 |
| Prlog | 6+6 | 36.58 KB | 27 Dec 2018 - 11:47 |
| Discordbot | 37 | 33.70 MB | 27 Dec 2018 - 09:58 |
| Pcore | 980 | 24.13 MB | 27 Dec 2018 - 06:19 |
| core | 159 | 26.21 MB | 27 Dec 2018 - 04:47 |
| wordpress | 447 | 15.82 MB | 27 Dec 2018 - 02:56 |
| nutch ( catchall ) | 16+16 | 223.26 KB | 26 Dec 2018 - 19:02 |
| ExtLinksBot | 56+27 | 946.72 KB | 26 Dec 2018 - 15:34 |
| LWP::Simple | 8 | 47.86 KB | 26 Dec 2018 - 11:19 |
| spider | 126+2 | 2.88 MB | 26 Dec 2018 - 01:57 |
| TelegramBot | 5 | 87.40 KB | 26 Dec 2018 - 01:27 |
| Nimbostratus-Bot | 37 | 221.54 KB | 25 Dec 2018 - 21:27 |
| Babya Discoverer | 137 | 927.97 KB | 25 Dec 2018 - 01:38 |
| Deepnet Explorer | 309 | 2.02 MB | 25 Dec 2018 - 01:31 |
| filterdb.iss.net | 815+44 | 5.85 MB | 24 Dec 2018 - 23:28 |
| fetcher | 50 | 1.09 MB | 24 Dec 2018 - 15:33 |
| Google Page Speed | 375 | 20.63 MB | 24 Dec 2018 - 11:00 |
| feed | 9 | 900.90 KB | 24 Dec 2018 - 09:15 |
| Curl/PHP | 1 | 6.06 KB | 24 Dec 2018 - 07:54 |
| Windows 99 - ( Rogue Robot ) | 21 | 194.67 KB | 24 Dec 2018 - 03:14 |
| Dispatch | 23 | 1.12 MB | 23 Dec 2018 - 00:38 |
| Mediatoolkitbot | 1+1 | 6.05 KB | 22 Dec 2018 - 13:08 |
| TweetmemeBot | 71 | 2.54 MB | 22 Dec 2018 - 07:48 |
| ODP link checker | 8 | 10.79 KB | 22 Dec 2018 - 07:36 |
| Linguee Bot | 1,782+2 | 27.59 MB | 22 Dec 2018 - 02:15 |
| foo | 29 | 180.17 KB | 21 Dec 2018 - 05:44 |
| PhantomJS | 426 | 15.15 MB | 21 Dec 2018 - 02:27 |
| Microsoft Office Protocol Discovery | 58 | 0 | 20 Dec 2018 - 13:10 |
| backlinktest.com | 22+4 | 159.31 KB | 20 Dec 2018 - 10:19 |
| webcollage | 8 | 194.07 KB | 20 Dec 2018 - 02:24 |
| scrapy | 1,286+13 | 9.18 MB | 19 Dec 2018 - 23:05 |
| Velen | 35 | 1.54 MB | 19 Dec 2018 - 20:15 |
| Konqueror | 346 | 5.49 MB | 19 Dec 2018 - 06:10 |
| CCBot | 3,827+149 | 53.42 MB | 19 Dec 2018 - 01:25 |
| Nautic Expo using Firefox/1.5 | 23 | 364.98 KB | 18 Dec 2018 - 08:44 |
| YandexImageResizer | 65 | 4.03 MB | 18 Dec 2018 - 01:15 |
| DuckDuckBot | 9 | 579.08 KB | 16 Dec 2018 - 19:19 |
| zend_http_client | 17 | 479.31 KB | 16 Dec 2018 - 09:56 |
| DuckDuckBot-Https | 629+7 | 11.79 MB | 16 Dec 2018 - 02:21 |
| Yandex ( catchall ) | 91 | 2.33 MB | 15 Dec 2018 - 15:26 |
| yoozBot | 31+26 | 767.61 KB | 14 Dec 2018 - 18:37 |
| checker | 139+6 | 1.88 MB | 14 Dec 2018 - 15:14 |
| y!j | 50+1 | 1.64 MB | 12 Dec 2018 - 23:32 |
| TurnitinBot | 14+14 | 292.76 KB | 12 Dec 2018 - 08:56 |
| AlphaBot | 225 | 6.57 MB | 12 Dec 2018 - 05:39 |
| netEstate NE Crawler | 2+2 | 12.27 KB | 11 Dec 2018 - 09:51 |
| Screaming Frog SEO Spider | 127+6 | 5.39 MB | 11 Dec 2018 - 05:16 |
| DomainStatsBot | 115+5 | 1.55 MB | 11 Dec 2018 - 04:30 |
| Xenu Link Sleuth | 7 | 11.91 KB | 10 Dec 2018 - 19:24 |
| Feedfetcher-Google | 62 | 1.38 MB | 10 Dec 2018 - 15:37 |
| ltx71 | 61+126 | 16.63 MB | 09 Dec 2018 - 19:32 |
| Gowikibot | 0+7 | 889 Bytes | 09 Dec 2018 - 03:43 |
| BingLocalSearch | 63+19 | 954.58 KB | 07 Dec 2018 - 13:17 |
| dataprovider.com | 246+18 | 7.53 MB | 07 Dec 2018 - 01:45 |
| GarlikCrawler | 3,091+52 | 101.55 MB | 05 Dec 2018 - 18:00 |
| SurdotlyBot | 29+7 | 173.67 KB | 05 Dec 2018 - 00:39 |
| ips-agent | 55+9 | 542.17 KB | 04 Dec 2018 - 07:20 |
| KomodiaBot | 5 | 29.99 KB | 02 Dec 2018 - 16:58 |
| smtbot | 936+9 | 17.99 MB | 02 Dec 2018 - 09:22 |
| LinkCheck | 55+1 | 297.31 KB | 01 Dec 2018 - 14:09 |
| Lightspeed | 49+3 | 378.33 KB | 28 Nov 2018 - 11:22 |
| webcopy | 6 | 5.17 MB | 28 Nov 2018 - 10:21 |
| internetarchive | 25 | 0 | 25 Nov 2018 - 00:50 |
| gigablastopensource | 14+11 | 298.76 KB | 23 Nov 2018 - 06:44 |
| vebidoobot | 21+3 | 125.43 KB | 21 Nov 2018 - 17:58 |
| CheckMarkNetwork | 24+5 | 278.09 KB | 21 Nov 2018 - 01:23 |
| SafeDNSBot | 41+33 | 610.95 KB | 20 Nov 2018 - 14:50 |
| CMS Crawler | 2 | 11.91 KB | 19 Nov 2018 - 19:28 |
| Mozilla ( Rogue Robot ) | 154 | 4.24 MB | 19 Nov 2018 - 10:51 |
| bnf.fr_bot | 1+1 | 52.32 KB | 18 Nov 2018 - 22:39 |
| aiHitBot | 53+3 | 571.44 KB | 18 Nov 2018 - 06:20 |
| libwww-perl | 1 | 5.96 KB | 14 Nov 2018 - 14:59 |
| Barkrowler | 4,736+80 | 109.10 MB | 08 Nov 2018 - 15:51 |
| yie8 | 22 | 369.09 KB | 07 Nov 2018 - 06:46 |
| CUBOT | 658 | 12.17 MB | 06 Nov 2018 - 11:35 |
| psbot-image | 2 | 60.81 KB | 05 Nov 2018 - 16:25 |
| psbot | 0+1 | 127 Bytes | 05 Nov 2018 - 16:24 |
| woobot | 4 | 23.82 KB | 04 Nov 2018 - 02:42 |
| OutclicksBot | 9 | 96.88 KB | 03 Nov 2018 - 09:50 |
| HubSpot Webcrawler | 11 | 433.56 KB | 31 Oct 2018 - 12:59 |
| nutch-1.4 | 3+3 | 18.24 KB | 29 Oct 2018 - 17:16 |
| SEOkicks-Robot | 210+24 | 4.05 MB | 28 Oct 2018 - 10:49 |
| linkbot | 4 | 50.15 KB | 25 Oct 2018 - 22:37 |
| ssearch_bot | 3+3 | 59.10 KB | 24 Oct 2018 - 14:36 |
| MegaIndex.ru | 3,487+4 | 64.37 MB | 21 Oct 2018 - 11:53 |
| ning | 7+1 | 93.59 KB | 19 Oct 2018 - 17:55 |
| wonderbot | 36 | 256.64 KB | 19 Oct 2018 - 05:39 |
| scoutjet | 12+12 | 79.65 KB | 17 Oct 2018 - 10:25 |
| pioneer | 3 | 154.39 KB | 16 Oct 2018 - 15:03 |
| httrack | 1 | 3.60 KB | 09 Oct 2018 - 13:16 |
| titan | 22 | 390.44 KB | 09 Oct 2018 - 01:45 |
| seodiver | 5+5 | 58.84 KB | 04 Oct 2018 - 15:21 |
| spyonweb | 4+4 | 24.32 KB | 03 Oct 2018 - 15:55 |
| Xaldon WebSpider | 1 | 51.08 KB | 28 Sep 2018 - 08:05 |
| phantom | 357 | 11.63 MB | 26 Sep 2018 - 14:38 |
| Baiduspider-image | 513 | 3.86 MB | 24 Sep 2018 - 15:09 |
| scanner | 4 | 23.82 KB | 23 Sep 2018 - 01:28 |
| bl.uk_lddc_bot | 1+1 | 21.20 KB | 16 Sep 2018 - 14:22 |
| spbot | 12,122+48 | 227.43 MB | 15 Sep 2018 - 16:10 |
| perl | 1 | 108.23 KB | 11 Sep 2018 - 16:36 |
| Mediapartners-Google | 13 | 209.63 KB | 09 Sep 2018 - 18:37 |
| SiteExplorer | 21+26 | 432.09 KB | 31 Aug 2018 - 18:07 |
| Googlebot-Video | 18 | 12.03 MB | 30 Aug 2018 - 20:19 |
| PiplBot | 12 | 335.10 KB | 26 Aug 2018 - 01:23 |
| Naaraa | 7+12 | 38.87 KB | 23 Aug 2018 - 13:42 |
| IndeedBot | 647+1 | 13.95 MB | 17 Aug 2018 - 14:46 |
| Meta_Bot | 3 | 17.87 KB | 17 Aug 2018 - 14:17 |
| feedburner | 10 | 0 | 15 Aug 2018 - 05:40 |
| facebook | 6 | 344.26 KB | 05 Aug 2018 - 09:10 |
| a6-indexer | 77+7 | 3.19 MB | 01 Aug 2018 - 17:48 |
| custo | 4 | 38.15 KB | 28 Jul 2018 - 15:51 |
| CRAZYWEBCRAWLER | 7 | 41.94 KB | 26 Jul 2018 - 19:06 |
| msie8 - ( Rogue Robot ) | 119 | 1.61 MB | 19 Jul 2018 - 04:15 |
| contxbot | 0+1 | 127 Bytes | 18 Jul 2018 - 22:36 |
| W3C_Validator | 3 | 11.91 KB | 18 Jul 2018 - 18:16 |
| ELinks | 4 | 28.00 KB | 09 Jul 2018 - 17:19 |
| 007ac9 Crawler | 1,760+3 | 31.82 MB | 08 Jul 2018 - 06:54 |
| MauiBot | 15,613+386 | 1.74 GB | 05 Jul 2018 - 02:09 |
| Findxbot | 7+28 | 101.31 KB | 28 Jun 2018 - 17:47 |
| rogerbot | 1 | 5.96 KB | 24 Jun 2018 - 08:05 |
| Plukkie | 3+3 | 18.24 KB | 20 Jun 2018 - 10:13 |
| Quick-Crawler | 1 | 5.96 KB | 05 Jun 2018 - 20:10 |
| Slackbot-LinkExpanding | 8 | 172.52 KB | 31 May 2018 - 05:19 |
| Mozilla/6.0 (compatible) - ( Rogue Robot ) | 9 | 168.85 KB | 30 May 2018 - 19:36 |
| sistrix | 1 | 30.79 KB | 24 May 2018 - 08:46 |
| microsoft-webdav-miniredir | 1 | 0 | 17 May 2018 - 11:17 |
| yacybot | 8+6 | 120.42 KB | 17 May 2018 - 00:14 |
| eright | 81+4 | 641.75 KB | 16 May 2018 - 23:46 |
| discover | 3 | 66.32 KB | 15 May 2018 - 09:18 |
| Unknown robot identified by \*bot | 4 | 58.52 KB | 14 May 2018 - 09:01 |
| daumoa | 4,455 | 16.85 MB | 10 May 2018 - 18:25 |
| James BOT | 261+15 | 13.21 MB | 04 May 2018 - 09:14 |
| bit.ly | 2+2 | 87.75 KB | 03 May 2018 - 03:22 |
| heritrix | 1+1 | 122.21 KB | 02 May 2018 - 18:21 |
| crawler4j | 1+3 | 6.33 KB | 29 Apr 2018 - 09:34 |
| msnbot | 1 | 0 | 26 Apr 2018 - 08:40 |
| trendiction | 5+6 | 305.16 KB | 22 Apr 2018 - 01:08 |
| bubing | 28,492+588 | 603.64 MB | 17 Apr 2018 - 15:12 |
| adscanner | 6+5 | 38.87 KB | 17 Apr 2018 - 09:22 |
| sitemap | 1 | 121.30 KB | 01 Apr 2018 - 22:41 |
| DnyzBot | 441 | 6.00 MB | 31 Mar 2018 - 18:21 |
| Links ( | 2 | 132.55 KB | 29 Mar 2018 - 15:26 |
| panscient | 22+2 | 472.92 KB | 27 Mar 2018 - 20:37 |
| vBSEO | 1 | 10.43 KB | 26 Mar 2018 - 22:37 |
| vBulletin via PHP | 2 | 28.10 KB | 23 Mar 2018 - 13:52 |
| DeuSu | 86+46 | 2.30 MB | 19 Mar 2018 - 05:00 |
| SurveyBot | 5+4 | 30.28 KB | 15 Mar 2018 - 11:05 |
| harvest | 8+6 | 272.39 KB | 13 Mar 2018 - 17:05 |
| ng/2. | 1 | 23.54 KB | 10 Mar 2018 - 06:03 |
| Wotbox | 331+2 | 5.84 MB | 09 Mar 2018 - 20:03 |
| Streamline3Bot | 1 | 5.96 KB | 06 Mar 2018 - 02:04 |
| Princetonbot | 2 | 64.78 KB | 05 Mar 2018 - 17:27 |
| Jooblebot | 10 | 66.97 KB | 04 Mar 2018 - 14:35 |
| ELinks ( | 1 | 35.65 KB | 20 Feb 2018 - 07:40 |
| ng/1. | 1 | 3.24 KB | 19 Feb 2018 - 20:52 |
| ICC-Crawler | 1+1 | 10.29 KB | 15 Feb 2018 - 23:18 |
| Contacts-Crawler | 4+1 | 155.90 KB | 13 Feb 2018 - 23:57 |
| genieo | 4+4 | 24.33 KB | 13 Feb 2018 - 02:54 |
| robi | 3 | 91.47 KB | 11 Feb 2018 - 22:02 |
| netseer | 1+1 | 6.08 KB | 07 Feb 2018 - 06:50 |
| motor | 2 | 50.03 KB | 03 Feb 2018 - 16:23 |
| seoscanners | 5+5 | 75.94 KB | 27 Jan 2018 - 12:38 |
| urllib | 5 | 149.17 KB | 11 Jan 2018 - 23:26 |
| Digincore | 1 | 5.96 KB | 09 Jan 2018 - 16:01 |
|