169 different robots | Hits | Bandwidth | Last visit |
YandexImages | 2,818 | 12.53 MB | 31 May 2016 - 23:58 |
bingbot | 27,679+215 | 718.97 MB | 31 May 2016 - 23:58 |
Googlebot | 4,092+125 | 69.28 MB | 31 May 2016 - 23:58 |
Googlebot-Image | 6,480 | 56.34 MB | 31 May 2016 - 23:57 |
Yahoo! Slurp | 6,801+143 | 1.64 GB | 31 May 2016 - 23:54 |
Unknown robot (identified by hit on robots.txt) | 0+226 | 28.03 KB | 31 May 2016 - 23:53 |
Firefox version 10 and lower - various robots | 761+71 | 17.82 MB | 31 May 2016 - 23:53 |
Googlebot-Mobile | 814 | 12.79 MB | 31 May 2016 - 23:52 |
qwantify | 361+41 | 10.11 MB | 31 May 2016 - 23:48 |
Baiduspider | 2,448+70 | 73.27 MB | 31 May 2016 - 23:46 |
YandexBot | 2,259+150 | 54.23 MB | 31 May 2016 - 23:45 |
AhrefsBot | 3,947+34 | 900.27 MB | 31 May 2016 - 23:45 |
python | 19 | 678.88 KB | 31 May 2016 - 23:38 |
DotBot | 989+346 | 10.53 MB | 31 May 2016 - 23:37 |
BingPreview | 1,144 | 22.53 MB | 31 May 2016 - 23:33 |
CCBot | 307+193 | 5.67 MB | 31 May 2016 - 23:29 |
crawl | 510+22 | 9.82 MB | 31 May 2016 - 22:58 |
linkdexbot | 517+6 | 29.10 MB | 31 May 2016 - 22:42 |
istellabot | 617+119 | 23.22 MB | 31 May 2016 - 22:41 |
Exabot | 245+35 | 3.24 MB | 31 May 2016 - 22:29 |
facebookexternalhit | 1,045 | 30.53 MB | 31 May 2016 - 22:22 |
yahoocachesystem | 382 | 11.93 MB | 31 May 2016 - 22:05 |
semanticbot | 6+1 | 12.31 KB | 31 May 2016 - 21:36 |
yeti | 13+4 | 168.53 KB | 31 May 2016 - 20:18 |
Gluten Free Crawler | 20 | 823.12 KB | 31 May 2016 - 19:17 |
SeznamBot | 679+243 | 9.00 MB | 31 May 2016 - 19:01 |
mozilla/5.0 - ( Rogue Robot ) | 45+13 | 1.16 MB | 31 May 2016 - 18:55 |
DeuSu | 9+12 | 312.14 KB | 31 May 2016 - 18:44 |
360Spider | 7+6 | 150.36 KB | 31 May 2016 - 18:26 |
spiderman | 17 | 101.67 KB | 31 May 2016 - 18:21 |
favicon | 99 | 1.34 MB | 31 May 2016 - 18:20 |
wordpress | 119 | 1.60 MB | 31 May 2016 - 18:13 |
Baiduspider-image | 45 | 2.74 MB | 31 May 2016 - 17:34 |
ia_archiver | 88+37 | 3.87 MB | 31 May 2016 - 17:10 |
Google Web Preview | 3,208 | 57.90 MB | 31 May 2016 - 16:26 |
empty user agent string | 687+8 | 13.54 MB | 31 May 2016 - 15:21 |
discover | 306 | 7.89 MB | 31 May 2016 - 14:50 |
MJ12bot | 3,971+249 | 48.50 MB | 31 May 2016 - 14:30 |
facebook | 4 | 8.54 KB | 31 May 2016 - 13:44 |
Java ( catchall ) | 173+6 | 4.83 MB | 31 May 2016 - 12:35 |
Mozilla Beta (Windows) - ( Rogue Robot ) | 108 | 719.58 KB | 31 May 2016 - 12:34 |
MSIE 6 - ( Rogue Robot ) | 4,938 | 73.99 MB | 31 May 2016 - 12:30 |
Python-urllib | 32+3 | 1.46 MB | 31 May 2016 - 12:29 |
msie8 - ( Rogue Robot ) | 1 | 5.98 KB | 31 May 2016 - 12:16 |
James BOT | 90+7 | 6.28 MB | 31 May 2016 - 11:44 |
YandexImageResizer | 11 | 1.44 MB | 31 May 2016 - 11:10 |
mozilla/4.0 (compatible;) - ( Rogue Robot ) | 1,960 | 23.13 MB | 31 May 2016 - 10:33 |
Unknown robot identified by bot\* | 56,040+27 | 8.51 GB | 31 May 2016 - 10:17 |
scrapy | 7 | 175.68 KB | 31 May 2016 - 08:40 |
PhantomJS | 14 | 642.89 KB | 31 May 2016 - 08:04 |
Deepnet Explorer | 117 | 754.98 KB | 31 May 2016 - 07:28 |
Babya Discoverer | 66 | 431.56 KB | 31 May 2016 - 07:28 |
MSIE 5 - ( Rogue Robot ) | 807 | 5.85 MB | 31 May 2016 - 07:27 |
MSIE 3 - ( Rogue Robot ) | 52 | 421.52 KB | 31 May 2016 - 07:25 |
MSIE 2 - ( Rogue Robot ) | 125 | 858.10 KB | 31 May 2016 - 07:17 |
yoozBot | 12+6 | 307.42 KB | 31 May 2016 - 05:03 |
msnbot-media | 175 | 581.67 MB | 31 May 2016 - 04:47 |
CFNetwork | 64 | 2.86 MB | 31 May 2016 - 02:48 |
archive.org_bot | 151+35 | 16.08 MB | 30 May 2016 - 23:54 |
PiplBot | 8 | 219.13 KB | 30 May 2016 - 19:14 |
Dalvik | 71 | 1.66 MB | 30 May 2016 - 18:37 |
CRAZYWEBCRAWLER | 1 | 5.98 KB | 30 May 2016 - 17:59 |
checker | 29 | 409.88 KB | 30 May 2016 - 15:22 |
SemrushBot | 1,001+12 | 65.10 MB | 30 May 2016 - 12:01 |
YandexMobileBot | 11 | 106.94 KB | 30 May 2016 - 11:53 |
Sogou web spider | 75+29 | 1.51 MB | 30 May 2016 - 10:33 |
dataprovider.com | 76+6 | 2.07 MB | 30 May 2016 - 04:12 |
Konqueror | 18 | 456.50 KB | 30 May 2016 - 04:10 |
Wget | 13 | 169.64 KB | 30 May 2016 - 01:32 |
YisouSpider | 7+1 | 19.68 KB | 29 May 2016 - 18:36 |
MegaIndex.ru | 872+1 | 16.09 MB | 29 May 2016 - 08:55 |
Spiderbot | 4+9 | 95.04 KB | 29 May 2016 - 08:52 |
MSIECrawler | 55 | 457.89 KB | 29 May 2016 - 08:16 |
MSIE 4 - ( Rogue Robot ) | 65 | 444.00 KB | 29 May 2016 - 07:41 |
yie8 | 1 | 26.36 KB | 29 May 2016 - 04:37 |
Applebot | 61+12 | 506.15 KB | 29 May 2016 - 00:36 |
twitterbot | 17+16 | 397.64 KB | 28 May 2016 - 20:01 |
scoutjet | 2+2 | 10.48 KB | 28 May 2016 - 18:47 |
ltx71 | 20+17 | 365.37 KB | 28 May 2016 - 18:02 |
DuckDuckGo-Favicons-Bot | 8 | 47.84 KB | 28 May 2016 - 15:13 |
filterdb.iss.net | 5+4 | 58.02 KB | 28 May 2016 - 12:49 |
core | 2 | 30.48 KB | 28 May 2016 - 12:17 |
linkbot | 8 | 865.82 KB | 28 May 2016 - 08:19 |
Curl | 13+1 | 59.93 KB | 28 May 2016 - 05:20 |
linkapediabot | 9+4 | 346.17 KB | 28 May 2016 - 02:52 |
Windows 95 - ( Rogue Robot ) | 42 | 251.18 KB | 28 May 2016 - 02:25 |
wallpaper | 2 | 39.92 KB | 27 May 2016 - 20:56 |
Feedfetcher-Google | 12 | 313.83 KB | 27 May 2016 - 14:04 |
ODP link checker | 2 | 0 | 27 May 2016 - 12:46 |
daumoa | 4 | 13.15 KB | 27 May 2016 - 09:01 |
BingLocalSearch | 8+4 | 62.07 KB | 26 May 2016 - 16:07 |
zend_http_client | 12 | 348.50 KB | 25 May 2016 - 21:54 |
coccoc | 65+16 | 1.52 MB | 25 May 2016 - 14:46 |
Xenu Link Sleuth | 8,225+1 | 1.73 GB | 25 May 2016 - 14:17 |
Apache-HttpClient | 2 | 16.13 KB | 25 May 2016 - 13:47 |
GrapeshotCrawler | 3+2 | 131.52 KB | 25 May 2016 - 10:05 |
netseer | 1+1 | 6.10 KB | 25 May 2016 - 09:08 |
XoviBot | 12 | 394.65 KB | 25 May 2016 - 08:31 |
MojeekBot | 3+3 | 71.48 KB | 25 May 2016 - 06:45 |
TweetmemeBot | 7 | 230.43 KB | 25 May 2016 - 05:42 |
Windows 99 - ( Rogue Robot ) | 142+1 | 2.97 MB | 25 May 2016 - 02:33 |
spbot | 2,857+12 | 51.99 MB | 25 May 2016 - 01:09 |
roboto | 2 | 8.82 KB | 25 May 2016 - 00:47 |
BLEXBot | 1,475+74 | 22.09 MB | 25 May 2016 - 00:06 |
Microsoft Office Protocol Discovery | 8 | 0 | 24 May 2016 - 22:45 |
SafeSearch microdata crawler | 4 | 89.81 KB | 24 May 2016 - 11:01 |
2345Explorer | 2 | 51.69 KB | 24 May 2016 - 06:03 |
Google Page Speed | 63 | 3.50 MB | 24 May 2016 - 03:47 |
SEOkicks-Robot | 24+6 | 227.31 KB | 23 May 2016 - 22:06 |
Screaming Frog SEO Spider | 6+1 | 148.84 KB | 23 May 2016 - 15:37 |
Dispatch | 3 | 434.32 KB | 22 May 2016 - 13:12 |
SurveyBot | 2+2 | 12.21 KB | 22 May 2016 - 13:01 |
Cliqzbot | 15+15 | 517.58 KB | 22 May 2016 - 09:45 |
InfluenceBot | 0+1 | 127 Bytes | 21 May 2016 - 17:59 |
Wotbox | 82+1 | 1.22 MB | 21 May 2016 - 09:15 |
Mechanize | 2 | 11.96 KB | 21 May 2016 - 02:58 |
ICC-Crawler | 18+20 | 313.60 KB | 21 May 2016 - 00:01 |
A PHP script | 4 | 57.86 KB | 20 May 2016 - 23:26 |
Googlebot-Video | 3 | 7.07 MB | 20 May 2016 - 20:32 |
Go-http-client | 39 | 714.80 KB | 20 May 2016 - 11:01 |
SiteExplorer | 11+5 | 242.31 KB | 20 May 2016 - 00:52 |
OrangeBot | 2+2 | 50.36 KB | 19 May 2016 - 18:29 |
Discordbot | 3 | 579.68 KB | 19 May 2016 - 17:53 |
RSSingBot | 2 | 18.17 KB | 19 May 2016 - 06:35 |
webcollage | 2 | 44.57 KB | 19 May 2016 - 03:27 |
titan | 3 | 40.06 KB | 18 May 2016 - 22:13 |
Plukkie | 1+1 | 6.10 KB | 18 May 2016 - 16:18 |
ZumBot | 42 | 2.33 MB | 18 May 2016 - 04:55 |
WbSrch/ | 1+1 | 6.10 KB | 18 May 2016 - 01:37 |
Mediapartners-Google | 2 | 24.06 KB | 17 May 2016 - 18:27 |
microsoft-webdav-miniredir | 1 | 0 | 17 May 2016 - 17:59 |
Mail.RU Bot | 431+91 | 23.95 MB | 17 May 2016 - 16:41 |
daum | 192+2 | 614.05 KB | 17 May 2016 - 13:47 |
nbot | 1 | 5.98 KB | 17 May 2016 - 05:17 |
Stratagems Kumo | 29+15 | 195.27 KB | 16 May 2016 - 21:01 |
Yahoo Link Preview | 2 | 33.35 KB | 16 May 2016 - 16:52 |
nutch ( catchall ) | 3+4 | 40.58 KB | 16 May 2016 - 10:54 |
LinkpadBot | 6 | 35.88 KB | 16 May 2016 - 09:54 |
Uptimebot | 26+6 | 12.71 KB | 16 May 2016 - 05:23 |
crawler4j | 0+1 | 127 Bytes | 16 May 2016 - 02:03 |
link | 8 | 144.54 KB | 14 May 2016 - 13:02 |
panscient | 70+6 | 1.13 MB | 14 May 2016 - 12:23 |
wonderbot | 23+1 | 333.74 KB | 14 May 2016 - 05:32 |
SafeDNSBot | 11+5 | 145.47 KB | 12 May 2016 - 15:29 |
imagecoccoc | 113+6 | 2.76 MB | 12 May 2016 - 06:43 |
robot | 25 | 63.72 KB | 11 May 2016 - 12:34 |
CMS Crawler | 1 | 5.98 KB | 10 May 2016 - 17:44 |
netcraft | 3 | 5.98 KB | 10 May 2016 - 12:21 |
GarlikCrawler | 2 | 216.46 KB | 10 May 2016 - 07:42 |
vebidoobot | 1 | 5.98 KB | 10 May 2016 - 04:17 |
patric | 7 | 101.73 KB | 10 May 2016 - 00:46 |
HubSpot Webcrawler | 1 | 0 | 10 May 2016 - 00:21 |
LWP::Simple | 2 | 11.96 KB | 09 May 2016 - 18:58 |
CUBOT | 1 | 24.45 KB | 08 May 2016 - 14:31 |
nutch-1.4 | 1+1 | 6.10 KB | 08 May 2016 - 08:19 |
mfibot | 1 | 5.98 KB | 07 May 2016 - 02:45 |
spider | 1 | 5.98 KB | 05 May 2016 - 22:19 |
msnbot | 1 | 5.98 KB | 05 May 2016 - 22:19 |
NRLCorpusBuilder/Nutch | 0+1 | 127 Bytes | 04 May 2016 - 21:12 |
WBSearchBot | 231+1 | 4.13 MB | 04 May 2016 - 09:38 |
ichiro | 25+3 | 545.30 KB | 04 May 2016 - 03:11 |
KomodiaBot | 1 | 5.98 KB | 03 May 2016 - 20:43 |
Slackbot-LinkExpanding | 1 | 2.55 KB | 03 May 2016 - 12:36 |
ning | 2 | 71.65 KB | 03 May 2016 - 12:11 |
perl | 1 | 14.47 KB | 02 May 2016 - 13:35 |
ips-agent | 11+1 | 104.36 KB | 02 May 2016 - 11:10 |
spyonweb | 1+1 | 6.10 KB | 02 May 2016 - 02:20 |
007ac9 Crawler | 904+1 | 28.23 MB | 01 May 2016 - 09:42 |
Who.is.Bot | 1 | 5.98 KB | 01 May 2016 - 02:16 |
|