150 different robots | Hits | Bandwidth | Last visit |
bingbot | 20,027+237 | 1.31 GB | 28 Feb 2017 - 23:44 |
YandexImages | 5,358 | 5.41 MB | 28 Feb 2017 - 21:43 |
Googlebot-Image | 4,674 | 51.02 MB | 28 Feb 2017 - 23:23 |
Googlebot | 3,811+59 | 72.53 MB | 28 Feb 2017 - 23:58 |
MSIE 6 - ( Rogue Robot ) | 3,674 | 50.65 MB | 28 Feb 2017 - 17:29 |
AhrefsBot | 3,131+32 | 636.89 MB | 28 Feb 2017 - 23:51 |
Yahoo! Slurp | 2,612+76 | 2.86 GB | 28 Feb 2017 - 23:41 |
SemrushBot | 2,497+80 | 54.35 MB | 28 Feb 2017 - 22:02 |
Google Web Preview | 2,500 | 46.92 MB | 28 Feb 2017 - 22:03 |
Baiduspider | 2,389+12 | 34.80 MB | 28 Feb 2017 - 23:44 |
SeznamBot | 1,896+267 | 59.96 MB | 28 Feb 2017 - 23:51 |
spbot | 1,900+10 | 35.42 MB | 26 Feb 2017 - 14:10 |
facebookexternalhit | 1,688 | 78.49 MB | 28 Feb 2017 - 23:07 |
YandexBot | 1,532+140 | 22.47 MB | 28 Feb 2017 - 21:41 |
crawl | 1,453+28 | 27.79 MB | 26 Feb 2017 - 18:54 |
BingPreview | 1,405 | 46.03 MB | 28 Feb 2017 - 22:57 |
Unknown robot identified by bot\* | 1,233+11 | 86.22 MB | 28 Feb 2017 - 20:56 |
MJ12bot | 878+150 | 12.38 MB | 28 Feb 2017 - 16:26 |
istellabot | 624+110 | 8.37 MB | 28 Feb 2017 - 13:30 |
MSIE 5 - ( Rogue Robot ) | 640 | 4.13 MB | 28 Feb 2017 - 15:08 |
vebidoobot | 596+1 | 6.22 MB | 07 Feb 2017 - 11:18 |
Firefox version 10 and lower - various robots | 549+31 | 11.80 MB | 28 Feb 2017 - 22:11 |
BLEXBot | 536+15 | 11.75 MB | 27 Feb 2017 - 11:12 |
empty user agent string | 505+6 | 14.00 MB | 28 Feb 2017 - 23:33 |
Pcore | 465 | 8.41 MB | 27 Feb 2017 - 05:01 |
CCBot | 417+10 | 5.79 MB | 25 Feb 2017 - 22:11 |
yahoocachesystem | 412 | 12.32 MB | 28 Feb 2017 - 22:37 |
linkdexbot | 398+6 | 20.05 MB | 28 Feb 2017 - 20:14 |
Java ( catchall ) | 314+4 | 8.95 MB | 28 Feb 2017 - 19:13 |
GarlikCrawler | 279+13 | 4.66 MB | 19 Feb 2017 - 00:53 |
mozilla/4.0 (compatible;) - ( Rogue Robot ) | 288 | 4.67 MB | 28 Feb 2017 - 09:34 |
Unknown robot (identified by hit on robots.txt) | 0+267 | 33.11 KB | 28 Feb 2017 - 23:57 |
Mail.RU Bot | 142+122 | 1.63 MB | 22 Feb 2017 - 05:08 |
psbot | 195+12 | 2.42 MB | 28 Feb 2017 - 15:09 |
Sogou web spider | 146+47 | 5.15 MB | 28 Feb 2017 - 16:08 |
Google Page Speed | 160 | 8.88 MB | 28 Feb 2017 - 07:32 |
daum | 86+58 | 2.35 MB | 28 Feb 2017 - 15:16 |
Python-urllib | 135+7 | 2.78 MB | 28 Feb 2017 - 10:40 |
electricmonk | 99+11 | 1.35 MB | 26 Feb 2017 - 21:55 |
James BOT | 100+9 | 7.39 MB | 28 Feb 2017 - 13:25 |
coccoc | 57+45 | 1.41 MB | 28 Feb 2017 - 17:06 |
ichiro | 84+9 | 1.45 MB | 27 Feb 2017 - 08:14 |
Mozilla Beta (Windows) - ( Rogue Robot ) | 86 | 514.32 KB | 27 Feb 2017 - 05:32 |
Deepnet Explorer | 82 | 490.40 KB | 27 Feb 2017 - 05:30 |
favicon | 80 | 678.74 KB | 28 Feb 2017 - 19:19 |
Applebot | 51+28 | 749.54 KB | 28 Feb 2017 - 15:02 |
YandexImageResizer | 74 | 7.49 MB | 27 Feb 2017 - 06:12 |
wordpress | 68 | 56.07 KB | 27 Feb 2017 - 20:16 |
yoozBot | 44+23 | 623.08 KB | 19 Feb 2017 - 09:58 |
Konqueror | 66 | 510.59 KB | 28 Feb 2017 - 19:52 |
MSIE 2 - ( Rogue Robot ) | 58 | 346.87 KB | 26 Feb 2017 - 02:57 |
Uptimebot | 47+1 | 41.99 KB | 28 Feb 2017 - 07:50 |
ia_archiver | 35+12 | 1.08 MB | 19 Feb 2017 - 14:05 |
Cliqzbot | 23+23 | 491.61 KB | 23 Feb 2017 - 22:01 |
Exabot | 33+12 | 571.07 KB | 28 Feb 2017 - 16:11 |
Dalvik | 45 | 1.55 MB | 28 Feb 2017 - 08:58 |
MSIE 3 - ( Rogue Robot ) | 44 | 263.14 KB | 27 Feb 2017 - 04:56 |
link | 43 | 914.10 KB | 28 Feb 2017 - 13:21 |
qwantify | 33+10 | 641.42 KB | 28 Feb 2017 - 04:32 |
seoscanners | 22+19 | 688.40 KB | 27 Feb 2017 - 07:46 |
Windows 95 - ( Rogue Robot ) | 38 | 227.26 KB | 27 Feb 2017 - 05:32 |
MSIE 4 - ( Rogue Robot ) | 37 | 221.28 KB | 27 Feb 2017 - 06:13 |
CFNetwork | 37 | 1.28 MB | 28 Feb 2017 - 07:43 |
MSIECrawler | 37 | 221.28 KB | 27 Feb 2017 - 04:39 |
izsearch | 33+3 | 526.22 KB | 04 Feb 2017 - 19:18 |
Babya Discoverer | 35 | 209.32 KB | 26 Feb 2017 - 02:56 |
robot | 32+3 | 2.01 MB | 28 Feb 2017 - 08:22 |
SEOkicks-Robot | 28+4 | 279.04 KB | 28 Feb 2017 - 19:46 |
Plukkie | 21+10 | 318.13 KB | 14 Feb 2017 - 08:10 |
checker | 28 | 395.75 KB | 28 Feb 2017 - 14:16 |
bhcBot | 27 | 517.89 KB | 20 Feb 2017 - 21:52 |
msnbot-media | 25 | 390.95 KB | 25 Feb 2017 - 12:22 |
SiteExplorer | 19+4 | 335.17 KB | 20 Feb 2017 - 03:33 |
LWP::Simple | 22 | 567.19 KB | 04 Feb 2017 - 19:12 |
python | 21 | 1.73 MB | 23 Feb 2017 - 22:26 |
PhantomJS | 21 | 1.17 MB | 14 Feb 2017 - 01:23 |
discover | 19 | 687.03 KB | 26 Feb 2017 - 13:11 |
Go-http-client | 18+1 | 528.41 KB | 28 Feb 2017 - 21:51 |
Baiduspider-image | 18 | 1.25 MB | 28 Feb 2017 - 23:03 |
ltx71 | 2+15 | 66.71 KB | 28 Feb 2017 - 20:23 |
mozilla/5.0 - ( Rogue Robot ) | 15 | 960.36 KB | 17 Feb 2017 - 11:03 |
SafeDNSBot | 8+6 | 82.42 KB | 18 Feb 2017 - 00:18 |
scrapy | 14 | 744.55 KB | 20 Feb 2017 - 04:57 |
nutch ( catchall ) | 8+5 | 147.95 KB | 21 Feb 2017 - 21:43 |
Gluten Free Crawler | 12 | 467.98 KB | 28 Feb 2017 - 05:03 |
twitterbot | 6+6 | 132.42 KB | 24 Feb 2017 - 13:29 |
ips-agent | 11+1 | 104.36 KB | 02 Feb 2017 - 10:44 |
360Spider | 3+8 | 45.87 KB | 25 Feb 2017 - 16:02 |
Yandex ( catchall ) | 10 | 1.13 MB | 27 Feb 2017 - 23:11 |
yeti | 7+2 | 101.27 KB | 26 Feb 2017 - 14:29 |
DuckDuckGo-Favicons-Bot | 9 | 53.82 KB | 25 Feb 2017 - 19:08 |
Googlebot-Video | 8 | 9.95 MB | 23 Feb 2017 - 16:23 |
YisouSpider | 8 | 91.51 KB | 27 Feb 2017 - 00:35 |
seek | 4+3 | 68.68 KB | 21 Feb 2017 - 19:46 |
archive.org_bot | 0+6 | 762 Bytes | 26 Feb 2017 - 23:27 |
MojeekBot | 2+4 | 16.17 KB | 25 Feb 2017 - 17:46 |
wonderbot | 4+1 | 26.47 KB | 09 Feb 2017 - 09:09 |
Microsoft Office Protocol Discovery | 5 | 0 | 23 Feb 2017 - 02:01 |
domainappender | 3+2 | 20.61 KB | 15 Feb 2017 - 21:57 |
trendiction | 1+4 | 25.99 KB | 27 Feb 2017 - 16:50 |
netcraft | 4 | 17.94 KB | 09 Feb 2017 - 05:14 |
siteimprove | 4 | 23.92 KB | 19 Feb 2017 - 05:14 |
Apache-HttpClient | 3+1 | 44.80 KB | 26 Feb 2017 - 07:41 |
CUBOT | 4 | 44.10 KB | 09 Feb 2017 - 05:41 |
titan | 4 | 165.76 KB | 26 Feb 2017 - 08:29 |
filterdb.iss.net | 2+2 | 12.21 KB | 14 Feb 2017 - 17:06 |
W3C-checklink | 2+2 | 254 Bytes | 22 Feb 2017 - 18:41 |
core | 4 | 87.40 KB | 24 Feb 2017 - 09:48 |
Mechanize | 3 | 69.19 KB | 23 Feb 2017 - 11:47 |
Yahoo Link Preview | 3 | 104.73 KB | 23 Feb 2017 - 00:58 |
Wget | 3 | 41.62 KB | 22 Feb 2017 - 16:26 |
LinkpadBot | 3 | 17.94 KB | 02 Feb 2017 - 19:07 |
steeler | 2+1 | 48.28 KB | 05 Feb 2017 - 08:11 |
Slackbot-LinkExpanding | 3 | 552.34 KB | 27 Feb 2017 - 04:16 |
HELLO Crawler | 2+1 | 63.48 KB | 26 Feb 2017 - 14:52 |
PiplBot | 3 | 81.24 KB | 24 Feb 2017 - 12:48 |
GrapeshotCrawler | 2+1 | 12.08 KB | 04 Feb 2017 - 18:03 |
Dispatch | 3 | 79.87 KB | 20 Feb 2017 - 07:58 |
SurveyBot | 1+1 | 6.10 KB | 13 Feb 2017 - 23:23 |
Prlog | 1+1 | 6.10 KB | 19 Feb 2017 - 22:18 |
scoutjet | 1+1 | 6.48 KB | 13 Feb 2017 - 05:10 |
SafeSearch microdata crawler | 2 | 54.21 KB | 26 Feb 2017 - 06:17 |
spiderman | 2 | 11.96 KB | 28 Feb 2017 - 19:16 |
linkbot | 2 | 17.95 KB | 07 Feb 2017 - 06:55 |
spyonweb | 1+1 | 6.10 KB | 03 Feb 2017 - 15:46 |
Windows 99 - ( Rogue Robot ) | 2 | 28.82 KB | 15 Feb 2017 - 02:16 |
YandexMobileBot | 2 | 36.64 KB | 24 Feb 2017 - 03:20 |
CMS Crawler | 2 | 11.96 KB | 06 Feb 2017 - 08:32 |
TweetmemeBot | 2 | 34.47 KB | 25 Feb 2017 - 16:49 |
nutch-1.4 | 1+1 | 6.10 KB | 04 Feb 2017 - 20:45 |
DotBot | 0+2 | 254 Bytes | 16 Feb 2017 - 09:16 |
ODP link checker | 1 | 0 | 03 Feb 2017 - 02:47 |
SurdotlyBot | 1 | 5.98 KB | 07 Feb 2017 - 07:58 |
^[1-3]$ | 1 | 3.08 KB | 13 Feb 2017 - 09:46 |
Screaming Frog SEO Spider | 1 | 108.23 KB | 16 Feb 2017 - 06:31 |
universalfeedparser | 1 | 21.08 KB | 18 Feb 2017 - 05:46 |
spider | 1 | 39.43 KB | 08 Feb 2017 - 02:48 |
LinkCheck | 1 | 32.92 KB | 17 Feb 2017 - 03:48 |
bubing | 0+1 | 127 Bytes | 27 Feb 2017 - 16:03 |
proximic | 0+1 | 127 Bytes | 21 Feb 2017 - 23:46 |
webcollage | 1 | 16.10 KB | 01 Feb 2017 - 18:17 |
Curl | 1 | 0 | 21 Feb 2017 - 08:59 |
Feedfetcher-Google | 1 | 22.96 KB | 17 Feb 2017 - 13:09 |
TelegramBot | 1 | 47.89 KB | 21 Feb 2017 - 07:31 |
crawler4j | 0+1 | 127 Bytes | 06 Feb 2017 - 18:13 |
Discordbot | 1 | 26.36 KB | 24 Feb 2017 - 09:31 |
wallpaper | 1 | 1.29 KB | 24 Feb 2017 - 06:05 |
rambler | 1 | 23.95 KB | 01 Feb 2017 - 19:50 |
gocrawl | 0+1 | 127 Bytes | 07 Feb 2017 - 05:29 |
yie8 | 1 | 39.05 KB | 06 Feb 2017 - 15:43 |
|