177 different robots | Hits | Bandwidth | Last visit |
Applebot | 41+16 | 807.82 KB | 31 Mar 2016 - 23:59 |
SeznamBot | 1,490+588 | 31.01 MB | 31 Mar 2016 - 23:59 |
Baiduspider | 2,203+83 | 40.77 MB | 31 Mar 2016 - 23:59 |
bingbot | 28,336+228 | 887.95 MB | 31 Mar 2016 - 23:57 |
crawl | 2,382+20 | 43.36 MB | 31 Mar 2016 - 23:53 |
YandexBot | 953+116 | 32.19 MB | 31 Mar 2016 - 23:53 |
BingPreview | 916 | 19.75 MB | 31 Mar 2016 - 23:51 |
Googlebot-Mobile | 1,375 | 20.58 MB | 31 Mar 2016 - 23:51 |
AhrefsBot | 3,661+20 | 718.69 MB | 31 Mar 2016 - 23:44 |
Googlebot | 6,530+108 | 1.61 GB | 31 Mar 2016 - 23:42 |
Yahoo! Slurp | 8,398+233 | 3.07 GB | 31 Mar 2016 - 23:39 |
DotBot | 166+51 | 1.81 MB | 31 Mar 2016 - 23:27 |
Python-urllib | 69+2 | 4.14 MB | 31 Mar 2016 - 23:16 |
Googlebot-Image | 6,974 | 59.42 MB | 31 Mar 2016 - 23:09 |
facebookexternalhit | 2,769 | 76.61 MB | 31 Mar 2016 - 23:06 |
Google Web Preview | 4,030 | 77.73 MB | 31 Mar 2016 - 23:01 |
Java ( catchall ) | 731+6 | 21.89 MB | 31 Mar 2016 - 22:59 |
Firefox version 10 and lower - various robots | 1,326+65 | 20.28 MB | 31 Mar 2016 - 22:18 |
yahoocachesystem | 459 | 25.84 MB | 31 Mar 2016 - 22:14 |
msnbot-media | 140 | 7.32 MB | 31 Mar 2016 - 21:39 |
Googlebot-Video | 11 | 24.06 MB | 31 Mar 2016 - 21:25 |
scrapy | 6 | 221.27 KB | 31 Mar 2016 - 21:13 |
YandexImages | 706 | 4.32 MB | 31 Mar 2016 - 21:12 |
empty user agent string | 262+12 | 494.10 MB | 31 Mar 2016 - 20:47 |
Exabot | 203+35 | 2.57 MB | 31 Mar 2016 - 20:26 |
Gluten Free Crawler | 18 | 647.23 KB | 31 Mar 2016 - 20:21 |
ichiro | 194+20 | 4.84 MB | 31 Mar 2016 - 19:44 |
TweetmemeBot | 3 | 73.69 KB | 31 Mar 2016 - 19:33 |
MSIE 6 - ( Rogue Robot ) | 3,126+1 | 42.11 MB | 31 Mar 2016 - 19:18 |
MJ12bot | 7,553+258 | 128.66 MB | 31 Mar 2016 - 18:22 |
istellabot | 737+105 | 24.92 MB | 31 Mar 2016 - 18:20 |
daum | 92+17 | 2.45 MB | 31 Mar 2016 - 17:41 |
Unknown robot (identified by hit on robots.txt) | 0+173 | 21.46 KB | 31 Mar 2016 - 17:37 |
Stratagems Kumo | 125+71 | 972.39 KB | 31 Mar 2016 - 17:22 |
linkdexbot | 512+8 | 28.78 MB | 31 Mar 2016 - 15:56 |
python | 169+2 | 6.84 MB | 31 Mar 2016 - 15:22 |
ZumBot | 64 | 3.50 MB | 31 Mar 2016 - 15:21 |
discover | 138 | 3.70 MB | 31 Mar 2016 - 14:53 |
favicon | 103 | 1.75 MB | 31 Mar 2016 - 13:45 |
riddler | 424+79 | 6.84 MB | 31 Mar 2016 - 12:52 |
Sogou web spider | 48+23 | 1.02 MB | 31 Mar 2016 - 12:51 |
Uptimebot | 31+5 | 84.35 KB | 31 Mar 2016 - 12:23 |
qwantify | 320+36 | 5.88 MB | 31 Mar 2016 - 12:18 |
James BOT | 100+7 | 7.35 MB | 31 Mar 2016 - 11:59 |
YandexImageResizer | 32 | 6.38 MB | 31 Mar 2016 - 11:46 |
mozilla/4.0 (compatible;) - ( Rogue Robot ) | 534 | 9.36 MB | 31 Mar 2016 - 11:02 |
360Spider | 8+4 | 156.09 KB | 31 Mar 2016 - 09:42 |
MegaIndex.ru | 874+1 | 16.11 MB | 31 Mar 2016 - 09:30 |
coccoc | 103+28 | 2.79 MB | 31 Mar 2016 - 07:56 |
Yandex ( catchall ) | 46 | 1.20 MB | 31 Mar 2016 - 02:48 |
ia_archiver | 167+48 | 2.95 MB | 31 Mar 2016 - 02:44 |
Mozilla Beta (Windows) - ( Rogue Robot ) | 77 | 644.72 KB | 31 Mar 2016 - 02:39 |
MSIE 5 - ( Rogue Robot ) | 492+2 | 4.71 MB | 31 Mar 2016 - 02:36 |
MSIE 4 - ( Rogue Robot ) | 34 | 258.60 KB | 31 Mar 2016 - 02:36 |
MSIE 3 - ( Rogue Robot ) | 26 | 155.49 KB | 31 Mar 2016 - 02:32 |
Deepnet Explorer | 75 | 741.08 KB | 31 Mar 2016 - 02:32 |
MSIE 2 - ( Rogue Robot ) | 62 | 496.61 KB | 31 Mar 2016 - 02:17 |
Babya Discoverer | 38 | 264.10 KB | 31 Mar 2016 - 02:12 |
MSIECrawler | 34 | 277.03 KB | 31 Mar 2016 - 01:59 |
Windows 95 - ( Rogue Robot ) | 33 | 307.89 KB | 31 Mar 2016 - 01:28 |
wordpress | 147 | 2.69 MB | 31 Mar 2016 - 00:21 |
vebidoobot | 13+4 | 78.24 KB | 30 Mar 2016 - 23:43 |
Xenu Link Sleuth | 6 | 5.98 KB | 30 Mar 2016 - 21:55 |
Dalvik | 127 | 3.95 MB | 30 Mar 2016 - 20:58 |
Wget | 113 | 9.92 MB | 30 Mar 2016 - 20:34 |
Baiduspider-image | 28 | 1.66 MB | 30 Mar 2016 - 19:30 |
scoutjet | 3+3 | 14.48 KB | 30 Mar 2016 - 19:05 |
mfibot | 33 | 410.67 KB | 30 Mar 2016 - 17:33 |
Go-http-client | 31 | 421.62 KB | 30 Mar 2016 - 16:42 |
linkbot | 409+5 | 7.63 MB | 30 Mar 2016 - 12:15 |
link | 4 | 130.45 KB | 30 Mar 2016 - 11:45 |
SemrushBot | 1,906+29 | 98.11 MB | 30 Mar 2016 - 10:58 |
XoviBot | 76 | 3.25 MB | 30 Mar 2016 - 10:47 |
Apache-HttpClient | 27+1 | 432.46 KB | 30 Mar 2016 - 10:32 |
acapbot | 1 | 23.93 KB | 30 Mar 2016 - 10:32 |
Microsoft Office Protocol Discovery | 12 | 0 | 30 Mar 2016 - 10:27 |
Windows 99 - ( Rogue Robot ) | 16 | 251.40 KB | 30 Mar 2016 - 09:11 |
HubSpot Webcrawler | 1 | 52.68 KB | 30 Mar 2016 - 03:43 |
CFNetwork | 102 | 2.08 MB | 30 Mar 2016 - 01:45 |
YisouSpider | 7 | 8.41 KB | 29 Mar 2016 - 19:13 |
A PHP script | 6 | 398.07 KB | 29 Mar 2016 - 18:35 |
DeuSu | 19+17 | 433.85 KB | 29 Mar 2016 - 17:40 |
KomodiaBot | 1 | 5.98 KB | 29 Mar 2016 - 16:47 |
Unknown robot identified by bot\* | 92,269+14 | 5.57 GB | 29 Mar 2016 - 16:10 |
Spiderbot | 0+8 | 1016 Bytes | 29 Mar 2016 - 12:38 |
PiplBot | 4 | 86.71 KB | 29 Mar 2016 - 09:55 |
checker | 17 | 240.27 KB | 29 Mar 2016 - 08:18 |
msie8 - ( Rogue Robot ) | 250 | 2.20 MB | 28 Mar 2016 - 22:36 |
Mozilla ( Rogue Robot ) | 26 | 481.06 KB | 28 Mar 2016 - 15:50 |
ICC-Crawler | 9+14 | 162.45 KB | 28 Mar 2016 - 14:40 |
commons-httpclient | 1 | 11.46 KB | 28 Mar 2016 - 14:31 |
Feedfetcher-Google | 1 | 3.02 KB | 28 Mar 2016 - 07:18 |
DuckDuckGo-Favicons-Bot | 11 | 65.79 KB | 28 Mar 2016 - 06:25 |
yoozBot | 34+20 | 920.17 KB | 28 Mar 2016 - 05:43 |
Curl | 49 | 400.64 KB | 28 Mar 2016 - 04:50 |
nbot | 10 | 29.91 KB | 27 Mar 2016 - 05:52 |
Yahoo Link Preview | 2 | 50.36 KB | 26 Mar 2016 - 21:30 |
CRAZYWEBCRAWLER | 5 | 30.13 KB | 26 Mar 2016 - 16:23 |
roboto | 1 | 5.98 KB | 26 Mar 2016 - 08:47 |
filterdb.iss.net | 11+6 | 75.17 KB | 26 Mar 2016 - 07:25 |
zend_http_client | 24 | 806.32 KB | 26 Mar 2016 - 06:25 |
robot | 2,925 | 51.99 MB | 26 Mar 2016 - 03:59 |
ODP link checker | 2 | 0 | 25 Mar 2016 - 19:32 |
2345Explorer | 12 | 230.78 KB | 25 Mar 2016 - 11:46 |
Prlog | 1+1 | 6.10 KB | 25 Mar 2016 - 11:39 |
nutch ( catchall ) | 150+42 | 53.11 MB | 25 Mar 2016 - 10:56 |
GrapeshotCrawler | 8+5 | 200.18 KB | 25 Mar 2016 - 10:55 |
mozilla/5.0 - ( Rogue Robot ) | 18 | 343.93 KB | 25 Mar 2016 - 08:43 |
CUBOT | 30 | 645.76 KB | 25 Mar 2016 - 07:01 |
smtbot | 72+3 | 1.54 MB | 25 Mar 2016 - 00:27 |
twitterbot | 9+5 | 273.94 KB | 24 Mar 2016 - 21:03 |
phpcrawl | 15 | 150.44 KB | 24 Mar 2016 - 20:28 |
spbot | 2,828+12 | 52.99 MB | 24 Mar 2016 - 17:45 |
archive.org_bot | 266+91 | 12.66 MB | 24 Mar 2016 - 16:50 |
fetchbot | 4+4 | 361.44 KB | 24 Mar 2016 - 15:01 |
GetintentCrawler getintent.com | 4+3 | 86.03 KB | 24 Mar 2016 - 01:14 |
metauri | 2 | 17.64 KB | 23 Mar 2016 - 11:56 |
Discordbot | 1 | 26.16 KB | 22 Mar 2016 - 13:00 |
titan | 5 | 158.77 KB | 22 Mar 2016 - 12:40 |
daumoa | 38 | 205.07 KB | 22 Mar 2016 - 12:22 |
Konqueror | 3 | 72.29 KB | 22 Mar 2016 - 04:06 |
netseer | 1+1 | 6.10 KB | 21 Mar 2016 - 18:36 |
Dispatch | 4 | 579.09 KB | 21 Mar 2016 - 17:01 |
webcollage | 2 | 73.34 KB | 21 Mar 2016 - 15:41 |
BLEXBot | 2,465+62 | 26.04 MB | 21 Mar 2016 - 15:19 |
Mail.RU Bot | 392+120 | 6.21 MB | 21 Mar 2016 - 10:47 |
yeti | 11+3 | 137.16 KB | 21 Mar 2016 - 10:26 |
Google Page Speed | 42 | 2.33 MB | 21 Mar 2016 - 06:53 |
nominet | 2+1 | 6.10 KB | 20 Mar 2016 - 22:50 |
PhantomJS | 119 | 2.19 MB | 20 Mar 2016 - 19:25 |
HTTP_Request2 | 3 | 68.01 KB | 20 Mar 2016 - 19:25 |
genieo | 2+2 | 12.21 KB | 20 Mar 2016 - 16:18 |
domainappender | 123+82 | 845.06 KB | 20 Mar 2016 - 04:18 |
Mechanize | 7 | 98.83 KB | 20 Mar 2016 - 01:17 |
core | 2 | 53.50 KB | 19 Mar 2016 - 14:38 |
SurveyBot | 2+2 | 12.21 KB | 19 Mar 2016 - 14:15 |
DomainStatsBot | 2+2 | 254 Bytes | 19 Mar 2016 - 12:06 |
Nautic Expo using Firefox/1.5 | 73 | 1.04 MB | 19 Mar 2016 - 09:14 |
feed | 1 | 16.70 KB | 19 Mar 2016 - 01:48 |
betabot | 19+9 | 102.94 KB | 19 Mar 2016 - 00:50 |
ELinks | 1 | 5.98 KB | 18 Mar 2016 - 22:13 |
OrangeBot | 2+2 | 50.36 KB | 18 Mar 2016 - 19:25 |
Screaming Frog SEO Spider | 3+3 | 19.83 KB | 18 Mar 2016 - 19:20 |
wonderbot | 1+1 | 6.10 KB | 18 Mar 2016 - 17:16 |
Princetonbot | 46 | 1.38 MB | 18 Mar 2016 - 10:42 |
BingLocalSearch | 21+6 | 229.21 KB | 18 Mar 2016 - 04:37 |
ltx71 | 4 | 152.75 KB | 17 Mar 2016 - 22:57 |
SafeSearch microdata crawler | 1 | 7.80 KB | 16 Mar 2016 - 16:13 |
lipperhey | 44+4 | 1.32 MB | 16 Mar 2016 - 12:21 |
DoCoMo | 2 | 52.74 KB | 16 Mar 2016 - 06:52 |
mozilla/4.0 - ( Rogue Robot ) | 2 | 34.83 KB | 15 Mar 2016 - 20:00 |
proximic | 0+1 | 127 Bytes | 15 Mar 2016 - 16:21 |
RukiCrawler | 3 | 487.49 KB | 15 Mar 2016 - 15:46 |
SEOlyticsCrawler | 1+1 | 6.10 KB | 14 Mar 2016 - 22:10 |
facebook | 8 | 94.59 KB | 14 Mar 2016 - 21:21 |
rogerbot | 3+3 | 24.34 KB | 14 Mar 2016 - 15:04 |
yie8 | 1 | 25.66 KB | 14 Mar 2016 - 13:33 |
semanticbot | 46+1 | 1.56 MB | 14 Mar 2016 - 09:26 |
gocrawl | 0+1 | 127 Bytes | 14 Mar 2016 - 08:29 |
foo | 1 | 6.21 KB | 14 Mar 2016 - 05:33 |
CMS Crawler | 2 | 11.96 KB | 13 Mar 2016 - 00:44 |
Unknown robot identified by \*bot | 2 | 62.01 KB | 12 Mar 2016 - 03:16 |
rambler | 11 | 81.05 KB | 12 Mar 2016 - 03:13 |
netcraft | 3 | 5.98 KB | 08 Mar 2016 - 20:45 |
LWP::Simple | 1+2 | 6.39 KB | 08 Mar 2016 - 04:47 |
microsoft-webdav-miniredir | 1 | 0 | 07 Mar 2016 - 14:33 |
simplepie | 1 | 5.98 KB | 07 Mar 2016 - 12:55 |
spider | 0+1 | 127 Bytes | 06 Mar 2016 - 19:30 |
voltron | 0+1 | 127 Bytes | 06 Mar 2016 - 17:56 |
wallpaper | 3 | 37.90 KB | 06 Mar 2016 - 16:39 |
SafeDNSBot | 1+1 | 6.10 KB | 06 Mar 2016 - 15:47 |
Cliqzbot | 11+11 | 351.75 KB | 05 Mar 2016 - 23:57 |
linkapediabot | 3+1 | 43.78 KB | 04 Mar 2016 - 23:44 |
psbot | 34+6 | 535.32 KB | 03 Mar 2016 - 06:21 |
ips-agent | 11+1 | 104.36 KB | 02 Mar 2016 - 10:42 |
Slackbot-LinkExpanding | 1 | 19.75 KB | 01 Mar 2016 - 19:34 |
meanpathbot | 3+3 | 18.31 KB | 01 Mar 2016 - 10:31 |
|