181 different robots | Hits | Bandwidth | Last visit |
Unknown robot identified by bot\* | 3,832,304+2578 | 69.30 GB | 30 Apr 2024 - 23:58 |
Bytespider | 441,421+357 | 19.54 GB | 30 Apr 2024 - 23:58 |
python | 44,846+2353 | 543.81 MB | 30 Apr 2024 - 23:55 |
Go-http-client | 42,186+85 | 2.27 GB | 30 Apr 2024 - 23:02 |
AhrefsBot | 35,047+857 | 411.07 MB | 30 Apr 2024 - 23:59 |
sift | 31,998+403 | 407.88 MB | 28 Apr 2024 - 09:17 |
facebookexternalhit | 31,238+233 | 763.56 MB | 30 Apr 2024 - 22:01 |
bingbot | 26,414+262 | 662.12 MB | 30 Apr 2024 - 23:47 |
PetalBot | 24,969+241 | 1.73 GB | 30 Apr 2024 - 23:33 |
Barkrowler | 23,230+81 | 13.37 GB | 26 Apr 2024 - 04:29 |
Googlebot-Image | 21,977 | 750.22 MB | 30 Apr 2024 - 23:56 |
Googlebot | 20,089+406 | 428.49 MB | 30 Apr 2024 - 23:59 |
MJ12bot | 19,029+771 | 5.15 GB | 30 Apr 2024 - 16:15 |
nbot | 19,294+28 | 3.31 GB | 28 Apr 2024 - 05:39 |
seek | 19,271+28 | 2.28 GB | 24 Apr 2024 - 12:09 |
DotBot | 12,275+1318 | 4.01 GB | 04 Apr 2024 - 22:47 |
Unknown robot (identified by hit on robots.txt) | 0+10147 | 840.60 KB | 30 Apr 2024 - 23:44 |
Applebot | 9,285+118 | 71.56 MB | 30 Apr 2024 - 23:57 |
BLEXBot | 6,372+103 | 48.70 MB | 30 Apr 2024 - 15:38 |
SemrushBot | 4,741+1249 | 32.55 MB | 30 Apr 2024 - 16:26 |
YandexBot | 2,537+2142 | 75.05 MB | 30 Apr 2024 - 22:24 |
Pinterestbot | 4,061+92 | 44.87 MB | 30 Apr 2024 - 23:11 |
nutch ( catchall ) | 2,464+372 | 32.09 MB | 27 Apr 2024 - 21:31 |
link | 2,778+8 | 47.05 MB | 19 Apr 2024 - 14:21 |
Windows 99 - ( Rogue Robot ) | 2,614+2 | 123.34 MB | 28 Apr 2024 - 08:00 |
Baiduspider ( catchall ) | 2,228 | 36.35 MB | 30 Apr 2024 - 08:40 |
crawl | 2,094+46 | 1.39 GB | 30 Apr 2024 - 20:03 |
DuckDuckBot | 1,955 | 520.69 MB | 30 Apr 2024 - 23:40 |
SeznamBot | 1,636+224 | 12.13 MB | 30 Apr 2024 - 22:40 |
Sogou web spider | 1,792+8 | 12.57 MB | 30 Apr 2024 - 23:50 |
zoominfobot | 1,450+142 | 9.66 MB | 28 Apr 2024 - 12:38 |
empty user agent string | 1,512+39 | 198.07 MB | 30 Apr 2024 - 22:33 |
archive.org_bot | 1,386+17 | 38.47 MB | 01 Apr 2024 - 22:07 |
Mail.RU Bot | 696+560 | 6.46 MB | 30 Apr 2024 - 18:38 |
Baiduspider | 1,233 | 7.90 MB | 30 Apr 2024 - 19:29 |
Yandex ( catchall ) | 1,179 | 8.09 MB | 30 Apr 2024 - 22:24 |
Google Web Preview | 1,088 | 26.90 MB | 30 Apr 2024 - 04:35 |
Unknown robot identified by \*bot | 1,010+73 | 8.98 MB | 30 Apr 2024 - 23:26 |
netEstate NE Crawler | 866+20 | 9.74 MB | 14 Mar 2024 - 06:51 |
Firefox version 10 and lower - various robots | 662+96 | 33.47 MB | 30 Apr 2024 - 22:04 |
Mediapartners-Google | 703 | 15.50 MB | 15 Apr 2024 - 04:27 |
Apache-HttpClient | 652+46 | 3.05 MB | 29 Apr 2024 - 10:23 |
CFNetwork | 614 | 21.59 MB | 30 Apr 2024 - 12:31 |
coccoc | 311+293 | 12.45 MB | 30 Apr 2024 - 23:45 |
YandexImages | 509 | 15.74 MB | 30 Apr 2024 - 13:14 |
MojeekBot | 195+211 | 914.16 KB | 30 Apr 2024 - 18:12 |
CCBot | 327+34 | 7.51 MB | 24 Apr 2024 - 14:40 |
yeti | 270+70 | 7.08 MB | 24 Apr 2024 - 23:33 |
DuckDuckGo-Favicons-Bot | 313 | 1.06 MB | 30 Apr 2024 - 12:49 |
Curl | 260 | 12.91 MB | 25 Apr 2024 - 15:15 |
BingPreview | 193 | 7.24 MB | 30 Apr 2024 - 11:02 |
yacybot | 149+38 | 3.22 MB | 22 Apr 2024 - 13:11 |
YisouSpider | 149+31 | 964.66 KB | 26 Apr 2024 - 00:43 |
dataprovider.com | 172+5 | 7.66 MB | 09 Apr 2024 - 12:32 |
core | 156+16 | 4.78 MB | 29 Apr 2024 - 07:40 |
seokicks.de | 168+2 | 2.33 MB | 27 Mar 2024 - 09:21 |
Dalvik | 168 | 12.58 MB | 28 Apr 2024 - 14:42 |
linkdexbot | 158+10 | 3.18 MB | 28 Feb 2024 - 04:52 |
urllib | 155 | 7.00 MB | 04 Apr 2024 - 07:55 |
MSIE 6 - ( Rogue Robot ) | 146 | 1.63 MB | 29 Apr 2024 - 07:38 |
wordpress | 122 | 504.90 KB | 21 Mar 2024 - 17:17 |
Python-urllib | 115 | 4.73 MB | 30 Apr 2024 - 04:44 |
motor | 112 | 6.88 MB | 30 Apr 2024 - 13:38 |
DomainStatsBot | 104+4 | 2.00 MB | 05 Apr 2024 - 15:16 |
yak-linkfluence | 91+12 | 1.71 MB | 26 Apr 2024 - 16:23 |
twitterbot | 67+36 | 1006.49 KB | 30 Apr 2024 - 14:14 |
perman | 101+1 | 1.99 MB | 03 Jan 2024 - 09:29 |
filterdb.iss.net | 89 | 1.14 MB | 25 Apr 2024 - 21:20 |
custo | 81 | 844.69 KB | 22 Apr 2024 - 21:32 |
trendiction | 53+20 | 2.29 MB | 26 Apr 2024 - 20:01 |
Slackbot-LinkExpanding | 73 | 252.07 KB | 26 Apr 2024 - 08:20 |
360Spider | 58 | 207.82 KB | 30 Apr 2024 - 16:01 |
Wget | 57 | 1.06 MB | 25 Mar 2024 - 04:54 |
Discordbot | 55 | 3.03 MB | 30 Apr 2024 - 15:07 |
bbot | 46+8 | 485.88 KB | 18 Jan 2024 - 16:55 |
scrapy | 42+12 | 290.03 KB | 12 Apr 2024 - 14:53 |
linkbot | 35+18 | 102.16 KB | 22 Apr 2024 - 16:40 |
MSIE 5 - ( Rogue Robot ) | 48 | 1.70 MB | 30 Apr 2024 - 22:03 |
BW | 24+20 | 88.01 KB | 27 Apr 2024 - 22:11 |
IonCrawl | 32+8 | 224.86 KB | 28 Apr 2024 - 22:35 |
Velen | 28+6 | 266.78 KB | 26 Apr 2024 - 02:10 |
feed | 33 | 1.00 MB | 10 Apr 2024 - 12:16 |
Lightspeed | 33 | 892.26 KB | 13 Feb 2024 - 20:45 |
SurdotlyBot | 29+2 | 100.77 KB | 30 Apr 2024 - 14:22 |
y!j | 14+17 | 572.15 KB | 12 Apr 2024 - 04:11 |
A PHP script | 24+5 | 966.95 KB | 26 Apr 2024 - 16:11 |
panscient | 25+2 | 154.45 KB | 12 Apr 2024 - 02:24 |
YandexMetrika | 26 | 1.26 MB | 11 Jan 2024 - 07:14 |
ia_archiver | 22 | 490.58 KB | 20 Mar 2024 - 14:58 |
bit.ly | 14+7 | 69.35 KB | 18 Mar 2024 - 20:31 |
Java ( catchall ) | 10+8 | 192.42 KB | 04 Apr 2024 - 06:27 |
Googlebot-Video | 17 | 2.12 GB | 12 Mar 2024 - 23:16 |
mozilla/5.0 - ( Rogue Robot ) | 17 | 94.99 KB | 22 Apr 2024 - 20:05 |
linkchecker | 15+1 | 8.04 KB | 25 Apr 2024 - 18:26 |
netcraft | 16 | 153.74 KB | 03 Apr 2024 - 18:21 |
hometown | 16 | 118.57 KB | 04 Feb 2024 - 06:54 |
Yahoo! Slurp | 9+7 | 152.18 KB | 08 Apr 2024 - 16:37 |
2345Explorer | 15 | 196.45 KB | 25 Apr 2024 - 17:50 |
spider | 10+5 | 70.27 KB | 13 Apr 2024 - 18:38 |
internetarchive | 15 | 411.35 KB | 29 Apr 2024 - 06:13 |
daum | 15 | 198.12 KB | 12 Apr 2024 - 15:35 |
facebook | 13 | 371.54 KB | 24 Mar 2024 - 17:38 |
favicon | 11 | 82.45 KB | 28 Apr 2024 - 10:36 |
daumoa | 0+11 | 814 Bytes | 08 Apr 2024 - 00:05 |
qwantify | 9 | 2.70 MB | 03 Apr 2024 - 15:40 |
ubermetrics-technologies.com | 6+3 | 22.76 KB | 05 Mar 2024 - 13:15 |
Screaming Frog SEO Spider | 9 | 112.16 KB | 16 Apr 2024 - 10:25 |
MixrankBot | 8 | 34.50 KB | 13 Apr 2024 - 18:20 |
checker | 8 | 16.71 KB | 12 Feb 2024 - 23:27 |
TelegramBot | 7 | 73.29 KB | 26 Apr 2024 - 21:04 |
robot | 6 | 95.21 KB | 23 Feb 2024 - 09:21 |
harvest | 4+2 | 150.95 KB | 22 Mar 2024 - 22:47 |
proximic | 5 | 36.75 KB | 27 Feb 2024 - 19:47 |
scanner | 5 | 17.46 KB | 24 Mar 2024 - 17:33 |
serendeputy | 3+2 | 32.64 KB | 01 Mar 2024 - 19:52 |
ips-agent | 3+2 | 12.35 KB | 05 Mar 2024 - 07:35 |
Yahoo Link Preview | 4 | 178.16 KB | 08 Apr 2024 - 16:37 |
blog | 4 | 146.60 KB | 09 Mar 2024 - 09:22 |
nomad | 4 | 20.80 KB | 10 Jan 2024 - 08:42 |
SemrushBot-SI | 4 | 85.05 KB | 07 Feb 2024 - 11:54 |
DuckDuckBot-Https | 2+2 | 7.02 KB | 08 Jan 2024 - 16:53 |
Ruby script | 4 | 29.21 KB | 15 Jan 2024 - 17:56 |
Links ( | 4 | 38.41 KB | 19 Mar 2024 - 07:10 |
W3C-checklink | 2+2 | 148 Bytes | 13 Feb 2024 - 02:12 |
SafeDNSBot | 1+2 | 3.60 KB | 29 Feb 2024 - 05:22 |
The Knowledge AI | 0+3 | 270 Bytes | 12 Mar 2024 - 10:27 |
Windows 95 - ( Rogue Robot ) | 3 | 186.44 KB | 04 Feb 2024 - 06:23 |
perl | 3 | 28.10 KB | 30 Apr 2024 - 18:24 |
LinkCheck | 3 | 77.54 KB | 28 Mar 2024 - 21:30 |
suke | 3 | 21.61 KB | 29 Mar 2024 - 16:12 |
My Nutch Spider | 2+1 | 10.91 KB | 22 Jan 2024 - 13:38 |
yie8 | 3 | 72.87 KB | 06 Apr 2024 - 17:59 |
webcollage | 3 | 711.48 KB | 26 Apr 2024 - 20:15 |
LinkedInBot | 3 | 248.94 KB | 01 Jan 2024 - 13:56 |
discover | 2 | 23.01 KB | 06 Mar 2024 - 08:30 |
eccp | 2 | 4.91 KB | 29 Mar 2024 - 15:36 |
octopus | 2 | 51.81 KB | 25 Feb 2024 - 14:23 |
Nautic Expo using Firefox/1.5 | 2 | 6.85 KB | 11 Feb 2024 - 11:40 |
coolbot | 2 | 74.14 KB | 07 Mar 2024 - 04:14 |
heritrix | 1+1 | 10.66 KB | 17 Mar 2024 - 18:50 |
sitebot | 1+1 | 3.58 KB | 21 Apr 2024 - 23:08 |
dwcp | 2 | 4.08 KB | 29 Mar 2024 - 16:13 |
[^a]fish | 2 | 8.01 KB | 12 Apr 2024 - 15:37 |
fetcher | 1+1 | 13.15 KB | 21 Apr 2024 - 06:59 |
YandexImageResizer | 2 | 675.49 KB | 23 Mar 2024 - 06:06 |
ng/1. | 2 | 26.41 KB | 08 Apr 2024 - 13:03 |
ODP link checker | 1 | 5.75 KB | 11 Jan 2024 - 00:52 |
wwwc | 1 | 13.13 KB | 12 Apr 2024 - 15:34 |
Googlebot-Mobile | 1 | 3.43 KB | 12 Feb 2024 - 01:48 |
nhse | 1 | 4.15 KB | 02 Feb 2024 - 14:55 |
sven | 1 | 2.51 KB | 29 Mar 2024 - 15:59 |
wombat | 1 | 7.42 KB | 24 Jan 2024 - 15:07 |
xirq | 1 | 2.49 KB | 12 Apr 2024 - 15:41 |
microsoft-webdav-miniredir | 1 | 0 | 14 Apr 2024 - 10:34 |
Who.is.Bot | 1 | 10.59 KB | 26 Mar 2024 - 17:48 |
rbse | 1 | 4.33 KB | 05 Jan 2024 - 15:34 |
ucsd | 1 | 397.06 KB | 02 Feb 2024 - 14:58 |
ning | 1 | 7.42 KB | 24 Jan 2024 - 15:07 |
superbot | 1 | 3.49 KB | 20 Mar 2024 - 18:06 |
drupal | 1 | 7.42 KB | 26 Jan 2024 - 13:21 |
msnbot | 1 | 3.49 KB | 14 Apr 2024 - 13:57 |
rambler | 1 | 10.59 KB | 19 Apr 2024 - 01:27 |
slurp | 1 | 1.37 KB | 01 Mar 2024 - 15:10 |
ELinks ( | 1 | 17.25 KB | 15 Apr 2024 - 05:53 |
MSIE 3 - ( Rogue Robot ) | 1 | 31.24 KB | 12 Feb 2024 - 08:15 |
Feedfetcher-Google | 1 | 13.01 KB | 10 Jan 2024 - 01:26 |
W3C_Validator | 1 | 4.00 KB | 04 Mar 2024 - 09:41 |
PhantomJS | 1 | 55.39 KB | 03 Mar 2024 - 08:58 |
MSIE 2 - ( Rogue Robot ) | 1 | 8.00 KB | 18 Jan 2024 - 12:53 |
legs | 1 | 12.97 KB | 05 Jan 2024 - 14:38 |
mozilla/4.0 (compatible;) - ( Rogue Robot ) | 1 | 0 | 26 Mar 2024 - 09:30 |
fido | 1 | 2.14 KB | 12 Apr 2024 - 15:40 |
miva | 1 | 13.50 KB | 15 Mar 2024 - 16:41 |
Konqueror | 1 | 3.49 KB | 12 Apr 2024 - 21:33 |
spry | 1 | 1.56 KB | 02 Feb 2024 - 14:51 |
Validator.nu | 1 | 4.00 KB | 04 Mar 2024 - 09:41 |
pita | 1 | 7.42 KB | 24 Jan 2024 - 15:07 |
sitemap | 1 | 3.42 KB | 08 Jan 2024 - 12:40 |
FirePHP | 1 | 3.43 KB | 27 Feb 2024 - 18:41 |
zeus | 1 | 13.68 KB | 16 Feb 2024 - 15:10 |
MSIECrawler | 1 | 9.08 KB | 16 Jan 2024 - 22:42 |
|