35 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 4,444+28 | 330.54 MB | 25 Dec 2020 - 03:25 |
bingbot | 93,692+120 | 5.31 GB | 25 Dec 2020 - 03:24 |
Unknown robot (identified by 'bot*') | 24,630+1165 | 1.45 GB | 25 Dec 2020 - 03:23 |
Googlebot | 4,421+45 | 267.98 MB | 25 Dec 2020 - 03:21 |
Unknown robot (identified by 'robot') | 16,645+34 | 1.16 GB | 25 Dec 2020 - 03:19 |
Unknown robot (identified by 'spider') | 2,376+36 | 167.18 MB | 25 Dec 2020 - 03:16 |
BaiDuSpider | 508 | 11.13 MB | 25 Dec 2020 - 03:11 |
Sogou Spider | 268+2 | 34.26 MB | 25 Dec 2020 - 03:05 |
Yandex bot | 569+148 | 31.63 MB | 25 Dec 2020 - 02:37 |
SeznamBot | 312+246 | 8.30 MB | 25 Dec 2020 - 02:20 |
InfoBot | 881+95 | 75.05 MB | 24 Dec 2020 - 18:04 |
Web Core / Roots | 99 | 1.89 MB | 24 Dec 2020 - 17:47 |
Unknown robot (identified by empty user agent string) | 395+1 | 24.84 MB | 24 Dec 2020 - 15:31 |
Bing Preview bot | 43 | 630.22 KB | 24 Dec 2020 - 14:31 |
MJ12bot | 23,170+173 | 1.54 GB | 24 Dec 2020 - 14:06 |
Additional Yahoo bots. | 63 | 689.38 KB | 24 Dec 2020 - 13:27 |
Common *nix tool for automating web document retireval. Most likely a bot. | 4 | 147.47 KB | 24 Dec 2020 - 07:45 |
FaceBook bot | 14 | 588.28 KB | 24 Dec 2020 - 04:39 |
lwp-request | 13 | 1.86 MB | 24 Dec 2020 - 03:56 |
yeti | 74+1 | 165.85 KB | 23 Dec 2020 - 13:43 |
FavIconizer | 7 | 1.00 MB | 23 Dec 2020 - 11:44 |
Python-urllib | 82+1 | 707.71 KB | 23 Dec 2020 - 07:23 |
Unknown robot (identified by hit on 'robots.txt') | 0+66 | 26.50 KB | 23 Dec 2020 - 00:52 |
CFNetwork | 15 | 222.81 KB | 22 Dec 2020 - 21:43 |
Mail.ru bot | 166+108 | 1.10 MB | 22 Dec 2020 - 21:00 |
WGet tools | 3 | 805 Bytes | 22 Dec 2020 - 12:10 |
LinkBot | 12+6 | 438.35 KB | 21 Dec 2020 - 04:34 |
TestBot | 1 | 146.68 KB | 19 Dec 2020 - 05:55 |
Exabot | 43 | 100.33 KB | 17 Dec 2020 - 15:07 |
WordPress | 2 | 586 Bytes | 15 Dec 2020 - 17:02 |
twitterbot | 3 | 804 Bytes | 13 Dec 2020 - 09:05 |
Motor | 22 | 75.47 KB | 11 Dec 2020 - 12:17 |
Alexa (IA Archiver) | 527+5 | 37.69 MB | 10 Dec 2020 - 11:33 |
Heritrix | 117+1 | 181.15 KB | 09 Dec 2020 - 18:30 |
Netcraft | 1 | 146.71 KB | 01 Dec 2020 - 23:33 |
|