27 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 11,161+21 | 842.64 MB | 20 May 2023 - 11:22 |
Googlebot | 14,167+30 | 687.06 MB | 20 May 2023 - 11:09 |
Unknown robot (identified by 'bot*') | 42,146+773 | 2.97 GB | 20 May 2023 - 11:09 |
Sogou Spider | 123+2 | 17.97 MB | 20 May 2023 - 11:07 |
MJ12bot | 26,894+192 | 1.89 GB | 20 May 2023 - 10:42 |
bingbot | 4,959+49 | 320.55 MB | 20 May 2023 - 10:42 |
Unknown robot (identified by 'spider') | 1,238+85 | 59.66 MB | 20 May 2023 - 10:36 |
Yandex bot | 1,086+166 | 69.87 MB | 20 May 2023 - 09:37 |
SeznamBot | 46+15 | 3.71 MB | 20 May 2023 - 09:27 |
Python-urllib | 1,204+1 | 3.42 MB | 20 May 2023 - 08:31 |
BaiDuSpider | 198 | 1.08 MB | 20 May 2023 - 02:06 |
Unknown robot (identified by 'robot') | 10,875+12 | 220.19 MB | 19 May 2023 - 23:29 |
CFNetwork | 5 | 1.28 KB | 19 May 2023 - 18:34 |
Unknown robot (identified by hit on 'robots.txt') | 0+70 | 23.17 KB | 19 May 2023 - 17:40 |
Custo | 4 | 597.30 KB | 19 May 2023 - 16:19 |
Bing Preview bot | 62 | 459.44 KB | 19 May 2023 - 16:14 |
Unknown robot (identified by empty user agent string) | 24 | 1.76 MB | 19 May 2023 - 10:21 |
Mail.ru bot | 175+77 | 1.09 MB | 19 May 2023 - 08:00 |
WebCollage | 1 | 268 Bytes | 18 May 2023 - 16:21 |
FavIconizer | 7 | 1.02 MB | 17 May 2023 - 20:11 |
FaceBook bot | 19 | 417.55 KB | 17 May 2023 - 14:40 |
Web Core / Roots | 6+1 | 52.77 KB | 17 May 2023 - 06:22 |
Common *nix tool for automating web document retireval. Most likely a bot. | 97 | 263.32 KB | 17 May 2023 - 06:16 |
twitterbot | 4 | 1.03 KB | 14 May 2023 - 17:56 |
InfoBot | 256+13 | 20.58 MB | 12 May 2023 - 11:36 |
BBot | 9+1 | 699.19 KB | 09 May 2023 - 13:57 |
Netcraft | 2 | 151.58 KB | 04 May 2023 - 05:58 |
|