34 different robots | Hits | Bandwidth | Last visit |
bingbot | 89,825+1726 | 4.58 GB | 30 Mar 2021 - 03:49 |
Unknown robot (identified by 'bot*') | 50,028+1893 | 3.33 GB | 30 Mar 2021 - 03:49 |
Unknown robot (identified by 'robot') | 30,594+265 | 2.11 GB | 30 Mar 2021 - 03:49 |
Unknown robot (identified by 'crawl') | 29,459+381 | 2.03 GB | 29 Mar 2021 - 16:31 |
MJ12bot | 27,620+265 | 1.83 GB | 30 Mar 2021 - 02:47 |
Googlebot | 13,519+72 | 575.31 MB | 30 Mar 2021 - 03:36 |
Unknown robot (identified by 'spider') | 8,740+83 | 274.39 MB | 30 Mar 2021 - 03:20 |
Yandex bot | 1,505+197 | 105.93 MB | 29 Mar 2021 - 21:12 |
Sogou Spider | 959+2 | 134.53 MB | 30 Mar 2021 - 03:45 |
InfoBot | 796+82 | 67.27 MB | 30 Mar 2021 - 01:59 |
SeznamBot | 449+409 | 9.60 MB | 29 Mar 2021 - 08:35 |
BaiDuSpider | 593 | 2.58 MB | 28 Mar 2021 - 12:21 |
Mail.ru bot | 181+116 | 1.46 MB | 30 Mar 2021 - 02:26 |
Unknown robot (identified by empty user agent string) | 272+1 | 12.97 MB | 29 Mar 2021 - 05:02 |
Heritrix | 209+2 | 1.63 MB | 08 Mar 2021 - 02:48 |
Bing Preview bot | 150 | 659.98 KB | 29 Mar 2021 - 16:47 |
yeti | 131+1 | 755.32 KB | 19 Mar 2021 - 19:35 |
Unknown robot (identified by hit on 'robots.txt') | 0+112 | 50.40 KB | 29 Mar 2021 - 06:07 |
Web Core / Roots | 111 | 3.07 MB | 30 Mar 2021 - 00:28 |
Python-urllib | 91 | 1.13 MB | 27 Mar 2021 - 03:25 |
Additional Yahoo bots. | 54 | 587.88 KB | 28 Mar 2021 - 23:42 |
LinkBot | 28+15 | 1015.19 KB | 29 Mar 2021 - 10:17 |
FaceBook bot | 27+2 | 861.84 KB | 27 Mar 2021 - 18:40 |
FavIconizer | 14 | 1.93 MB | 29 Mar 2021 - 18:57 |
Custo | 13 | 1.13 MB | 26 Mar 2021 - 06:18 |
Suspected bot masqurading as Mozilla | 10 | 69.79 KB | 28 Mar 2021 - 12:21 |
CFNetwork | 9 | 136.71 KB | 24 Mar 2021 - 20:37 |
Common *nix tool for automating web document retireval. Most likely a bot. | 8 | 2.05 KB | 24 Mar 2021 - 04:19 |
TestBot | 5 | 725.24 KB | 09 Mar 2021 - 15:23 |
lwp-request | 5 | 724.30 KB | 26 Mar 2021 - 13:05 |
Powermarks | 3 | 425.11 KB | 19 Mar 2021 - 15:28 |
MSIECrawler | 3 | 428.58 KB | 05 Mar 2021 - 21:59 |
Netcraft | 2 | 772 Bytes | 29 Mar 2021 - 04:00 |
WGet tools | 1 | 259 Bytes | 26 Mar 2021 - 10:25 |
|