Log-Hero.com Plugin
Log Hero Do you want to know which bots visit your site, and what they find there? Log Hero records every request your server answers and turns it into a clear picture of how search engines, AI crawlers and all the other bots move through your site. Because the plugin works on the server, it sees wh
Log Hero
Do you want to know which bots visit your site, and what they find there? Log Hero records every request your server answers and turns it into a clear picture of how search engines, AI crawlers and all the other bots move through your site.
Because the plugin works on the server, it sees what a tracking script never will. Crawlers do not run JavaScript, so they are invisible to ordinary analytics. Log Hero catches every one of them, including the requests to robots.txt and your sitemaps, the 404s they run into and the redirects they follow. No downloading log files, no grep.
Search bots, AI crawlers and everything else
Next to the classic search engine bots, Log Hero recognises the AI crawlers that now make up a large share of automated traffic, and it tells you which is which:
- Search engines such as Googlebot, bingbot, YandexBot, Amazonbot and Sogou.
- AI crawlers and assistants such as GPTBot, ClaudeBot and ChatGPT-User.
- SEO tools such as AhrefsBot and SemrushBot.
- Social networks and link previews such as facebookexternalhit.
Bots that identify themselves with an unknown user agent are grouped so you can still see how much traffic they cause.
Where your data lives
The data is available in two places, and you can use both.
In the Keyword Hero app. A bot activity dashboard: hits, error rate, how many bots are active and how fast your site answers them, daily traffic split per bot, the paths that get crawled most and the errors bots run into.
In Google Analytics 4. Log Hero pushes the data into your GA4 property, so you can build your own explorations across bot name, landing page and status code, and combine bot traffic with the rest of your reporting.
What you can analyse
Everything below is included, there is no paid tier holding features back.
- The path each bot requested, so you can see what gets crawled and how often.
- The bot name, checked against the IP address rather than taken at face value, so a crawler claiming to be Googlebot has to prove it.
- The user agent it identified itself with.
