What crawls this site?
A live look at every bot, crawler, and scanner that has visited leedriggers.com — search engines, AI crawlers, SEO tools, and everything else that shows up.
122,199Total requests
64Distinct bots
20Paths hit
15Countries
Activity (last 30 days)
Chrome No User-Agent Other bot Human / unknown curl Scanner / probe Google (by ASN) AhrefsBot
Distribution Breakdown
Traffic by Bot Segment
<1% Search Engines
4% AI Crawlers
2% SEO Tools
<1% Social / Fetchers
5% Scanners & Probes
12% Other / Unclassified
48% Human / Browser
26% Dev Tools & Scripts
Search Engine Share
51% Googlebot
26% Bingbot
11% YandexBot
6% Applebot
3% SeznamBot
2% Baiduspider
<1% DuckDuckBot
<1% MojeekBot
AI Crawler Share
26% Perplexity (User)
21% ClaudeBot
11% PetalBot
10% ChatGPT (User)
8% Amazonbot
6% GPTBot
4% OpenAI SearchBot
4% Amzn SearchBot
Content Types Targeted
97% HTML / Pages
<1% XML Data
1% Robots / TXT
2% Other
Most Crawled Paths
81% /
4% /blog/
2% /resume/
1% /contact/
1% /projects/
1% /about/
1% /wp-content/uploads/
1% /robots.txt
Top Origin Countries
35% US
11% FR
7% BR
7% CA
7% NL
5% MX
4% DE
4% NO
Infrastructure & Velocity
7-Day Rolling Velocity
Total crawl volume over the last week.
Crawler Controls
Hits checking permissions & site structures.
robots.txt249
*.xml (Sitemaps)178
/sitemap-main.xml178ASN Identifications
Known company IP ranges matched by network block — not user-agent. These crawlers deliberately omit or rotate their UA string.
Google 1,688 hits
Anthropic 2 hits
Bot Directory
Search Engines 804 hits
Googlebot 410
Bingbot 206
YandexBot 87
Applebot 52
SeznamBot 26
Baiduspider 14
DuckDuckBot 5
MojeekBot 4
AI Crawlers 5,313 hits
Perplexity (User) 1,364
ClaudeBot 1,099
PetalBot 595
ChatGPT (User) 554
Amazonbot 446
GPTBot 335
OpenAI SearchBot 211
Amzn SearchBot 192
PerplexityBot 116
Google Extended 97
GoogleOther 72
Meta (Scraper) 68
You.com 41
CCBot 35
Bytespider 23
DeepSeekBot 12
Claude SearchBot 9
Diffbot 8
Cohere 7
Claude Code 6
Mistral (User) 6
Applebot Extended 6
xAI (Grok) 5
Claude (User) 4
Google VertexBot 2
Other Bot Segments
SEO tools, social fetchers, scanners, and unclassified traffic. "Other / Unclassified" includes UAs that don't match any of the 1,200+ known bot signatures — typically generic scrapers, headless browsers, or truly blank user-agents.
SEO Tools 2,636
AhrefsBot 1,633
MajesticBot 329
SemrushBot 305
Screaming Frog 147
MozBot 134
Barkrowler 85
DataForSEO 2
SeobilityBot 1
Social / Fetchers 56
Facebook 47
Twitterbot 9
Scanners & Probes 6,373
Scanner / probe 6,359
Security Scanner 14
Other / Unclassified 14,472
Other bot 14,472
Human / Browser 58,805
Chrome 45,099
Human / unknown 9,714
Browser 1,280
Safari 1,207
Firefox 1,164
Edge 304
Opera 31
Samsung Browser 5
Internet Explorer 1
Dev Tools & Scripts 32,046
No User-Agent 23,717
curl 7,522
Go HTTP 602
Python HTTP 199
Java HTTP 4
Node.js HTTP 2
Headless Browsers 4
Headless Browser 4
ASN-identified Bots 1,690
Google (by ASN) 1,688
Anthropic (by ASN) 2
Top paths
| Path | Hits |
|---|---|
/ | 18,091 |
/blog/ | 940 |
/resume/ | 382 |
/contact/ | 323 |
/projects/ | 316 |
/about/ | 308 |
/wp-content/uploads/ | 266 |
/robots.txt | 249 |
/.well-known/ | 194 |
/sitemap-main.xml | 178 |
/cgi-bin/ | 149 |
/wp-content/ | 143 |
/resources/ | 122 |
/wp-includes/PHPMailer/ | 106 |
/admin.php | 88 |
Countries
| Code | Hits |
|---|---|
| US | 39,625 |
| FR | 12,700 |
| BR | 8,077 |
| CA | 7,794 |
| NL | 7,274 |
| MX | 5,204 |
| DE | 4,204 |
| NO | 4,077 |
| CH | 3,978 |
| SE | 3,817 |
| IT | 3,598 |
| ES | 3,058 |
| PL | 3,011 |
| JP | 2,735 |
| KR | 2,715 |
Updated 6h ago. Aggregate data only — no visitor information shown.