What crawls this site?
A live look at every bot, crawler, and scanner that has visited leedriggers.com — search engines, AI crawlers, SEO tools, and everything else that shows up.
122,938Total requests
64Distinct bots
20Paths hit
15Countries
Activity (last 30 days)
Chrome No User-Agent Other bot Human / unknown curl Scanner / probe Google (by ASN) AhrefsBot
Distribution Breakdown
Traffic by Bot Segment
<1% Search Engines
4% AI Crawlers
2% SEO Tools
<1% Social / Fetchers
5% Scanners & Probes
12% Other / Unclassified
48% Human / Browser
26% Dev Tools & Scripts
Search Engine Share
51% Googlebot
26% Bingbot
11% YandexBot
6% Applebot
3% SeznamBot
2% Baiduspider
<1% DuckDuckBot
<1% MojeekBot
AI Crawler Share
25% Perplexity (User)
21% ClaudeBot
11% PetalBot
10% ChatGPT (User)
8% Amazonbot
6% GPTBot
4% OpenAI SearchBot
4% Amzn SearchBot
Content Types Targeted
97% HTML / Pages
<1% XML Data
1% Robots / TXT
1% Other
Most Crawled Paths
81% /
4% /blog/
2% /resume/
1% /contact/
1% /projects/
1% /about/
1% /wp-content/uploads/
1% /robots.txt
Top Origin Countries
35% US
11% FR
7% BR
7% CA
6% NL
5% MX
4% NO
4% DE
Infrastructure & Velocity
7-Day Rolling Velocity
Total crawl volume over the last week.
Crawler Controls
Hits checking permissions & site structures.
robots.txt249
*.xml (Sitemaps)178
/sitemap-main.xml178ASN Identifications
Known company IP ranges matched by network block — not user-agent. These crawlers deliberately omit or rotate their UA string.
Google 1,688 hits
Anthropic 2 hits
Bot Directory
Search Engines 806 hits
Googlebot 412
Bingbot 206
YandexBot 87
Applebot 52
SeznamBot 26
Baiduspider 14
DuckDuckBot 5
MojeekBot 4
AI Crawlers 5,359 hits
Perplexity (User) 1,364
ClaudeBot 1,139
PetalBot 600
ChatGPT (User) 554
Amazonbot 447
GPTBot 335
OpenAI SearchBot 211
Amzn SearchBot 192
PerplexityBot 116
Google Extended 97
GoogleOther 72
Meta (Scraper) 68
You.com 41
CCBot 35
Bytespider 23
DeepSeekBot 12
Claude SearchBot 9
Diffbot 8
Cohere 7
Claude Code 6
Mistral (User) 6
Applebot Extended 6
xAI (Grok) 5
Claude (User) 4
Google VertexBot 2
Other Bot Segments
SEO tools, social fetchers, scanners, and unclassified traffic. "Other / Unclassified" includes UAs that don't match any of the 1,200+ known bot signatures — typically generic scrapers, headless browsers, or truly blank user-agents.
SEO Tools 2,647
AhrefsBot 1,644
MajesticBot 329
SemrushBot 305
Screaming Frog 147
MozBot 134
Barkrowler 85
DataForSEO 2
SeobilityBot 1
Social / Fetchers 56
Facebook 47
Twitterbot 9
Scanners & Probes 6,385
Scanner / probe 6,368
Security Scanner 17
Other / Unclassified 14,568
Other bot 14,568
Human / Browser 59,113
Chrome 45,398
Human / unknown 9,714
Browser 1,281
Safari 1,211
Firefox 1,165
Edge 307
Opera 31
Samsung Browser 5
Internet Explorer 1
Dev Tools & Scripts 32,310
No User-Agent 23,979
curl 7,524
Go HTTP 602
Python HTTP 199
Java HTTP 4
Node.js HTTP 2
Headless Browsers 4
Headless Browser 4
ASN-identified Bots 1,690
Google (by ASN) 1,688
Anthropic (by ASN) 2
Top paths
| Path | Hits |
|---|---|
/ | 18,191 |
/blog/ | 942 |
/resume/ | 385 |
/contact/ | 324 |
/projects/ | 317 |
/about/ | 308 |
/wp-content/uploads/ | 268 |
/robots.txt | 249 |
/.well-known/ | 195 |
/sitemap-main.xml | 178 |
/cgi-bin/ | 149 |
/wp-content/ | 145 |
/resources/ | 123 |
/wp-includes/PHPMailer/ | 107 |
/admin.php | 88 |
Countries
| Code | Hits |
|---|---|
| US | 39,772 |
| FR | 12,702 |
| BR | 8,078 |
| CA | 7,795 |
| NL | 7,275 |
| MX | 5,561 |
| NO | 4,221 |
| DE | 4,205 |
| CH | 3,978 |
| SE | 3,818 |
| IT | 3,598 |
| ES | 3,058 |
| PL | 3,011 |
| KR | 2,779 |
| JP | 2,735 |
Updated 2h ago. Aggregate data only — no visitor information shown.