What crawls this site?
A live look at every bot, crawler, and scanner that has visited leedriggers.com — search engines, AI crawlers, SEO tools, and everything else that shows up.
217,772Total requests
76Distinct bots
20Paths hit
15Countries
Activity (last 30 days)
Chrome No User-Agent Other bot Scanner / probe curl Human / unknown Google (by ASN) Browser
Distribution Breakdown
Traffic by Bot Segment
1% Search Engines
5% AI Crawlers
2% SEO Tools
<1% Social / Fetchers
8% Scanners & Probes
15% Other / Unclassified
45% Human / Browser
21% Dev Tools & Scripts
Search Engine Share
58% Googlebot
19% Bingbot
9% Applebot
6% Baiduspider
4% YandexBot
2% SeznamBot
<1% DuckDuckBot
<1% MojeekBot
AI Crawler Share
20% ClaudeBot
14% Perplexity (User)
11% PetalBot
9% Amazonbot
7% ChatGPT (User)
7% GPTBot
5% OpenAI SearchBot
2% PerplexityBot
Content Types Targeted
99% HTML / Pages
<1% XML Data
<1% Robots / TXT
<1% Other
Most Crawled Paths
84% /
5% /blog/
1% /contact/
1% /about/
1% /resume/
1% /projects/
<1% /wp-content/uploads/
<1% /.well-known/
Top Origin Countries
37% US
11% NL
9% FR
5% CA
5% KR
4% BR
4% DE
4% MX
Infrastructure & Velocity
7-Day Rolling Velocity
Total crawl volume over the last week.
Crawler Controls
Hits checking permissions & site structures.
robots.txt249
*.xml (Sitemaps)178
/sitemap-main.xml178ASN Identifications
Known company IP ranges matched by network block — not user-agent. These crawlers deliberately omit or rotate their UA string.
Google 7,805 hits
Anthropic 2 hits
Bot Directory
Search Engines 2,326 hits
Googlebot 1,355
Bingbot 447
Applebot 208
Baiduspider 150
YandexBot 97
SeznamBot 58
DuckDuckBot 7
MojeekBot 4
AI Crawlers 10,565 hits
ClaudeBot 2,079
Perplexity (User) 1,508
PetalBot 1,119
Amazonbot 946
ChatGPT (User) 728
GPTBot 727
OpenAI SearchBot 528
PerplexityBot 244
Meta (Scraper) 220
Amzn SearchBot 208
Google Extended 197
Bytespider 188
Claude (User) 181
You.com 178
DeepSeekBot 175
CCBot 172
Claude SearchBot 166
Kimi SearchBot 160
Cohere 139
ChatGLM Spider 138
KimiBot 134
DuckAssist 116
Mistral (User) 106
PanguBot 92
GoogleOther 87
Claude Code 8
Diffbot 8
Applebot Extended 6
xAI (Grok) 5
Google VertexBot 2
Other Bot Segments
SEO tools, social fetchers, scanners, and unclassified traffic. "Other / Unclassified" includes UAs that don't match any of the 1,200+ known bot signatures — typically generic scrapers, headless browsers, or truly blank user-agents.
SEO Tools 4,320
AhrefsBot 2,776
SemrushBot 535
MajesticBot 450
Barkrowler 234
MozBot 166
Screaming Frog 147
DataForSEO 11
SeobilityBot 1
Social / Fetchers 187
Facebook 75
Telegram 34
Twitterbot 22
Discordbot 17
LinkedInBot 14
WhatsApp 13
Slackbot 12
Scanners & Probes 17,221
Scanner / probe 17,192
Security Scanner 29
Other / Unclassified 31,944
Other bot 31,944
Human / Browser 98,106
Chrome 78,350
Human / unknown 9,714
Browser 4,309
Safari 2,658
Firefox 2,141
Edge 795
Opera 57
Internet Explorer 53
Samsung Browser 29
Dev Tools & Scripts 45,290
No User-Agent 33,500
curl 10,055
Go HTTP 1,421
Python HTTP 293
Java HTTP 16
Node.js HTTP 3
Ruby HTTP 1
wget 1
Headless Browsers 6
Headless Browser 6
ASN-identified Bots 7,807
Google (by ASN) 7,805
Anthropic (by ASN) 2
Top paths
| Path | Hits |
|---|---|
/ | 38,304 |
/blog/ | 2,299 |
/contact/ | 656 |
/about/ | 638 |
/resume/ | 637 |
/projects/ | 590 |
/wp-content/uploads/ | 378 |
/.well-known/ | 293 |
/robots.txt | 249 |
/resources/ | 219 |
/wp-content/ | 214 |
/cgi-bin/ | 203 |
/sitemap-main.xml | 178 |
/wp-includes/PHPMailer/ | 163 |
/wp-includes/images/ | 136 |
Countries
| Code | Hits |
|---|---|
| US | 69,771 |
| NL | 20,951 |
| FR | 17,042 |
| CA | 10,146 |
| KR | 9,541 |
| BR | 8,342 |
| DE | 7,441 |
| MX | 6,893 |
| HK | 6,325 |
| SG | 5,721 |
| IN | 5,375 |
| PL | 5,184 |
| AU | 4,871 |
| NO | 4,506 |
| CH | 4,327 |
Updated 1h ago. Aggregate data only — no visitor information shown.