What crawls this site?
A live look at every bot, crawler, and scanner that has visited leedriggers.com — search engines, AI crawlers, SEO tools, and everything else that shows up.
194,331Total requests
76Distinct bots
20Paths hit
15Countries
Activity (last 30 days)
Chrome No User-Agent Other bot Scanner / probe curl Human / unknown Google (by ASN) Browser
Distribution Breakdown
Traffic by Bot Segment
<1% Search Engines
5% AI Crawlers
2% SEO Tools
<1% Social / Fetchers
8% Scanners & Probes
14% Other / Unclassified
44% Human / Browser
22% Dev Tools & Scripts
Search Engine Share
52% Googlebot
21% Bingbot
10% Applebot
7% Baiduspider
5% YandexBot
3% SeznamBot
<1% DuckDuckBot
<1% MojeekBot
AI Crawler Share
21% ClaudeBot
15% Perplexity (User)
10% PetalBot
9% Amazonbot
7% ChatGPT (User)
7% GPTBot
5% OpenAI SearchBot
2% PerplexityBot
Content Types Targeted
98% HTML / Pages
<1% XML Data
<1% Robots / TXT
<1% Other
Most Crawled Paths
84% /
5% /blog/
1% /resume/
1% /contact/
1% /about/
1% /projects/
<1% /wp-content/uploads/
<1% /.well-known/
Top Origin Countries
37% US
10% NL
10% FR
6% CA
5% KR
5% BR
4% DE
4% MX
Infrastructure & Velocity
7-Day Rolling Velocity
Total crawl volume over the last week.
Crawler Controls
Hits checking permissions & site structures.
robots.txt249
*.xml (Sitemaps)178
/sitemap-main.xml178ASN Identifications
Known company IP ranges matched by network block — not user-agent. These crawlers deliberately omit or rotate their UA string.
Google 6,365 hits
Anthropic 2 hits
Bot Directory
Search Engines 1,798 hits
Googlebot 937
Bingbot 386
Applebot 183
Baiduspider 130
YandexBot 97
SeznamBot 54
DuckDuckBot 7
MojeekBot 4
AI Crawlers 9,934 hits
ClaudeBot 2,053
Perplexity (User) 1,489
PetalBot 1,025
Amazonbot 848
ChatGPT (User) 707
GPTBot 663
OpenAI SearchBot 465
PerplexityBot 223
Amzn SearchBot 208
Meta (Scraper) 202
Google Extended 197
Bytespider 164
You.com 163
Claude (User) 161
DeepSeekBot 156
CCBot 153
Claude SearchBot 150
Kimi SearchBot 138
ChatGLM Spider 121
Cohere 119
KimiBot 119
Mistral (User) 106
DuckAssist 103
PanguBot 92
GoogleOther 80
Claude Code 8
Diffbot 8
Applebot Extended 6
xAI (Grok) 5
Google VertexBot 2
Other Bot Segments
SEO tools, social fetchers, scanners, and unclassified traffic. "Other / Unclassified" includes UAs that don't match any of the 1,200+ known bot signatures — typically generic scrapers, headless browsers, or truly blank user-agents.
SEO Tools 4,030
AhrefsBot 2,584
SemrushBot 466
MajesticBot 448
Barkrowler 216
MozBot 162
Screaming Frog 147
DataForSEO 6
SeobilityBot 1
Social / Fetchers 177
Facebook 65
Telegram 34
Twitterbot 22
Discordbot 17
LinkedInBot 14
WhatsApp 13
Slackbot 12
Scanners & Probes 14,887
Scanner / probe 14,863
Security Scanner 24
Other / Unclassified 27,958
Other bot 27,958
Human / Browser 86,123
Chrome 68,073
Human / unknown 9,714
Browser 3,664
Safari 2,232
Firefox 1,827
Edge 543
Opera 47
Samsung Browser 21
Internet Explorer 2
Dev Tools & Scripts 43,051
No User-Agent 31,898
curl 9,980
Go HTTP 874
Python HTTP 278
Java HTTP 16
Node.js HTTP 3
Ruby HTTP 1
wget 1
Headless Browsers 6
Headless Browser 6
ASN-identified Bots 6,367
Google (by ASN) 6,365
Anthropic (by ASN) 2
Top paths
| Path | Hits |
|---|---|
/ | 33,576 |
/blog/ | 2,033 |
/resume/ | 577 |
/contact/ | 542 |
/about/ | 536 |
/projects/ | 518 |
/wp-content/uploads/ | 340 |
/.well-known/ | 259 |
/robots.txt | 249 |
/wp-content/ | 198 |
/resources/ | 196 |
/cgi-bin/ | 179 |
/sitemap-main.xml | 178 |
/wp-includes/PHPMailer/ | 139 |
/wp-includes/images/ | 108 |
Countries
| Code | Hits |
|---|---|
| US | 63,657 |
| NL | 17,630 |
| FR | 16,798 |
| CA | 10,130 |
| KR | 9,111 |
| BR | 8,286 |
| DE | 6,613 |
| MX | 6,559 |
| HK | 6,029 |
| SG | 4,592 |
| NO | 4,503 |
| IN | 4,423 |
| SE | 4,181 |
| JP | 4,031 |
| CH | 4,020 |
Updated 4h ago. Aggregate data only — no visitor information shown.