What crawls this site?
A live look at every bot, crawler, and scanner that has visited leedriggers.com — search engines, AI crawlers, SEO tools, and everything else that shows up.
195,883Total requests
76Distinct bots
20Paths hit
15Countries
Activity (last 30 days)
Chrome No User-Agent Other bot Scanner / probe curl Human / unknown Google (by ASN) Browser
Distribution Breakdown
Traffic by Bot Segment
<1% Search Engines
5% AI Crawlers
2% SEO Tools
<1% Social / Fetchers
8% Scanners & Probes
14% Other / Unclassified
44% Human / Browser
22% Dev Tools & Scripts
Search Engine Share
52% Googlebot
21% Bingbot
10% Applebot
7% Baiduspider
5% YandexBot
3% SeznamBot
<1% DuckDuckBot
<1% MojeekBot
AI Crawler Share
21% ClaudeBot
15% Perplexity (User)
10% PetalBot
9% Amazonbot
7% ChatGPT (User)
7% GPTBot
5% OpenAI SearchBot
2% PerplexityBot
Content Types Targeted
98% HTML / Pages
<1% XML Data
<1% Robots / TXT
<1% Other
Most Crawled Paths
84% /
5% /blog/
1% /resume/
1% /contact/
1% /about/
1% /projects/
<1% /wp-content/uploads/
<1% /.well-known/
Top Origin Countries
37% US
10% NL
10% FR
6% CA
5% KR
5% BR
4% DE
4% MX
Infrastructure & Velocity
7-Day Rolling Velocity
Total crawl volume over the last week.
Crawler Controls
Hits checking permissions & site structures.
robots.txt249
*.xml (Sitemaps)178
/sitemap-main.xml178ASN Identifications
Known company IP ranges matched by network block — not user-agent. These crawlers deliberately omit or rotate their UA string.
Google 6,395 hits
Anthropic 2 hits
Bot Directory
Search Engines 1,827 hits
Googlebot 954
Bingbot 391
Applebot 186
Baiduspider 132
YandexBot 97
SeznamBot 56
DuckDuckBot 7
MojeekBot 4
AI Crawlers 10,000 hits
ClaudeBot 2,056
Perplexity (User) 1,489
PetalBot 1,031
Amazonbot 861
ChatGPT (User) 709
GPTBot 664
OpenAI SearchBot 469
PerplexityBot 225
Amzn SearchBot 208
Meta (Scraper) 206
Google Extended 197
Bytespider 168
You.com 165
Claude (User) 164
CCBot 159
DeepSeekBot 159
Claude SearchBot 154
Kimi SearchBot 142
ChatGLM Spider 123
KimiBot 121
Cohere 119
Mistral (User) 106
DuckAssist 104
PanguBot 92
GoogleOther 80
Claude Code 8
Diffbot 8
Applebot Extended 6
xAI (Grok) 5
Google VertexBot 2
Other Bot Segments
SEO tools, social fetchers, scanners, and unclassified traffic. "Other / Unclassified" includes UAs that don't match any of the 1,200+ known bot signatures — typically generic scrapers, headless browsers, or truly blank user-agents.
SEO Tools 4,051
AhrefsBot 2,592
SemrushBot 469
MajesticBot 448
Barkrowler 224
MozBot 164
Screaming Frog 147
DataForSEO 6
SeobilityBot 1
Social / Fetchers 177
Facebook 65
Telegram 34
Twitterbot 22
Discordbot 17
LinkedInBot 14
WhatsApp 13
Slackbot 12
Scanners & Probes 14,912
Scanner / probe 14,888
Security Scanner 24
Other / Unclassified 28,204
Other bot 28,204
Human / Browser 86,906
Chrome 68,817
Human / unknown 9,714
Browser 3,687
Safari 2,242
Firefox 1,831
Edge 545
Opera 47
Samsung Browser 21
Internet Explorer 2
Dev Tools & Scripts 43,403
No User-Agent 32,240
curl 9,986
Go HTTP 876
Python HTTP 280
Java HTTP 16
Node.js HTTP 3
Ruby HTTP 1
wget 1
Headless Browsers 6
Headless Browser 6
ASN-identified Bots 6,397
Google (by ASN) 6,395
Anthropic (by ASN) 2
Top paths
| Path | Hits |
|---|---|
/ | 33,839 |
/blog/ | 2,041 |
/resume/ | 580 |
/contact/ | 545 |
/about/ | 541 |
/projects/ | 520 |
/wp-content/uploads/ | 343 |
/.well-known/ | 262 |
/robots.txt | 249 |
/resources/ | 199 |
/wp-content/ | 199 |
/cgi-bin/ | 179 |
/sitemap-main.xml | 178 |
/wp-includes/PHPMailer/ | 142 |
/wp-includes/images/ | 110 |
Countries
| Code | Hits |
|---|---|
| US | 64,018 |
| NL | 17,720 |
| FR | 16,810 |
| CA | 10,131 |
| KR | 9,332 |
| BR | 8,291 |
| DE | 6,619 |
| MX | 6,559 |
| HK | 6,115 |
| IN | 4,650 |
| SG | 4,600 |
| NO | 4,503 |
| SE | 4,185 |
| JP | 4,115 |
| CH | 4,020 |
Updated 2h ago. Aggregate data only — no visitor information shown.