← Back to browse

CrawlAPI

Turn any URL into clean markdown or structured data. Built for AI agents, LangChain, CrewAI, and OpenAI Assistants. Start free on RapidAPI.

62% unique tagline

crawlapi.net · Added April 10, 2026 · Last analysed April 10, 2026· via Product Hunt

Screenshot of CrawlAPI
This analysis is a snapshot taken on 10 April 2026. The site may have changed since then and results may not reflect its current state.
4.5
StackScope Score
Fair
11/100 Vibe Score
Few AI signals
35/100 Launch Readiness
Partially ready
0/6 Security Headers
Poor
open
AI Stance
Welcomes AI crawlers

Tech Stack (4)

Infrastructure
Cloudflare http_header_name
Cloudflare DNS ns_host
HTTP/3 http_header_value
Build & Framework
Express http_header_value

Infrastructure

Hosting
AS13335 · US
SSL Certificate
Let's Encrypt
Expires 7 Jul 2026
Domain Age
4 days
Registered Apr 2026 · Cloudflare, Inc.

Readiness Breakdown How?

✓ Responsive viewport meta tag
✓ Custom title and meta description
✓ Semantic HTML (nav, main, article)
- Open Graph tags (title, image, description)
- Canonical URL declared
- Source maps not exposed in production
- Error tracking service installed
- Privacy policy page present
- Twitter card meta tags
- Favicon present

Vibe Score Breakdown How?

SignalPoints
Copy style patterns +5
Writing style patterns +3
Content style patterns +3

This score is based on structural patterns and is not definitive. Many legitimate sites may trigger signals, and AI-built sites may go undetected. It should be treated as an indicator, not a verdict.

Well-Known Files

✓ robots.txt
✓ llms.txt
✗ security.txt
✓ sitemap.xml
✗ ads.txt
✗ humans.txt

Legal

? Privacy Policy not detected
? Terms of Service not detected
Detection works best on English language sites.

Security Headers (0/6)

✗ Referrer-Policy
✗ X-Frame-Options
✗ Permissions-Policy
✗ X-Content-Type-Options
✗ Content-Security-Policy
✗ Strict-Transport-Security
– X-XSS-Protection (legacy)

Performance

101ms response time
Faster than 92% of sites

Build

✗ HTML minified
0 JS files
0 Third-party domains
Is this your site? 5 tips to improve your score
- Add a privacy policy. Free generators like Termly or Iubenda can create one in minutes.
- Add a /.well-known/security.txt so security researchers can reach you. Learn more
- Improve your security headers. Scan your site at securityheaders.com to see what's missing.
- Add Open Graph tags so your site looks good when shared on social media. Learn more
- Add a <link rel="canonical"> tag to prevent duplicate content issues. Learn more
Embed this score on your site
StackScope Score 
<a href="https://stackscope.dev/launch/8axxe9fr/crawlapi"><img src="https://stackscope.dev/badge/8axxe9fr.svg" alt="StackScope Score" height="28" /></a>