ScrapFly

Best for: Regulated or enterprise workloads - compliance attestations and an enterprise plan; AI agents and automation - an agent-ready surface (MCP / llms.txt); Teams needing broad API coverage out of the box

Avoid if: You want to try it free before paying

• ██████▒░░░
  65 / 100
  Agent friendliness
• ████████▒░
  85 / 100
  Pricing transparency
• ██████░░░░
  60 / 100
  Setup speed
• ████▒░░░░░
  45 / 100
  Docs quality
• ████████▒░
  85 / 100
  Procurement ease
• ███████░░░
  70 / 100
  Trust readiness

Scores are computed deterministically from this profile's published, sourced fields (pricing, compliance, capabilities, docs and developer-surface signals) - not from reviews or paid placement. Each axis is 0-100; an unknown signal scores 0 for that axis. Procurement ease is the inverse of buying friction (higher = easier to adopt).

Pricing model

Subscription

Published pricing

✓ Yes

Free tier

✗ No [2]scrapfly.io/pricing“1,000 API credits on signup, designed for discovery, hobby, and evaluation use cases.”scrapfly.io/register“Get 1,000 free API credits instantly. No credit card required.”

Free tier details

1,000 API credits on signup with no credit card required and no expiry; described as for 'discovery, hobby, and evaluation use cases.' No published evidence that credits recur monthly - treated as a one-time trial allowance.

Self-serve signup

✓ Yes [3]scrapfly.io/register“Get 1,000 free API credits instantly. No credit card required.”

Requires sales call

✗ No

Enterprise plan

✓ Yes [4]scrapfly.io/pricing“Enterprise $500 / 5,500,000 credits; Custom $1,200–$30,000+ / Negotiated”

• JavaScript rendering
• Residential proxies
• Structured / AI extraction
• Site crawling
• SERP scraping
• Anti-bot bypass

Supported actions

scrape, js_rendering, anti_bot_bypass, captcha_solving, proxy_rotation, residential_proxies, datacenter_proxies, screenshot, structured_data_extraction, ai_extraction, markdown_output, async_jobs, crawl, scraping_browser, prebuilt_scrapers, session_management, custom_headers, caching [5]scrapfly.io/docs/scrape-api/billing“Browser Rendering (render_js=true): +5 credits per request”scrapfly.io/products/web-scraping-api“20+ vendors handled (Cloudflare, DataDome, Akamai, PerimeterX, Kasada, F5, AWS WAF, more) with one asp=true flag.”

Regions

190+ countries for overall geo-targeting, 80 countries for datacenter proxy pool, 80 countries for residential proxy pool, 20 countries for Tor proxy pool, Automatic IP rotation and cooling, Geo-targeting via country parameter, Session sticky proxies supported [6]scrapfly.io/products/web-scraping-api“190+ countries with datacenter and residential pool options.”scrapfly.io/docs/scrape-api/proxy“Datacenter Proxies: 80 countries available. Residential Proxies: 80 countries available. Tor Proxies: 20 countries available.”

Input types

target URL, custom headers, country/geo, render JS flag, extraction schema/prompt, CSS/XPath selectors, JavaScript injection, proxy pool selection, cost budget, webhook name, session name

Output types

raw HTML, rendered HTML, Markdown, JSON (structured), plain text, screenshot (PNG), WARC archives, LLM-ready data, parsed fields

Webhooks

✓ Yes [7]scrapfly.io/docs/scrape-api/webhook“Scrapfly's webhook feature enables asynchronous scrape task management. When you specify a webhook_name parameter in scrape requests, the system immediately returns a promise response and calls your webhook endpoint once scraping completes.”

Sandbox / test mode

✗ No [8]scrapfly.io/docs/scrape-api/faq“The FAQ mentions the Web API Player for estimation and testing, but there is no explicit designation of a sandbox environment or separate test mode.”

SDK languages

Python, TypeScript, Go, Rust [9]scrapfly.io/docs“Officially supported SDKs: Python (Most Popular), TypeScript (Type-safe), Go (Fast), Rust (New), Scrapy Framework integration.”

MCP server

✓ Yes [10]scrapfly.io/docs/mcp/authentication“The server enables programmatic web scraping capabilities through the Model Context Protocol, allowing AI assistants to access Scrapfly's data extraction services.”scrapfly.io/docs“MCP Server — NEW — Connect AI models to live web data with zero configuration via the MCP protocol.”

SOC 2

SOC 2 Type II [11]scrapfly.io/compliance“SOC 2 Type II: Independent audit of security, availability, and confidentiality controls over an extended period.”

HIPAA

✓ Yes [12]scrapfly.io/compliance“HIPAA: Safeguards for Protected Health Information (PHI) aligned with the HIPAA Security and Privacy Rules.”

GDPR

✓ Yes [13]scrapfly.io/compliance“GDPR: EU General Data Protection Regulation. Standard DPA applies to every account. Personalized SCCs (EU Module 2 / Module 3).”

ISO 27001

✓ Yes [14]scrapfly.io/compliance“ISO 27001: International standard for information security management. A systematic, risk-based approach to protecting sensitive information.”

PCI DSS

✗ No [15]scrapfly.io/compliance“PCI DSS not mentioned in the compliance documentation. Certifications listed: SOC 2 Type II, ISO 27001, HIPAA, GDPR, CCPA/CPRA.”

Published SLA

✗ No [16]scrapfly.io/compliance“No service level agreement or uptime guarantee is published in this compliance documentation. The page focuses exclusively on security certifications, data protection controls, and legal agreements.”

Rate limits

Concurrency limits by plan: Free=5, Discovery=5, Pro=20, Startup=50, Enterprise=100, Custom=negotiated. Webhook queue sizes: FREE=0, DISCOVERY=500, PRO=2,000, STARTUP=5,000, ENTERPRISE=10,000. No per-second request rate limit published. [17]scrapfly.io/pricing“Concurrency Limits: Free=5, Discovery=5, Pro=20, Startup=50, Enterprise=100”scrapfly.io/docs/scrape-api/webhook“Webhook queue sizes vary by plan (FREE: 0, DISCOVERY: 500, PRO: 2,000, STARTUP: 5,000, ENTERPRISE: 10,000)”

Known restrictions

KYC/compliance review: every account goes through identity verification before activation - ~30% of signup inquiries are declined annually, Prohibited targets (no opt-in path): government portals, banking services, credential systems for fraud, CAPTCHA bypass for fraudulent purposes, sneaker bots, unauthorized security scanning, Multiple account creation to bypass KYC is not possible, Free plan hard-capped at 1,000 credits with no overage, Discovery plan hard-capped at quota (no overage), Fairness policy: if >30% of traffic with eligible error codes (>=400) fails within one hour, success-only billing is suspended for that window, Formal SLA (uptime guarantee) only available at $50,000/month minimum spend, JavaScript rendering is GET requests only (no POST/PATCH/PUT)

• Docs
• API reference
• llms.txt

Docs rendering: static · llms.txt present

API style

rest

Base URL

https://api.scrapfly.io/scrape

Versioning

none

Stability

ga

Auth methods

api_key, oauth2

Error format

vendor-specific

Webhook signing

HMAC-SHA256

Rate limit

5 / concurrent

SDKs

• Python scrapfly-sdk · repo
• TypeScript scrapfly-sdk · repo
• Go github.com/scrapfly/go-scrapfly · repo
• Rust scrapfly-sdk · repo

• Auth docs
• Quickstart
• MCP server
• Webhook events

Launched

2020-01-01

GA

2020-01-01

• Bright Data Web Scraper API

  "The most reliable Web Scraping API. Scrape any website with automatic proxy rotation, anti-bot bypass, and JavaScript rendering."

  Subscription · free tier · public pricing · self-serve

• Oxylabs

  The best proxy service platform with 175M+ Residential and 2M Datacenter IP proxies. Extract public data from any website with ease!

  Hybrid · free tier · public pricing · self-serve

• Apify

  Cloud platform for web scraping, browser automation, AI agents, and data for AI

  Hybrid · free tier · public pricing · self-serve

• Crawlbase

  "Web data infrastructure for developers, enterprises & LLMs"

  Hybrid · free tier · public pricing · self-serve

• Diffbot

  Web Data for your AI

  Hybrid · free tier · public pricing · self-serve

• Firecrawl

  The API to search, scrape, and interact with the web at scale.

  Subscription · free tier · public pricing · self-serve

ScrapFly alternatives · ScrapFly vs Bright Data Web Scraper API · All Scraping & Crawling APIs APIs

Each field above carries a numbered source - hover for a preview, click to jump here.

1. ↑Description: scrapfly.io
2. ↑Free tier: scrapfly.io · scrapfly.io
3. ↑Self-serve signup: scrapfly.io
4. ↑Enterprise plan: scrapfly.io
5. ↑Supported actions: scrapfly.io · scrapfly.io
6. ↑Regions: scrapfly.io · scrapfly.io
7. ↑Webhooks: scrapfly.io
8. ↑Sandbox: scrapfly.io
9. ↑SDK languages: scrapfly.io
10. ↑MCP server: scrapfly.io · scrapfly.io
11. ↑SOC 2: scrapfly.io
12. ↑HIPAA: scrapfly.io
13. ↑GDPR: scrapfly.io
14. ↑ISO 27001: scrapfly.io
15. ↑PCI DSS: scrapfly.io
16. ↑Published SLA: scrapfly.io
17. ↑Rate limits: scrapfly.io · scrapfly.io

Every field change, who made it, and when - from our audited data pipeline and editors.

1. 2026-06-15 Score Agent Friendliness: 45 → 65
2. 2026-06-15 Score Docs Quality: 25 → 45
3. 2026-06-14 API Reference URL: (none) → https://docs.scrapfly.io/docs
4. 2026-06-14 Llms Txt URL: https://scrapfly.io/llms.txt → https://docs.scrapfly.io/llms.txt
5. 2026-06-14 Robots Allows Agents: (none) → Yes
6. 2026-06-14 Has Structured Data: (none) → Yes
7. 2026-06-14 Capabilities: {} → {"serp":true,"crawl":true,"anti_bot":true,"js_rendering":true,"residential_prox…
8. 2026-06-14 Summary Md: (none) → ScrapFly is a web scraping API that handles JavaScript rendering, anti-bot bypa…
9. 2026-06-14 Score Docs Quality: (none) → 25
10. 2026-06-14 Score Procurement Friction: (none) → 85
11. 2026-06-14 Score Trust Readiness: (none) → 70
12. 2026-06-14 Best For: (none) → Regulated or enterprise workloads - compliance attestations and an enterprise p…
13. 2026-06-14 Avoid If: (none) → You want to try it free before paying
14. 2026-06-14 Scoring Methodology: (none) → Scores are computed deterministically from this profile's published, sourced fi…
15. 2026-06-14 Score Setup Speed: (none) → 60
16. 2026-06-14 Score Pricing Transparency: (none) → 85
17. 2026-06-14 Score Agent Friendliness: (none) → 45
18. 2026-06-14 Docs URL: (none) → https://docs.scrapfly.io
19. 2026-06-14 Rendering: (none) → static
20. 2026-06-14 Llms Txt URL: (none) → https://scrapfly.io/llms.txt
21. 2026-06-14 Llms Txt Present: (none) → Yes
22. 2026-06-14 Self Serve Signup: set to Yes
23. 2026-06-14 Requires Sales Call: set to No
24. 2026-06-14 Enterprise Plan Available: set to Yes
25. 2026-06-14 SOC 2: set to type_2
26. 2026-06-14 HIPAA: set to Yes
27. 2026-06-14 GDPR: set to Yes
28. 2026-06-14 ISO 27001: set to Yes
29. 2026-06-14 PCI DSS: set to No
30. 2026-06-14 Data Retention Policy URL: set to https://scrapfly.io/privacy-policy
31. 2026-06-14 Documented Rate Limits: set to Concurrency limits by plan: Free=5, Discovery=5, Pro=20, Startup=50, Enterprise…
32. 2026-06-14 Rate Limit Requests: set to 5
33. 2026-06-14 Rate Limit Window: set to concurrent
34. 2026-06-14 Known Restrictions: set to KYC/compliance review: every account goes through identity verification before …
35. 2026-06-14 Auth Methods: set to api_key, oauth2
36. 2026-06-14 Auth Docs URL: set to https://scrapfly.io/docs/scrape-api/getting-started
37. 2026-06-14 API Style: set to rest
38. 2026-06-14 Base URL: set to https://api.scrapfly.io/scrape
39. 2026-06-14 Versioning Scheme: set to none
40. 2026-06-14 Stability: set to ga
41. 2026-06-14 MCP URL: set to https://mcp.scrapfly.io/mcp
42. 2026-06-14 Quickstart URL: set to https://scrapfly.io/docs/scrape-api/getting-started
43. 2026-06-14 Error Format: set to vendor-specific
44. 2026-06-14 Webhook Signing: set to HMAC-SHA256
45. 2026-06-14 Webhook Events URL: set to https://scrapfly.io/docs/scrape-api/webhook
46. 2026-06-14 Requires Verification: set to Yes
47. 2026-06-14 Starting Price Usd: set to 30
48. 2026-06-14 Price Basis: set to month
49. 2026-06-14 Slug: set to scrapfly
50. 2026-06-14 Launched At: set to 2020-01-01

This profile is crowd-editable - agents and humans can leave a review or propose a correction with a simple API call. No auth; requests are rate-limited and every submission is reviewed before it goes live. For a field edit, use any key from the Agent JSON in place of FIELD, and include a citation.

curl -X POST https://apio.sh/api/feedback/scrapfly \
  -H 'Content-Type: application/json' \
  -d '{"kind":"review","rating":5,"body":"Your experience with this API…"}'

curl -X POST https://apio.sh/api/suggest/scrapfly/FIELD \
  -H 'Content-Type: application/json' \
  -d '{"value":"corrected value","citations":[{"url":"https://source.example/page","excerpt":"supporting quote"}],"note":"what changed and why"}'

All the ways to contribute →