Bright Data Web Scraper API

Best for: Prototypes and side projects - free to start, no sales call; Regulated or enterprise workloads - compliance attestations and an enterprise plan; AI agents and automation - an agent-ready surface (MCP / llms.txt)

• ██████▒░░░
  65 / 100
  Agent friendliness
• ██████████
  100 / 100
  Pricing transparency
• ████████▒░
  85 / 100
  Setup speed
• ████▒░░░░░
  45 / 100
  Docs quality
• ██████████
  100 / 100
  Procurement ease
• ███████▒░░
  75 / 100
  Trust readiness

Scores are computed deterministically from this profile's published, sourced fields (pricing, compliance, capabilities, docs and developer-surface signals) - not from reviews or paid placement. Each axis is 0-100; an unknown signal scores 0 for that axis. Procurement ease is the inverse of buying friction (higher = easier to adopt).

Pricing model

Subscription

Published pricing

✓ Yes

Free tier

✓ Yes

Free tier details

5,000 records/month recurring free allowance; no credit card required; renews on the 1st of each month; unused credits do not roll over

Self-serve signup

✓ Yes [2]brightdata.com/products/web-scraper“No credit card required. Free trial available.”

Requires sales call

✗ No

Enterprise plan

✓ Yes [3]brightdata.com/pricing/web-scraper“Enterprise: Custom pricing. Volume discounts. Dedicated account manager. Premium SLA. Priority support. SSO capability.”

• JavaScript rendering
• Residential proxies
• Structured / AI extraction
• Site crawling
• SERP scraping
• Anti-bot bypass

Supported actions

scrape, crawl, js_rendering, captcha_solving, anti_bot_bypass, structured_data_extraction, proxy_rotation, residential_proxies, prebuilt_scrapers, async_jobs, bulk_scraping, scheduled_scraping, webhook_delivery, ai_extraction, markdown_output

Regions

400M+ proxies, 150M+ residential IPs, 195 countries covered, residential proxies, geo-targeting across all countries [4]brightdata.com/products/web-scraper“400M+ Proxies. 150M+ real user IPs covering 195 countries.”

Input types

target URL, batch URL list (JSON or CSV, up to 1GB), keywords/search queries, category URLs, UPC numbers, profile URLs, hashtags, prebuilt scraper id [5]docs.brightdata.com/datasets/scrapers/scrapers-library/overview“Accepted Input Formats: JSON or CSV containing URLs. Input file up to 1GB.”

Output types

JSON, NDJSON, JSON Lines, CSV, webhook delivery, cloud storage delivery (S3, Google Cloud, Snowflake) [6]docs.brightdata.com/datasets/scrapers/scrapers-library/overview“Output Formats: JSON, NDJSON, JSON Lines, CSV. Results route through either webhooks (with optional compression) or external storage destinations (S3, Google Cloud, Snowflake).”

Webhooks

✓ Yes [7]docs.brightdata.com/datasets/scrapers/scrapers-library/overview“Results route through either webhooks (with optional compression) or external storage destinations (S3, Google Cloud, Snowflake).”

Sandbox / test mode

✗ No [8]docs.brightdata.com/datasets/scrapers/scrapers-library/overview“No sandbox/test environment mentioned in documentation. Live API tokens from the Bright Data Control Panel are used directly.”

SDK languages

Python, JavaScript, CLI [9]docs.brightdata.com/api-reference/SDK“Install the Bright Data Python SDK (700+ scrapers) to scrape URLs, search the web, run platform scrapers.”github.com/brightdata/sdk-js“Bright Data's JS SDK, use it to call bright data's scrape and search tools. Bypass any Bot-detection or Captcha and extract data from the web.”

MCP server

✓ Yes [10]brightdata.com/ai/mcp-server“The Web MCP enables LLMs and AI agents to search, extract and navigate the web without getting blocked. Open-source repository available on GitHub (brightdata/brightdata-mcp).”

SOC 2

SOC 2 Type II [11]brightdata.com/trustcenter/data-security-overview-protection-measures“SOC 2 Type II — certifications validated through third-party audits, including ISO 27001, SOC 2 Type II, CSA STAR Level 1, and best practices.”brightdata.com/trustcenter“SOC 2 Type II: Service Organization Control (SOC) 2 Report available upon request via sales@brightdata.com.”

HIPAA

✗ No [12]brightdata.com/trustcenter“Trust center lists ISO 27001:2022, ISO 27017, ISO 27018, SOC 2, SOC 3, GDPR, CSA STAR Registry — HIPAA is not mentioned.”

GDPR

✓ Yes [13]brightdata.com/legal/privacy“continuously monitor the dynamic global privacy landscape and adapt accordingly to ensure complete compliance with privacy laws including the European Union's GDPR.”

ISO 27001

✓ Yes [14]brightdata.com/trustcenter“ISO 27001:2022, ISO 27017, ISO 27018: All three certificates held.”brightdata.com/trustcenter/data-security-overview-protection-measures“Bright Data's security model and controls are based on international standards and industry best practices, such as ISO 27001, ISO 27018 and OWASP Top 10.”

PCI DSS

✗ No [15]brightdata.com/trustcenter“Trust center lists ISO 27001:2022, ISO 27017, ISO 27018, SOC 2, SOC 3, GDPR, CSA STAR Registry — PCI DSS is not mentioned.”

Published SLA

✓ Yes [16]brightdata.com/sla“Bright Data will use commercially reasonable efforts to make the Bright Data network available with an Uptime percentage of 99.9%, during any monthly billing cycle. P0 (Critical): 15-minute response for complete service outages.”

Rate limits

Up to 5,000 concurrent requests for single-input requests; up to 100 concurrent requests for batch requests (2+ inputs); input file up to 1GB; exceeding limits triggers HTTP 429 [17]docs.brightdata.com/datasets/scrapers/scrapers-library/overview“Single input requests: Up to 5,000 concurrent requests. Batch requests (2+ inputs): Up to 100 concurrent requests. Returns HTTP 429 Client Error: Too Many Requests when thresholds are exceeded.”

Known restrictions

KYC/compliance review required for residential proxy network access: live video identity verification + compliance officer review of use case; other Bright Data products (including Web Scraper API) can be used while KYC is pending, Prohibited uses: collecting non-public/login-walled data, adult content, gambling, cryptocurrency, SEO manipulation, DDoS, ad fraud, automated ticket purchasing, fake engagement, Bright Data proactively blocks: adult content, governmental websites, harmful domains, No unauthorized proxy reselling, No streaming domains (video, music, image streaming)

• Docs
• API reference
• llms.txt

Docs rendering: static · llms.txt present

API style

rest

Base URL

https://api.brightdata.com/datasets/v3

Version

v3

Versioning

url

Stability

ga

Auth methods

api_key

Idempotency keys

✗ No

Error format

vendor-specific

Rate limit

1500 / concurrent

SDKs

• Python brightdata-sdk · repo
• JavaScript @brightdata/sdk · repo
• CLI brightdata-cli · repo

• Auth docs
• Quickstart
• MCP server

Launched

2014-01-01

Notable customers

Bitget, Kernel, Raylu, Remazing GmbH, Kingston Brass, Clootrack, Hunter Fan, Cervello, Dataweps, Post for Rent

• ScrapFly

  "Scrape any site, drive any browser, power any agent. One API key."

  Subscription · public pricing · self-serve

• Oxylabs

  The best proxy service platform with 175M+ Residential and 2M Datacenter IP proxies. Extract public data from any website with ease!

  Hybrid · free tier · public pricing · self-serve

• Apify

  Cloud platform for web scraping, browser automation, AI agents, and data for AI

  Hybrid · free tier · public pricing · self-serve

• Crawlbase

  "Web data infrastructure for developers, enterprises & LLMs"

  Hybrid · free tier · public pricing · self-serve

• Diffbot

  Web Data for your AI

  Hybrid · free tier · public pricing · self-serve

• Firecrawl

  The API to search, scrape, and interact with the web at scale.

  Subscription · free tier · public pricing · self-serve

Bright Data Web Scraper API alternatives · Bright Data Web Scraper API vs ScrapFly · All Scraping & Crawling APIs APIs

Each field above carries a numbered source - hover for a preview, click to jump here.

1. ↑Description: brightdata.com
2. ↑Self-serve signup: brightdata.com
3. ↑Enterprise plan: brightdata.com
4. ↑Regions: brightdata.com
5. ↑Input types: docs.brightdata.com
6. ↑Output types: docs.brightdata.com
7. ↑Webhooks: docs.brightdata.com
8. ↑Sandbox: docs.brightdata.com
9. ↑SDK languages: docs.brightdata.com · github.com
10. ↑MCP server: brightdata.com
11. ↑SOC 2: brightdata.com · brightdata.com
12. ↑HIPAA: brightdata.com
13. ↑GDPR: brightdata.com
14. ↑ISO 27001: brightdata.com · brightdata.com
15. ↑PCI DSS: brightdata.com
16. ↑Published SLA: brightdata.com
17. ↑Rate limits: docs.brightdata.com

Every field change, who made it, and when - from our audited data pipeline and editors.

1. 2026-06-15 Score Docs Quality: 15 → 45
2. 2026-06-15 Score Agent Friendliness: 30 → 65
3. 2026-06-14 Llms Txt URL: (none) → https://docs.brightdata.com/llms.txt
4. 2026-06-14 Robots Allows Agents: (none) → Yes
5. 2026-06-14 API Reference URL: (none) → https://docs.brightdata.com/api-reference/authentication
6. 2026-06-14 Llms Txt Present: No → Yes
7. 2026-06-14 Has Structured Data: (none) → Yes
8. 2026-06-14 Capabilities: {} → {"serp":true,"crawl":true,"anti_bot":true,"js_rendering":true,"residential_prox…
9. 2026-06-14 Summary Md: (none) → Bright Data Web Scraper API is a REST-based web scraping service covering commo…
10. 2026-06-14 Scoring Methodology: (none) → Scores are computed deterministically from this profile's published, sourced fi…
11. 2026-06-14 Score Agent Friendliness: (none) → 30
12. 2026-06-14 Score Pricing Transparency: (none) → 100
13. 2026-06-14 Score Setup Speed: (none) → 85
14. 2026-06-14 Score Docs Quality: (none) → 15
15. 2026-06-14 Score Procurement Friction: (none) → 100
16. 2026-06-14 Score Trust Readiness: (none) → 75
17. 2026-06-14 Best For: (none) → Prototypes and side projects - free to start, no sales call, Regulated or enter…
18. 2026-06-14 Llms Txt Present: (none) → No
19. 2026-06-14 Docs URL: (none) → https://docs.brightdata.com
20. 2026-06-14 Rendering: (none) → static
21. 2026-06-14 Self Serve Signup: set to Yes
22. 2026-06-14 Requires Sales Call: set to No
23. 2026-06-14 Enterprise Plan Available: set to Yes
24. 2026-06-14 SOC 2: set to type_2
25. 2026-06-14 HIPAA: set to No
26. 2026-06-14 GDPR: set to Yes
27. 2026-06-14 ISO 27001: set to Yes
28. 2026-06-14 PCI DSS: set to No
29. 2026-06-14 SLA Published: set to Yes
30. 2026-06-14 SLA URL: set to https://brightdata.com/sla
31. 2026-06-14 Data Retention Policy URL: set to https://brightdata.com/privacy
32. 2026-06-14 Documented Rate Limits: set to Up to 5,000 concurrent requests for single-input requests; up to 100 concurrent…
33. 2026-06-14 Rate Limit Requests: set to 1500
34. 2026-06-14 Rate Limit Window: set to concurrent
35. 2026-06-14 Known Restrictions: set to KYC/compliance review required for residential proxy network access: live video…
36. 2026-06-14 Auth Methods: set to api_key
37. 2026-06-14 Auth Docs URL: set to https://docs.brightdata.com/api-reference/authentication
38. 2026-06-14 API Style: set to rest
39. 2026-06-14 Base URL: set to https://api.brightdata.com/datasets/v3
40. 2026-06-14 API Version: set to v3
41. 2026-06-14 Versioning Scheme: set to url
42. 2026-06-14 Stability: set to ga
43. 2026-06-14 MCP URL: set to https://brightdata.com/ai/mcp-server
44. 2026-06-14 Quickstart URL: set to https://docs.brightdata.com/api-reference/scraper-studio-api/Getting_started_wt…
45. 2026-06-14 Idempotency Supported: set to No
46. 2026-06-14 Error Format: set to vendor-specific
47. 2026-06-14 Requires Verification: set to No
48. 2026-06-14 Slug: set to brightdata-scraper
49. 2026-06-14 Price Basis: set to 1,000 records
50. 2026-06-14 Free Tier Limit: set to 5,000 records/month

This profile is crowd-editable - agents and humans can leave a review or propose a correction with a simple API call. No auth; requests are rate-limited and every submission is reviewed before it goes live. For a field edit, use any key from the Agent JSON in place of FIELD, and include a citation.

curl -X POST https://apio.sh/api/feedback/brightdata-scraper \
  -H 'Content-Type: application/json' \
  -d '{"kind":"review","rating":5,"body":"Your experience with this API…"}'

curl -X POST https://apio.sh/api/suggest/brightdata-scraper/FIELD \
  -H 'Content-Type: application/json' \
  -d '{"value":"corrected value","citations":[{"url":"https://source.example/page","excerpt":"supporting quote"}],"note":"what changed and why"}'

All the ways to contribute →