Diffbot

Best for: Prototypes and side projects - free to start, no sales call; AI agents and automation - an agent-ready surface (MCP / llms.txt); Teams needing broad API coverage out of the box

Avoid if: You have strict compliance requirements

Pricing model

Hybrid (base + usage) [2]diffbot.com/pricing/devtune.ai/verticals/web-data-infrastructure-for-ai/diffbot/pricing“Diffbot offers four tiers billed monthly with no contracts required. Free: $0/month, 10,000 credits, full API access, 5 calls/minute.”

Published pricing

✓ Yes [3]diffbot.com/pricing/“Free $0/mo”xpay.sh/saas-pricing/diffbot/“Diffbot pricing starts at $0/mo for the Free plan; paid plans up to $899/mo. Billed monthly.”

Free tier

✓ Yes [4]diffbot.com/pricing/“Free $0/mo each plan is subject to API rate limits.”

Free tier details

Free forever. 10,000 credits/month, 5 calls/min. No credit card required. [5]diffbot.com/pricing/“Free $0/mo each plan is subject to API rate limits.”devtune.ai/verticals/web-data-infrastructure-for-ai/diffbot/pricing“Free: $0/month, 10,000 credits, full API access, 5 calls/minute.”

Self-serve signup

✓ Yes [6]diffbot.com/pricing/“Free $0/mo”docs.diffbot.com/reference/authentication“All Diffbot APIs are authenticated via token.”

Requires sales call

✗ No [7]diffbot.com/pricing/“Free $0/mo”docs.diffbot.com/reference/authentication“All Diffbot APIs are authenticated via token.”

Enterprise plan

✓ Yes [8]diffbot.com/pricing/devtune.ai/verticals/web-data-infrastructure-for-ai/diffbot/pricing“Diffbot offers four tiers billed monthly with no contracts required.”

Minimum commitment

No contracts required [9]diffbot.com/pricing/“No contracts required.”

• Structured / AI extraction
• Site crawling

Supported actions

extract_analyze, extract_article, extract_discussion, extract_event, extract_image, extract_job, extract_list, extract_product, extract_video, enhance_get, enhance_post, bulk_enhance, knowledge_graph_search, knowledge_graph_combine, create_crawl, manage_crawl_job, retrieve_crawl_job_data, search_crawl_job_data, create_bulkjob, download_bulkjob_results, poll_bulkjob_status, list_bulkjobs_for_token, download_bulkjob_coverage_report, delete_bulkjob, download_single_bulkjob_result, stop_bulkjob, create_or_update_custom_api, custom_api_rulesets, extract_with_custom_api, delete_custom_api, retrieve_custom_apis, extract_content_not_available_online, extract_custom_headers, extract_custom_javascript [10]docs.diffbot.com/reference/extract-analyze“Automatically classify a page and extract data according to its type.”docs.diffbot.com/reference/event“Automatically extracts dates, location and address information, images and event descriptions from event pages.”docs.diffbot.com/reference/retrieve-a-custom-api“Get all the Custom APIs and their rules currently defined on your token.”docs.diffbot.com/docs/introduction-to-custom-api“Select "Article" under the "API" dropdown and paste the URL of blog post into the "Test URL" field. Then click "Create".”docs.diffbot.com/llms.txtdocs.diffbot.com/reference/article“Automatically extract clean article text and other data from news articles, blog posts and other text-heavy pages.”docs.diffbot.com/reference/enhancedocs.diffbot.com/reference/extract-content-not-available-online

Input types

URL, HTML markup, plain text [11]docs.diffbot.com/reference/extract-analyze“Automatically classify a page and extract data according to its type.”docs.diffbot.com/reference/enhancedocs.diffbot.com/reference/extract-content-not-available-online

Output types

JSON [12]github.com/diffbot/diffbot-rust-client“It returns a Json”docs.diffbot.com/reference/introduction-to-diffbot-apis

Webhooks

✓ Yes [13]blog.diffbot.com/crawlbot-updates-webhooks-and-preventing-duplicate-content/“When starting a crawl, you can now supply a webhook URL to be notified when the crawl is complete.”diffbot.com/solutions/news-monitoring/“Webhook API to integrate alerts into your news application.”

Sandbox / test mode

✗ No [14]docs.diffbot.com/reference/authentication“All Diffbot APIs are authenticated via token.”docs.diffbot.com

SDK languages

Python, Go, Ruby, Java, C#, Node.js, PHP, C, Scala, Clojure, Rust [15]github.com/diffbot/diffbot-python“Identify and extract the important parts of any web page in Python!”github.com/diffbot/diffbot-go-client“This package implements a Diffbot client library.”github.com/diffbot/diffbot-ruby-client“Official Diffbot Ruby API Client”github.com/diffbot/diffbot-rust-client“This library allows you to access the Diffbot API from your rust application.”github.com/diffbot“An open source search engine written in C/C++ for Linux on Intel/AMD.”github.com/diffbot/diffbot-js-clientgithub.com/diffbot/diffbot-csharp-clientgithub.com/diffbot/diffbot-java-client“A java client for Diffbot's RESTful API”github.com/diffbot/diffbot-r-client

MCP server

✓ Yes [16]github.com/diffbot/diffbot-mcp“A Diffbot MCP server with a variety of helpful web data handling tools for your agent or LLM pipeline.”

SOC 2

– Unknown [17]diffbot.com/company/privacy/“Diffbot utilizes only PCI-DSS compliant third-party payment processors to ensure the security of your personal information.”

HIPAA

– Unknown [18]diffbot.com/company/privacy/“Diffbot utilizes only PCI-DSS compliant third-party payment processors to ensure the security of your personal information.”

GDPR

✓ Yes [19]diffbot.com/company/privacy/aidoos.com/products/diffbot“Is Diffbot GDPR and CCPA compliant? Yes, Diffbot includes built-in compliance controls for GDPR and CCPA.”

ISO 27001

– Unknown [20]diffbot.com/company/privacy/“Diffbot utilizes only PCI-DSS compliant third-party payment processors to ensure the security of your personal information.”

PCI DSS

– Unknown [21]diffbot.com/company/privacy/“Diffbot utilizes only PCI-DSS compliant third-party payment processors to ensure the security of your personal information.”

Published SLA

✗ No [22]status.diffbot.com/622688“Availability (uptime) over the past 24 hours. Red sections indicate downtime.”status.diffbot.com

Rate limits

Free: 5 Calls Per Minute; Startup: 5 Calls Per Second; Plus: 25 Calls Per Second; Enterprise: 25+ Calls Per Second [23]diffbot.com/pricing/“Free $0/mo each plan is subject to API rate limits.”docs.diffbot.com/reference/rate-limits“APIs to access a trillion connected facts across the web or extract them on demand.”

Known restrictions

sublicense, resell, rent, lease, transfer, assign, time share, or otherwise commercially exploit or make the Service available to any third party, reverse engineer, decompile or disassemble any portion of the Service, bypass any robot exclusion headers or other measures we take to restrict access to the Site or Service, use the API or the Data in any manner that violates the rights of any person, including but not limited to intellectual property rights, rights of privacy or rights of publicity, IN NO EVENT WILL COMPANY'S LIABILITY TO YOU EXCEED $10 [24]diffbot.com/company/terms/“You agree that you will not: sublicense, resell, rent, lease, transfer, assign, time share, or otherwise commercially exploit or make the Service available to any third party”

• Docs
• API reference
• llms.txt
• Changelog
• Status page

Docs rendering: static · llms.txt present

API style

rest

Base URL

https://api.diffbot.com/v3

Version

v3

Versioning

url

Stability

ga

Auth methods

api_key

Idempotency keys

✗ No

Error format

vendor-specific

Rate limit

5 / minute

SDKs

• Python · repo · updated 2026-06 · 124★
• Go · repo · updated 2025-06 · 10★
• Ruby diffbot-ruby-client (rubygems) · repo · updated 2024-05 · 17★
• Java · repo · updated 2019-03 · 9★
• C# · repo · updated 2022-06 · 10★
• Node.js · repo · updated 2017-05 · 23★
• PHP · repo · updated 2016-03 · 9★
• C · repo · updated 2019-03 · 0★
• Scala · repo · updated 2019-03 · 4★
• Clojure · repo · updated 2019-03 · 6★
• Rust · repo · updated 2017-07 · 4★

• Auth docs
• MCP server

Notable customers

Snapchat, AstraZeneca, Klarna, Indeed, NBC, BuzzFeed, Notion, Quora, SemRush, Sequoia Capital, Andreessen Horowitz, Opera, Doximity, FINRA, Factset, Meltwater, SmartNews, Vice, InMoment, Instapaper

• ScrapFly

  "Scrape any site, drive any browser, power any agent. One API key."

  Subscription · public pricing · self-serve

• Bright Data Web Scraper API

  "The most reliable Web Scraping API. Scrape any website with automatic proxy rotation, anti-bot bypass, and JavaScript rendering."

  Subscription · free tier · public pricing · self-serve

• Oxylabs

  The best proxy service platform with 175M+ Residential and 2M Datacenter IP proxies. Extract public data from any website with ease!

  Hybrid · free tier · public pricing · self-serve

• Apify

  Cloud platform for web scraping, browser automation, AI agents, and data for AI

  Hybrid · free tier · public pricing · self-serve

• Crawlbase

  "Web data infrastructure for developers, enterprises & LLMs"

  Hybrid · free tier · public pricing · self-serve

• Firecrawl

  The API to search, scrape, and interact with the web at scale.

  Subscription · free tier · public pricing · self-serve

Diffbot alternatives · Diffbot vs ScrapFly · All Scraping & Crawling APIs APIs

Each field above carries a numbered source - hover for a preview, click to jump here.

1. ↑Description: diffbot.com
2. ↑Pricing model: diffbot.com · devtune.ai
3. ↑Published pricing: diffbot.com · xpay.sh
4. ↑Free tier: diffbot.com
5. ↑Free tier details: diffbot.com · devtune.ai
6. ↑Self-serve signup: diffbot.com · docs.diffbot.com
7. ↑Requires sales call: diffbot.com · docs.diffbot.com
8. ↑Enterprise plan: diffbot.com · devtune.ai
9. ↑Minimum commitment: diffbot.com
10. ↑Supported actions: docs.diffbot.com · docs.diffbot.com · docs.diffbot.com · docs.diffbot.com · docs.diffbot.com · docs.diffbot.com · docs.diffbot.com · docs.diffbot.com
11. ↑Input types: docs.diffbot.com · docs.diffbot.com · docs.diffbot.com
12. ↑Output types: github.com · docs.diffbot.com
13. ↑Webhooks: blog.diffbot.com · diffbot.com
14. ↑Sandbox: docs.diffbot.com · docs.diffbot.com
15. ↑SDK languages: github.com · github.com · github.com · github.com · github.com · github.com · github.com · github.com · github.com
16. ↑MCP server: github.com
17. ↑SOC 2: diffbot.com
18. ↑HIPAA: diffbot.com
19. ↑GDPR: diffbot.com · aidoos.com
20. ↑ISO 27001: diffbot.com
21. ↑PCI DSS: diffbot.com
22. ↑Published SLA: status.diffbot.com · status.diffbot.com
23. ↑Rate limits: diffbot.com · docs.diffbot.com
24. ↑Known restrictions: diffbot.com

Every field change, who made it, and when - from our audited data pipeline and editors.

1. 2026-06-15 Score Agent Friendliness: 30 → 55
2. 2026-06-15 Score Docs Quality: 15 → 55
3. 2026-06-15 API Reference URL: (none) → https://docs.diffbot.com/reference
4. 2026-06-15 Robots Allows Agents: (none) → Yes
5. 2026-06-15 Llms Txt URL: (none) → https://docs.diffbot.com/llms.txt
6. 2026-06-15 Has Structured Data: (none) → No
7. 2026-06-15 Changelog URL: (none) → https://docs.diffbot.com/changelog
8. 2026-06-15 Llms Txt Present: No → Yes
9. 2026-06-14 Capabilities: {} → {"crawl":true,"structured_extraction":true}
10. 2026-06-09 Best For: Prototypes and side projects — free to start, no sales call, AI agents and auto… → Prototypes and side projects - free to start, no sales call, AI agents and auto…
11. 2026-06-09 Scoring Methodology: Scores are computed deterministically from this profile's published, sourced fi… → Scores are computed deterministically from this profile's published, sourced fi…
12. 2026-06-09 Best For: (none) → Prototypes and side projects — free to start, no sales call, AI agents and auto…
13. 2026-06-09 Score Pricing Transparency: (none) → 100
14. 2026-06-09 Score Setup Speed: (none) → 75
15. 2026-06-09 Score Docs Quality: (none) → 15
16. 2026-06-09 Score Procurement Friction: (none) → 100
17. 2026-06-09 Score Trust Readiness: (none) → 15
18. 2026-06-09 Scoring Methodology: (none) → Scores are computed deterministically from this profile's published, sourced fi…
19. 2026-06-09 Score Agent Friendliness: (none) → 30
20. 2026-06-09 Avoid If: (none) → You have strict compliance requirements
21. 2026-06-08 Docs URL: (none) → https://docs.diffbot.com
22. 2026-06-08 Status Page URL: (none) → https://status.diffbot.com
23. 2026-06-08 Rendering: (none) → static
24. 2026-06-08 Llms Txt Present: (none) → No
25. 2026-06-07 Summary Md: (none) → Diffbot turns the web into structured data for AI, with products for market int…
26. 2026-06-07 SDK Packages: Python, Go, Ruby, Java, C#, Node.js, PHP, C, Scala, Clojure, Rust → Python, Go, Ruby, Java, C#, Node.js, PHP, C, Scala, Clojure, Rust
27. 2026-06-07 Data Retention Policy URL: set to https://www.diffbot.com/company/privacy/
28. 2026-06-07 Documented Rate Limits: set to Free: 5 Calls Per Minute; Startup: 5 Calls Per Second; Plus: 25 Calls Per Secon…
29. 2026-06-07 Rate Limit Requests: set to 5
30. 2026-06-07 Rate Limit Window: set to minute
31. 2026-06-07 Known Restrictions: set to sublicense, resell, rent, lease, transfer, assign, time share, or otherwise com…
32. 2026-06-07 Auth Methods: set to api_key
33. 2026-06-07 Auth Docs URL: set to https://docs.diffbot.com/reference/authentication
34. 2026-06-07 API Style: set to rest
35. 2026-06-07 Base URL: set to https://api.diffbot.com/v3
36. 2026-06-07 API Version: set to v3
37. 2026-06-07 Versioning Scheme: set to url
38. 2026-06-07 Stability: set to ga
39. 2026-06-07 MCP URL: set to https://github.com/diffbot/diffbot-mcp
40. 2026-06-07 Idempotency Supported: set to No
41. 2026-06-07 Error Format: set to vendor-specific
42. 2026-06-07 Requires Verification: set to No
43. 2026-06-07 Starting Price Usd: set to 299
44. 2026-06-07 Price Basis: set to month
45. 2026-06-07 Free Tier Limit: set to 10,000 credits/month
46. 2026-06-07 Notable Customers: set to Snapchat, AstraZeneca, Klarna, Indeed, NBC, BuzzFeed, Notion, Quora, SemRush, S…
47. 2026-06-07 Fields Not Found: set to supported_regions, soc2, iso_27001, hipaa, pci_dss, ga_date, launched_at
48. 2026-06-07 Slug: set to diffbot
49. 2026-06-07 Extractor: set to parallel:ultra
50. 2026-06-07 Last Verified At: set to 2026-06-06T00:00:00.000Z

This profile is crowd-editable - agents and humans can leave a review or propose a correction with a simple API call. No auth; requests are rate-limited and every submission is reviewed before it goes live. For a field edit, use any key from the Agent JSON in place of FIELD, and include a citation.

curl -X POST https://apio.sh/api/feedback/diffbot \
  -H 'Content-Type: application/json' \
  -d '{"kind":"review","rating":5,"body":"Your experience with this API…"}'

curl -X POST https://apio.sh/api/suggest/diffbot/FIELD \
  -H 'Content-Type: application/json' \
  -d '{"value":"corrected value","citations":[{"url":"https://source.example/page","excerpt":"supporting quote"}],"note":"what changed and why"}'

All the ways to contribute →