Harness Hub
All startups

Firecrawl

Turn websites into clean, LLM-ready markdown.

Firecrawl (the team formerly known as Mendable, now renamed after the product) crawls, scrapes and structures the web for agents — the de-facto 'eyes' of many research and automation harnesses. Core is open source.

Pros & cons

Each point cites its sources and says what kind of evidence backs it. A second reviewer tried to refute every claim before it was kept.

Pros

  • MetadataVery popular (about 197k GitHub stars) and actively maintained, with a core you can self-host.[1]
  • User reportsTurns pages into clean, LLM-ready Markdown; builders use it in production scraping pipelines and recommend it alongside Exa.[1][2]
  • User reportsSelf-hosting works well for one agent user who does not need the cloud-only features.[1]
  • DocsThe free plan gives 1,000 credits a month with no card, and Hobby is $16/month billed yearly for 5,000 credits.[1]

Cons

  • DocsAGPL-3.0, and the default self-hosted stack has no Fire-engine anti-bot, no screenshots, no page actions and no Agent or Browser features. Its quickstart turns API auth off and has no high availability.[1][2]
  • DocsUnused credits roll over only on Scale and Enterprise, and the JSON, Question and Highlight formats add 4 credits per page.[1]
  • User reportsSite operators complain about its traffic: one said Firecrawl customers caused 95% of their bandwidth overage and that it is not a 'verified bot'.[1]
  • User reportsA competitor says it often struggles with heavy SPAs and hardened anti-bot walls such as Turnstile and DataDome.[1]
  • User reportsA privacy-focused user lists Firecrawl among the providers that keep request logs.[1]
Best for
Agents and RAG pipelines that need web pages as clean Markdown at moderate volume.
Watch out for
Expect blocks on protected sites, and check the AGPL terms before you embed it.

Assessed Oct 29, 2026 · adversarially reviewedSuggest a correction

People

Open roles (14)

All 14 roles

Their open-source work

firecrawl/firecrawl

Turn websites into clean markdown for LLMs and agents.

Maintained by Firecrawl (formerly Mendable)

4 pros · 4 cons

Activity

Last push
· yesterday
Latest release
v2.11.0
· 5mo ago
Last 90 days
0 releases
  1. v2.11.0Firecrawl v2.11.0

    · 5mo ago

    Firecrawl v2.11.0 Improvements Firecrawl Research Index — Added a specialized index for agentic AI/ML research: search across 3M+ arXiv papers and the GitHub code behind them (issues, merged PRs, and READMEs, refreshed daily), fetch a paper's details or related work, and check…

  2. v2.10Firecrawl v2.10

    · 6mo ago

    Firecrawl v2.10 Improvements /parse endpoint — Upload local files (PDF, DOCX, DOC, ODT, RTF, XLSX, XLS, HTML) up to 50 MB and get back clean, LLM-ready Markdown, JSON, or a summary. Tables and reading order are preserved, with full Zero Data Retention support for enterprise…

  3. v2.9.0

    · 7mo ago

    Firecrawl v2.9.0 Improvements Browser Interaction via /interact endpoint — Scrape a page, then call /interact to take actions on it — click buttons, fill forms, navigate deeper, or extract dynamic content. Describe what you want in natural language via prompt, or write…

  4. v2.8.0

    · 9mo ago

    v2.8.0 Firecrawl v2.8.0 is here! Firecrawl v2.8.0 brings major improvements to agent workflows, developer tooling, and self-hosted deployments across the API and SDKs, including our new Skill. Parallel Agents for running thousands of /agent queries simultaneously, powered by…

  5. v2.7.0

    · 11mo ago

    Firecrawl v2.7.0 is here! ZDR Search support for enterprise customers. Improved Branding Format with better detection. Partner Integrations API now in closed beta. Faster and more accurate screenshots. Self-hosted improvements And a lot more enhacements, check it out below! New…

Checked against GitHub on Nov 21, 2026. Release notes are shortened to plain text.

On X

No posts from them in our X feed yet.

Follow @firecrawl on X · The X feed

The data framework for connecting agents to your data.

LlamaIndex provides ingestion, indexing and retrieval primitives that give agents grounded context over enterprise data — a foundational piece of the retrieval side of the harness stack.

4 pros · 3 cons

Exa

Search API purpose-built for AI agents.

Exa (formerly Metaphor) provides neural search and web-crawl APIs tuned for agent consumption — live, cited knowledge for agents instead of stale training data.

4 pros · 4 cons

Search and extraction API optimized for LLMs and agents.

Tavily gives agents a single API for search, crawling and in-depth extraction, returning clean, cited results — a common tool in research-agent harnesses.

4 pros · 4 cons

Connections

Relations from the Harness Hub knowledge graph, as charted in the State of Harness reports.

Maintains · 2

Similar entries · 2

The Harness Hub newsletter

New harness companies, projects, releases and the monthly State of Harness report, in your inbox.