StartupSan Francisco, CA · Est. 2023
Firecrawl
Turn websites into clean, LLM-ready markdown.
Firecrawl (the team formerly known as Mendable, now renamed after the product) crawls, scrapes and structures the web for agents — the de-facto 'eyes' of many research and automation harnesses. Core is open source.
Pros & cons
Each point cites its sources and says what kind of evidence backs it. A second reviewer tried to refute every claim before it was kept.
Pros
- MetadataVery popular (about 197k GitHub stars) and actively maintained, with a core you can self-host.[1]
- User reportsTurns pages into clean, LLM-ready Markdown; builders use it in production scraping pipelines and recommend it alongside Exa.[1][2]
- User reportsSelf-hosting works well for one agent user who does not need the cloud-only features.[1]
- DocsThe free plan gives 1,000 credits a month with no card, and Hobby is $16/month billed yearly for 5,000 credits.[1]
Cons
- DocsAGPL-3.0, and the default self-hosted stack has no Fire-engine anti-bot, no screenshots, no page actions and no Agent or Browser features. Its quickstart turns API auth off and has no high availability.[1][2]
- DocsUnused credits roll over only on Scale and Enterprise, and the JSON, Question and Highlight formats add 4 credits per page.[1]
- User reportsSite operators complain about its traffic: one said Firecrawl customers caused 95% of their bandwidth overage and that it is not a 'verified bot'.[1]
- User reportsA competitor says it often struggles with heavy SPAs and hardened anti-bot walls such as Turnstile and DataDome.[1]
- User reportsA privacy-focused user lists Firecrawl among the providers that keep request logs.[1]
- Best for
- Agents and RAG pipelines that need web pages as clean Markdown at moderate volume.
- Watch out for
- Expect blocks on protected sites, and check the AGPL terms before you embed it.
Assessed Oct 29, 2026 · adversarially reviewedSuggest a correction
People
Co-founder
Harness engineering
Co-founder & CTO
Harness engineering
Co-founder & CEO
Harness engineering
Open roles (14)
- Creator Program Manager (UGC)
San Francisco HQ; Toronto Hub · Full-time · Posted Nov 19, 2026
Go-to-market - Platform Partnerships Lead, AI Labs & Agents
San Francisco, CA · Full-time · Posted Nov 17, 2026
EngineeringRemote - Founding Security Engineer
San Francisco HQ; Toronto Hub · Full-time · Posted Nov 16, 2026
EngineeringRemote - Deployment Experiences Lead
San Francisco, CA · Full-time · Posted Oct 23, 2026
EngineeringRemote - Partnerships Manager - Alexandria
San Francisco HQ; Toronto Hub · Full-time · Posted Oct 7, 2026
EngineeringRemote
Their open-source work
TypeScript · ≈205k stars · AGPL-3.0
firecrawl/firecrawl
Turn websites into clean markdown for LLMs and agents.
Maintained by Firecrawl (formerly Mendable)
Activity
- Last push
- · yesterday
- Latest release
- v2.11.0
· 5mo ago - Last 90 days
- 0 releases
v2.11.0Firecrawl v2.11.0
· 5mo agoFirecrawl v2.11.0 Improvements Firecrawl Research Index — Added a specialized index for agentic AI/ML research: search across 3M+ arXiv papers and the GitHub code behind them (issues, merged PRs, and READMEs, refreshed daily), fetch a paper's details or related work, and check…
v2.10Firecrawl v2.10
· 6mo agoFirecrawl v2.10 Improvements /parse endpoint — Upload local files (PDF, DOCX, DOC, ODT, RTF, XLSX, XLS, HTML) up to 50 MB and get back clean, LLM-ready Markdown, JSON, or a summary. Tables and reading order are preserved, with full Zero Data Retention support for enterprise…
- · 7mo ago
Firecrawl v2.9.0 Improvements Browser Interaction via /interact endpoint — Scrape a page, then call /interact to take actions on it — click buttons, fill forms, navigate deeper, or extract dynamic content. Describe what you want in natural language via prompt, or write…
- · 9mo ago
v2.8.0 Firecrawl v2.8.0 is here! Firecrawl v2.8.0 brings major improvements to agent workflows, developer tooling, and self-hosted deployments across the API and SDKs, including our new Skill. Parallel Agents for running thousands of /agent queries simultaneously, powered by…
- · 11mo ago
Firecrawl v2.7.0 is here! ZDR Search support for enterprise customers. Improved Branding Format with better detection. Partner Integrations API now in closed beta. Faster and more accurate screenshots. Self-hosted improvements And a lot more enhacements, check it out below! New…
Checked against GitHub on Nov 21, 2026. Release notes are shortened to plain text.
On X
No posts from them in our X feed yet.
Neighbours in the directory
San Francisco, CA · Est. 2022
The data framework for connecting agents to your data.
LlamaIndex provides ingestion, indexing and retrieval primitives that give agents grounded context over enterprise data — a foundational piece of the retrieval side of the harness stack.
San Francisco, CA · Est. 2021
Search API purpose-built for AI agents.
Exa (formerly Metaphor) provides neural search and web-crawl APIs tuned for agent consumption — live, cited knowledge for agents instead of stale training data.
Est. 2023
Search and extraction API optimized for LLMs and agents.
Tavily gives agents a single API for search, crawling and in-depth extraction, returning clean, cited results — a common tool in research-agent harnesses.
Connections
Relations from the Harness Hub knowledge graph, as charted in the State of Harness reports.
Maintains · 2
- FirecrawlProject
- firecrawl-mcp-serverProject