All Repos
AI AgentsTypeScriptAGPL-3.0

firecrawl

firecrawl/firecrawl · Updated

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

firecrawl/firecrawl is a TypeScript repository in the AI Agents category with 196,247 stars and 10,361 forks on GitHub, released under the AGPL-3.0 license, last updated today.

#ai#ai-agents#ai-crawler#ai-scraping#ai-search#crawler#data-extraction#html-to-markdown
View on GitHub 196kGitHub stars

How to install firecrawl in your AI client

Setup for Claude Code, Claude Desktop, Cursor, Codex, Windsurf, Cline and VS Code — copy-paste ready.

How to install firecrawl in Claude CodeAnthropic's agentic CLI

  1. Clone & open

    bash
    git clone https://github.com/firecrawl/firecrawl.git
cd firecrawl
claude

  2. Let Claude read it

    Ask “/init” to generate a CLAUDE.md, then have Claude explain, run, or extend the codebase. It reads files on demand.

Documentation

Full README

🔥 Firecrawl

The API to search, scrape, and interact with the web at scale. Firecrawl is the context API for AI agents. 🔥 Open source and available as a hosted service.

_Pst. Hey, you, join our stargazers :)_

Why Firecrawl?

  • Industry-leading reliability: Covers 96% of the web, including JS-heavy pages — no proxy headaches, just clean data (see benchmarks)
  • Blazingly fast: P95 latency of 3.4s across millions of pages, built for real-time agents and dynamic apps
  • LLM-ready output: Clean markdown, structured JSON, screenshots, and more — spend fewer tokens, build better AI apps
  • We handle the hard stuff: Rotating proxies, orchestration, rate limits, JS-blocked content, and more — zero configuration
  • Agent ready: Connect Firecrawl to any AI agent or MCP client with a single command
  • Document parsing: Turn PDFs, DOCX, and other documents into clean Markdown or structured JSON
  • Actions: Click, scroll, write, wait, and press before extracting content
  • Open source: Developed transparently and collaboratively — join our community

Feature Overview

Core Endpoints

| Feature | Description | |---------|-------------| | **Search** | Search the web and get full page content from results | | **Scrape** | Convert any URL to markdown, HTML, screenshots, or structured JSON | | **Interact** | Scrape a page, then interact with it using AI prompts or code |

More

| Feature | Description | |---------|-------------| | **Parse** | Turn PDFs, DOCX, and other documents into clean Markdown or structured JSON | | **Agent** | Automated data gathering, just describe what you need | | **Crawl** | Scrape all URLs of a website with a single request | | **Map** | Discover all URLs on a website instantly | | **Batch Scrape** | Scrape thousands of URLs asynchronously | | **Monitor** | Get notified when content on a website changes |

Excerpt — the full document is on GitHub.

More AI Agents repositories

Catalog data refreshed . Something wrong? Report it.