# D4Vinci/Scrapling

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

90,271 stars · 9,340 forks · Python · BSD-3-Clause

Topics: ai, ai-scraping, automation, crawler, crawling, crawling-python, data, data-extraction

## Use it

### How to install Scrapling in Claude Code

1. Clone & open

```bash
git clone https://github.com/D4Vinci/Scrapling.git
cd Scrapling
claude
```

2. Let Claude read it

   Ask “/init” to generate a CLAUDE.md, then have Claude explain, run, or extend the codebase. It reads files on demand.

### How to install Scrapling in Claude Desktop

1. Clone the repository

```bash
git clone https://github.com/D4Vinci/Scrapling.git
```

2. Open in your AI editor

   Open the folder in your assistant and ask it to index the codebase, then reference files in chat.

### How to install Scrapling in Cursor

1. Clone & open in Cursor

```bash
git clone https://github.com/D4Vinci/Scrapling.git
```

2. Index & chat

   Open the folder — Cursor indexes it automatically. Use @Codebase in chat to ask about it or scaffold from it.

### How to install Scrapling in Codex CLI

1. Clone

```bash
git clone https://github.com/D4Vinci/Scrapling.git
```

2. Point Codex at it

   Run codex in the repo root; add setup notes to AGENTS.md so the agent knows how to build & test.

### How to install Scrapling in Windsurf

1. Clone & open

```bash
git clone https://github.com/D4Vinci/Scrapling.git
```

2. Use Cascade

   Windsurf indexes the workspace; ask Cascade to explain or reuse modules from the repo.

### How to install Scrapling in Cline

1. Clone the repository

```bash
git clone https://github.com/D4Vinci/Scrapling.git
```

2. Open in your AI editor

   Open the folder in your assistant and ask it to index the codebase, then reference files in chat.

### How to install Scrapling in VS Code

1. Clone the repository

```bash
git clone https://github.com/D4Vinci/Scrapling.git
```

2. Open in your AI editor

   Open the folder in your assistant and ask it to index the codebase, then reference files in chat.

---

Source: https://mcp-skills-hub.vercel.app/repos/d4vinci-scrapling · MCP Skills Hub · data as of 2026-10-28T12:31:05Z