web_crawl

The web_crawl tool is provided by oassis — web scraping, crawling and browser control for AI agents. Install that server in your AI client and the assistant can call it directly.

Servers exposing web_crawl

• oassis — web scraping, crawling and browser control for AI agentsD · 33HTTP

  From the publisher:Follows a site's links and reads every page. Returns a jobId; poll it with web_crawl_status. API key and credits required; `limit` controls the maximum pages charged. Use web_map first if you only need the urls. Reference for the oassis API: https://oassis.dev/openapi.json

  Parameter	Type	Description
  formats	array	Outputs you want in the same response. `controls` is the map of what can be clicked; `elements` needs `selectors`; `json` needs `json.prompt` or `json.schema`. A screenshot or a PDF is not available h
  selectors	array	CSS selectors for the `elements` format.
  json	object	For the `json` format: a `prompt` describing what to pull out, a JSON `schema` to fill, or both.
  controls	object	Options for the `controls` format: `visibleOnly`, and `limit` (1 to 1000) to cut the map.
  links	object	Options for the `links` format: `visibleOnly`, `excludeExternal` to keep only internal links.
  wait	object	When to consider the page loaded: `until` (load, domcontentloaded, networkidle0, networkidle2), `selector` to wait for, `timeout` in ms.
  request	object	How to make the request: `headers`, `cookies`, `userAgent`, and `auth` for basic authentication.
  block	object	What not to load, which makes a render faster and cheaper. `resourceTypes` takes image, font, stylesheet, media… and `urlPatterns` are regular expressions, not globs: `\.svg$`, not `*.svg`.
  maxAge	integer	Accept an answer up to this many milliseconds old. A cache hit costs $0.0002 instead of the format price. Leave it out to force a fresh render.
  binaryAs	string	How a screenshot or a PDF comes back. `base64` is the only value today.
  viewport	object	The window to render in: `width`, `height`, `deviceScaleFactor`.
  url*	string	Page to process.
  limit	integer	Pages this crawl may read, up to 200. Charged up front; what it does not read comes back.
  maxDepth	integer	How far from the starting page to follow links. 0 reads only the starting page.
  includeSubdomains	boolean	Treat subdomains of the same site as part of it.
  includePaths	array	Keep only urls whose path contains one of these. Up to twenty.
  excludePaths	array	Discard urls whose path contains one of these. Up to twenty. It wins over `includePaths`.

  Install oassis — web scraping, crawling and browser control for AI agents →

Tool lists are read from the live servers (or, for packaged servers, from their documentation) each morning, so this reflects what they exposed at the last refresh. Search all tools.