← Back to browse

web-scraper

Indexed by com.agishub

About

Web scraper for agents: fetch any URL as clean markdown (headings, links). x402 for JS rendering.

Use this server

Add it to your MCP client. The catalogue lists this config verbatim from its source — it does not run, download, or vouch for the server. Review the command before you run it.

TransportHTTP (remote server)
Claude Code
claude mcp add --transport http web-scraper https://api.agishub.com/mcp/web
Cursor

Add to Cursor

If the button doesn't open Cursor, use the JSON below — Cursor accepts the same mcpServers config.

VS Code
code --add-mcp '{"name":"web-scraper","type":"http","url":"https://api.agishub.com/mcp/web"}'
JSON
{
  "mcpServers": {
    "web-scraper": {
      "url": "https://api.agishub.com/mcp/web"
    }
  }
}