agnt
[Get started for free]
Web

Web data, one key, agent-ready

Scrape any page as clean markdown or structured JSON, search the web and get full page content in one call, and map a site's URLs. Designed for LLMs and automation.

API Reference & PlaygroundGet started for free

Quickstart

3 options

Choose how you want to integrate the Web API.

Register Web tools natively in your agent's tool registry via a code plugin.

1

Install the plugin:

openclaw plugins install web
2

Configure your API key in openclaw.json:

{
  "plugins": {
    "entries": {
      "agntdata-web": {
        "enabled": true,
        "config": {
          "apiKey": "${AGNTDATA_API_KEY}"
        }
      }
    }
  }
}
3

Restart OpenClaw — Web tools are now available to your agent.

View on ClawHub →

Want all 7 APIs at once?

Install the master plugin for unified access to every platform.

clawhub install agnt-data
openclaw plugins install @agntdata/openclaw-agnt-data
Get started for freeAPI Reference & Playground
Endpoints

3

Cost / request

$0.01

Response format

JSON

OpenAPI version

2.0.0

Overview

The agntdata Web API gives agents reliable access to the live web through a single integration. Fetch the content of any public page as clean main-content markdown or structured JSON, run a web search and pull the full content of each result in one call, and discover every URL on a site before scraping it. JavaScript-rendered pages are handled for you. Instead of managing scraping infrastructure, proxies, and rate limits yourself, you call agntdata with one credential and consume agent-ready JSON with predictable, usage-based credit pricing.

Key features

Scrape any page as clean markdown or schema-driven JSON
Search the web and return full page content in one request
Map a website's URLs quickly before deep scraping
Handles JavaScript-rendered pages and anti-bot challenges
Single API key and unified credit balance across agntdata
Usage-based pricing that scales with each request's options

Endpoints

3 endpoints across 3 categories. Click any row for detailed documentation.

3 total

Scrape

1

Extract the content of a single web page as markdown, HTML, or structured JSON.

MethodEndpoint
postScrape a web page

Reading a specific page an agent already has the URL for

Search

1

Search the web and optionally return full page content for each result.

MethodEndpoint
postSearch the web

Answering questions that need fresh information from the web

Map

1

Discover the URLs on a website.

MethodEndpoint
postMap a website's URLs

Discovering all pages on a site before deep scraping

Use cases

Research and deep-research agents that read live web pages
RAG pipelines that ingest fresh page content on demand
Competitive and market monitoring agents
Lead and company enrichment from public web pages
Content extraction into structured JSON for downstream tools

Ready to integrate?

Generate your API key in seconds and start calling 3 endpoints with a single credential. Free tier available with transparent pricing.

Get started for freeBrowse all APIs

Frequently asked questions

web scraping APIweb search API for AI agentsscrape to markdown APIstructured web extraction APIsite map URL discovery APIagent-ready web data APIMCP web data source