Web Scraping API

Web Scraping Crawl website API

Crawl a website and get clean text content from up to 10 pages in one normalized response - ideal for feeding sites into LLMs and search indexes.

POST/v1/run/web.crawl
Uptime
100.00%
30d · 1 call
Requests
1
30d · weekly, last 12 wks
Response
5.3s
median · 30d

Pricing

One price, in dollars

Providers
Octopus1 served100.00% uptime5140ms p50$3.15/1k resultsup to $0.0347 / request

Try it

Make your first request

Open in
Get a free key
Sample response
Free runs return only the first 3 results. Fund a key to get the full response.
{
  "found": true,
  "data": {
    "items": [
      {
        "url": "https://www.example.com",
        "title": "Example - Build something great",
        "text": "Example is the platform teams use to ship faster…"
      },
      {
        "url": "https://www.example.com/pricing",
        "title": "Pricing - Example",
        "text": "Simple plans for teams of every size…"
      }
    ]
  }
}
Response interface
interface WebCrawlResponse {
  data: {
    items: {
      domain: string;
      text: string;
    }[];
  } | null;
  found: boolean;
}

Full parameter and response reference - every field, type, and example for this endpoint.

Reference

Request, response, and price

Last verified 2026-09-16 · uptime and latency measured over 30d
POST /v1/run/web.crawl
curl -X POST https://api.getanyapi.com/v1/run/web.crawl \
  -H "Authorization: Bearer $ANYAPI_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://www.example.com"}'
FieldTypeExample value
Request body
urlstring"https://www.example.com"The website URL or domain to crawl.
limitintegerMaximum number of results to return (1-10, default 10). You are billed per result returned, so a lower limit costs less.
Response
foundbooleantrue
dataobject
data.itemsarray
data.items[].urlstring"https://www.example.com"
data.items[].titlestring"Example - Build something great"
data.items[].textstring"Example is the platform teams use to ship faster…"
Price
Price per request (ceiling)USD$0.0347
Price /1k resultsUSD$3.15

FAQ

About the Web Scraping Crawl website API

The AnyAPI Web Scraping Crawl website API returns Web Scraping crawl website data as normalized JSON from one POST call to /v1/run/web.crawl. Crawl a website and get clean text content from up to 10 pages in one normalized response - ideal for feeding sites into LLMs and search indexes. AnyAPI returns one normalized schema whichever source serves it. It costs $3.15 per 1,000 results, and never more than $0.0347 for a single request, in US dollars with no subscription and no monthly minimum. Over the last 30 days, 100.0% of Web Scraping crawl website calls through AnyAPI succeeded, with a median response time of 5.3 seconds across 1 measured calls.

It costs $3.15 per 1,000 results, and never more than $0.0347 for a single request, in US dollars with no subscription and no monthly minimum. You fund one USD wallet, each call draws it down, and a failed request costs $0.

Crawl a website and get clean text content from up to 10 pages in one normalized response - ideal for feeding sites into LLMs and search indexes. The response is normalized JSON with the same envelope every AnyAPI endpoint returns, so parsing a second endpoint is a change of URL and nothing else.

Over the last 30 days, 100.0% of Web Scraping crawl website calls through AnyAPI succeeded, with a median response time of 5.3 seconds across 1 measured calls. These are AnyAPI's own measurements of traffic through the gateway, recomputed continuously, not a published service-level target.
More to call

Other Web Scraping endpoints

Scrape pagefrom $0.70 /1k reqMap sitefrom $1.00 /1k reqScreenshot pagefrom $1.74 /1k req