Pages the crawl reported as failed or skipped. They are never in items and never billed. The list holds what the crawl reported, not every page of the site.

• outcome"failed" | "robots_disallowed" | "skipped"

  failed: the page could not be fetched or answered with an HTTP error. robots_disallowed: the site's robots.txt does not allow crawling it. skipped: the crawl did not fetch it, for example because it is outside the crawled site.

• statusCodeinteger

  The HTTP status code the page answered with, or null when unknown.

• urlstring

  The page's URL.

One record per crawled page: its URL and domain, page title, meta description, language, HTTP status, the page content as Markdown text, and the page metadata the source reports. You are billed for these pages only. Populated whenever the provider has data for the entity.

• authorstringpode ser exigido

  The author the page declares, or null when unknown.

• canonicalUrlstringpode ser exigido

  The canonical URL the page declares in its own markup, or null when it declares none or the source does not report it.

• contentTypestringpode ser exigido

  The content type the page was served with (for example text/html;charset=utf-8), or null when unknown.

• descriptionstring

  The page's meta description, empty when the page has none.

• domainstring

  The page's host name, without a leading www. Populated whenever the provider has data for the entity.

• jsonLdany[]pode ser exigido

  The JSON-LD structured data blocks the page publishes (schema.org Organization, LocalBusiness, BreadcrumbList and so on), as parsed JSON, or null when the source does not report them. They are the publisher's own claims, not verified facts.

• languagestringpode ser exigido

  The page's declared language code (for example en-US), or null when unknown.

• modifiedUtcintegerpode ser exigido

  When the page says it was last modified, as a UTC epoch timestamp in seconds (Unix time), or null when unknown. Multiply by 1000 for a JS Date in milliseconds.

• publishedUtcintegerpode ser exigido

  When the page says it was published, as a UTC epoch timestamp in seconds (Unix time), or null when unknown. Multiply by 1000 for a JS Date in milliseconds.

• robotsstringpode ser exigido

  The page's robots meta directives (for example noindex, nofollow), or null when it declares none or the source does not report them.

• siteNamestringpode ser exigido

  The site name the page declares (its og:site_name), or null when unknown.

• sourceUrlstring

  The URL the crawler requested for this page, before any redirect, or null when unknown.

• statusCodeinteger

  The HTTP status code the page answered with, or null when unknown.

• textstring

  Example is the platform teams use to ship faster…

  The page content as Markdown. Populated whenever the provider has data for the entity.

• titlestring

  Example - Build something great

  The page title, empty when the page has none (a PDF, for example).

• urlstring

  https://www.example.com

  The crawled page's URL, after any redirect. Populated whenever the provider has data for the entity.

The page's headings in document order, each with its level (1 for an h1) and text, or null when the source does not report them.

• levelinteger

  The heading level, 1 to 6.

• textstring

  The heading text.

Counts for this crawl. They describe the pages this crawl visited and reported, not the whole website, and are not added together into a total.

• pagesReturnedinteger

  The number of pages in items, which is the number you are billed for.

• reportedFailedinteger

  The number of pages the crawl reported as failed, or null when the source does not report a complete count.

• reportedSkippedinteger

  The number of pages the crawl reported as skipped, including those robots.txt disallows, or null when the source does not report a complete count.

• foundboolean

  true

• reason"not_found"

  Present only when `found` is false, and says why there is no result. `not_found`: the source states the target does not exist, or returned nothing for it. A `found: false` answer is a successful call, not an error, and `costUsd` is what it actually cost.