CRAWL · UP TO 100 PAGES

Every page checked.
The next fix, clear.

Crawl your website, see what needs attention on each page, and get a prioritized list of fixes backed by evidence. Need the pages themselves? Get every page's content too.

250 credits for the first page, then 5 credits per 5 additional pages, rounded up, up to 100 pages.

A REAL CRAWL

From pages to a fix list.

10 pages, 3 findings, each with the affected page or site, evidence and a fix. Filter them like you would your own.

Findings

3 findings
  1. Content gapsmedium severity/docs/api

    /docs/api needs a clear primary heading

    Fix: Give https://www.novagentum.ai/docs/api exactly one descriptive H1 aligned with its primary buyer intent.

  2. Structured datamedium severity/solutions

    /solutions has no structured data

    Fix: Add JSON-LD to https://www.novagentum.ai/solutions only for entities and content visibly represented on the page.

  3. Content gapsmedium severity/company

    /company needs headings that answer buyer questions

    Fix: Add a buyer question as a descriptive heading on https://www.novagentum.ai/company and answer it directly in visible HTML.

Pages with each problem

Out of 10 pages checked.

Missing machine-readable facts (structured data)
Facts such as product, price or organisation in a format search engines and AI tools read directly. Without it, they have to guess from the text.
No heading that answers a question
Buyers ask questions. A heading that answers one gives search engines and AI tools a clear passage to use.
Show the data
ItemValueNote
Missing machine-readable facts (structured data)1 of 10Facts such as product, price or organisation in a format search engines and AI tools read directly. Without it, they have to guess from the text.
No heading that answers a question1 of 10Buyers ask questions. A heading that answers one gives search engines and AI tools a clear passage to use.
Filter findings like you would your own.
01 / WHAT YOU GET

Know what to fix, and why.

Finds your pages

Follows same-site links and your sitemap, up to 100 pages per crawl. Robots rules are respected.

Sees what visitors see

Paid crawls render every page that needs JavaScript in a real browser, up to the crawl’s page limit, for +5 credits per rendered page. Only successful renders are charged; free crawls use plain HTML.

Evidence for every finding

Each issue links to the pages behind it and what was found, so you can decide what to fix first.

Fix briefs you can hand off

Copy a fix brief for your team, Codex or Claude. Share a read-only link to a crawl and revoke it any time.

02 / OPTIONS

Findings, content, or both.

Page content too

Choose content output to get every page as Markdown, HTML, links and metadata, or audit + content for both. Page content costs 1 credit per page, the same as a Scrape page, instead of the audit price. JavaScript rendering is included. Pages that fail are not charged.

Audit + content

Audit + content costs the audit price plus 1 credit per page for its content; rendered pages cost +5 credits each, as for the audit. Pages that fail are not charged.

Choose what to crawl

Include or exclude paths, limit the discovery depth, ignore the sitemap, and stay under a path or crawl the whole domain.

Scrape settings per page

Content crawls apply Scrape settings to every page: formats, main content only, include or exclude HTML tags, wait and timeout. PDFs, screenshots and cache are Scrape only.

03 / MAP THE SITE FIRST

See every URL before you crawl.

Map lists the URLs of a website from its sitemaps and links, so you can pick the pages to crawl or scrape.

What you get
A list of the site's URLs. Use it to set include and exclude paths, or paste pages into a Scrape batch.
Price
1 credit per map, whatever the number of URLs. No URLs found means no charge. Paid only.
From code
POST /api/v1/map, next to Crawl and Scrape.
04 / FOR DEVELOPERS

Crawl from your code.

Call the REST API to run the same crawl from your scripts or CI, or connect an AI tool over MCP. Usage and billing are shared with your dashboard. Content output and Map are in the API too.

API referenceOpenAPI 3.1 · /api/v1
Format
curl -X POST https://www.novagentum.ai/api/v1/crawl \
  -H "Authorization: Bearer $NOVAGENTUM_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"url": "https://www.novagentum.ai", "limit": 10}'
API
05 / PRICE AND LIMITS

Know what you pay.

Simple usage pricing, shown before you start. See all plans.

Price
250 credits for the first page, then 5 credits per 5 additional pages, rounded up, up to 100 pages.
JavaScript
Paid crawls render every page that needs JavaScript in a real browser, up to the crawl’s page limit, for +5 credits per rendered page. Only successful renders are charged; free crawls use plain HTML.
Free
Each confirmed email address gets one free Crawl of up to 10 pages or up to 100 free Scrapes per calendar month; Visibility always uses credits.
Before you start
You see the maximum price before every crawl. You pay only for pages that were actually checked, never more than the quote.
06 / QUESTIONS

A few things to know.

START WITH THE EVIDENCE

Turn your website into a fix list.

Add your website, review the quote and get your first findings in minutes.

Start a crawl