/docs/api needs a clear primary heading
Fix: Give https://www.novagentum.ai/docs/api exactly one descriptive H1 aligned with its primary buyer intent.
CRAWL · UP TO 100 PAGES
Crawl your website, see what needs attention on each page, and get a prioritized list of fixes backed by evidence. Need the pages themselves? Get every page's content too.
250 credits for the first page, then 5 credits per 5 additional pages, rounded up, up to 100 pages.
10 pages, 3 findings, each with the affected page or site, evidence and a fix. Filter them like you would your own.
Fix: Give https://www.novagentum.ai/docs/api exactly one descriptive H1 aligned with its primary buyer intent.
Fix: Add JSON-LD to https://www.novagentum.ai/solutions only for entities and content visibly represented on the page.
Fix: Add a buyer question as a descriptive heading on https://www.novagentum.ai/company and answer it directly in visible HTML.
Out of 10 pages checked.
| Item | Value | Note |
|---|---|---|
| Missing machine-readable facts (structured data) | 1 of 10 | Facts such as product, price or organisation in a format search engines and AI tools read directly. Without it, they have to guess from the text. |
| No heading that answers a question | 1 of 10 | Buyers ask questions. A heading that answers one gives search engines and AI tools a clear passage to use. |
Follows same-site links and your sitemap, up to 100 pages per crawl. Robots rules are respected.
Paid crawls render every page that needs JavaScript in a real browser, up to the crawl’s page limit, for +5 credits per rendered page. Only successful renders are charged; free crawls use plain HTML.
Each issue links to the pages behind it and what was found, so you can decide what to fix first.
Copy a fix brief for your team, Codex or Claude. Share a read-only link to a crawl and revoke it any time.
Choose content output to get every page as Markdown, HTML, links and metadata, or audit + content for both. Page content costs 1 credit per page, the same as a Scrape page, instead of the audit price. JavaScript rendering is included. Pages that fail are not charged.
Audit + content costs the audit price plus 1 credit per page for its content; rendered pages cost +5 credits each, as for the audit. Pages that fail are not charged.
Include or exclude paths, limit the discovery depth, ignore the sitemap, and stay under a path or crawl the whole domain.
Content crawls apply Scrape settings to every page: formats, main content only, include or exclude HTML tags, wait and timeout. PDFs, screenshots and cache are Scrape only.
Map lists the URLs of a website from its sitemaps and links, so you can pick the pages to crawl or scrape.
Call the REST API to run the same crawl from your scripts or CI, or connect an AI tool over MCP. Usage and billing are shared with your dashboard. Content output and Map are in the API too.
curl -X POST https://www.novagentum.ai/api/v1/crawl \
-H "Authorization: Bearer $NOVAGENTUM_TOKEN" \
-H "Content-Type: application/json" \
-d '{"url": "https://www.novagentum.ai", "limit": 10}'Add your website, review the quote and get your first findings in minutes.
Start a crawl