io.github.77777R7/octocrawl

pkg:npm:@octocrawl/mcp

Web pages as clean Markdown and JSON for AI agents, in fewer tokens, with an Evidence Record.

transport:: remote + stdio
credential class:: self-provisionable
repo:: https://github.com/77777R7/Octocrawl

Owner verification

Not yet verified. Verifying proves you control this server and is free, permanently — it never changes a published score.

Start verification →

Tools

map
List a site's URLs without reading each page: the start page's links (read over HTTP alone) and the entries of the sitemaps the site declares, within one deadline. URLs stay in scope (the start host and its www twin, the start path's subtree, assets left out, similar URLs folded) and robots.txt applies unless ignoreRobotsTxt is set; what was left out is counted. No page title is fetched. At the deadline the answer is what was found (partial, stoppedBy timeout). Compact by default; debug adds each link's evidence and the sources read. Not for: reading pages, as one page body is read at most.
shallow
scrape
Read one URL as Markdown with its Evidence Record (final URL, fetch time, HTTP status, robots.txt decision, hashes), over HTTP first and in the browser when the page needs it. Not for: many URLs or a whole site section. Compact by default; debug adds the full audit. warnings name what the content cannot vouch for (client_rendered_suspected, robots_overridden), and agentHints the next step.
shallow

Embed this server’s score

Tool count and median score across every tool in this server’s corpus — honest in a way a single cherry-picked tool’s badge wouldn’t be.

[![Vouch score](https://vouch.tools/api/servers/65a50388-d379-4510-b3f0-ebb50c00727a/badge.svg)](https://vouch.tools/servers/65a50388-d379-4510-b3f0-ebb50c00727a)