cvl_crawl_start

com.convertlyft/convertlyft · Verify this server

Start a crawl of any public website with the Convertlyft crawler and get a crawl_id straight away; the crawl runs for a few minutes. It counts toward the plan’s “Pages of your site scanned”: 1 per crawled page, counted when the crawl ends and never more than limit; the answer says the most it can use and what is left. It obeys the site’s robots.txt, skips sign-in endpoints (/api/auth/*), never fetches private or internal addresses, and runs no AI on the pages. Limits per workspace: one crawl running at a time (an SEO-tab crawl counts), 500 pages per crawl. Past a limit the answer says which and when to retry. mode "links" returns just the map of URLs, never page text; "full" also returns each page’s text. Follow it with cvl_crawl_status, then read pages with cvl_crawl_page. To audit THIS workspace’s own site for the SEO tab, use cvl_run_crawl instead.