XCrawl is a web data API for LLMs, RAG and AI agents that turns any URL into Markdown, JSON, HTML or screenshots, and can crawl sites, map domains and query SERPs.

Visit site

Claim this tool · Submit your tool

Overview

Key features

Scrape any URL to Markdown, JSON, HTML or screenshot
Crawl sites, map domain URLs and query SERPs
Built for AI agents and RAG teams with SDKs, CLI and MCP

Use cases

Feeding live web content into RAG pipelines
AI agents needing web search and page reading
Clean structured data without managing proxies

Back

Information

Websitewww.xcrawl.ai
Published date2026/11/02

Similar tools

Ohmbo

AI Coding Tools

CURATED•2026

AI workspace for hardware teams: circuits, PCB, firmware, simulation and enclosures in one project, from an idea to a measured prototype

Hardware AI Workspace

Details Visit site

Massvai

AI Coding Tools

CURATED•2026

Massvai is an AI app builder for founders: describe your product and an agent builds a full-stack Next.js app with Supabase auth and data, live preview, GitHub sync and one-click Vercel deploy

AI App Builder

Details Visit site

OfferCC

AI Coding Tools

CURATED•2026

Live desktop AI interview assistant - real-time spoken answers and coding from screenshots

Interview Assistant

Details Visit site

Key Features

Scrape any URL to Markdown, JSON, HTML or screenshot
Crawl sites, map domain URLs and query SERPs
Built for AI agents and RAG teams with SDKs, CLI and MCP

Use Cases

Feeding live web content into RAG pipelines
AI agents needing web search and page reading
Clean structured data without managing proxies