URL Scraper

URL Scraper API — scrape single or batch URLs with intelligent caching and AI extraction

URL Scraper

The URL Scraper is the core scraping API. Submit any URL and receive the scraped HTML, markdown, and optionally AI-extracted JSON data. Supports single URL and batch (up to 10 URLs) modes.

Features

  • Single & batch scraping in one API
  • 30x faster with intelligent caching
  • Zero blocks with anti-detection and proxy routing across 207 countries and territories
  • AI JSON extraction — structured data from any page
  • Browser mode — headless Chrome for JS-heavy sites and SPAs

Endpoints

POST/v1/url-scraper

Submit Scrape Job — scrape a single URL
POST/v1/url-scraper/batch

Batch URL Scraping — scrape up to 10 URLs
GET/v1/url-scraper/{id}

Get Job Status & Results — poll for results