Get started
Map

Every URL on any website.

Point Map at any domain and get back every URL we can discover: internal links, subdomains, hidden paths, paginated archives. Complete site topology in one call.

Discovers internal links & subdomainsRespects robots.txt (optional)Returns up to 50,000 URLs per call
Start mappingView docs
example.com/blog/products/about/docs/pricing/post-1/post-2/post-3/item-42/item-87/team/api/guide/ref/plans2,847URLs discoveredmap.anakin.io / v1live

The problem

Finding URLs shouldn't require building a spider.

Every team reinvents the same URL discovery logic: sitemap parsing, link following, deduplication. Map handles all of it with a single API call.

✕

The old way

  • Crawl entire site to find URLs
  • Parse sitemap.xml manually
  • Miss dynamically generated pages
  • No subdomain discovery
  • Process duplicates yourself
  • Re-crawl to update
  • Build custom spider logic
  • Handle pagination manually
M

With Map

  • One API call per domain
  • Sitemap + link crawl combined
  • Dynamic pages discovered
  • Subdomain enumeration built in
  • Deduplicated output
  • Incremental mode available
  • No spider to build or maintain
  • Pagination handled automatically

3,847 URLs discovered · 28s

full sitemap · deduped · export ready

How it works

One call. Every URL back.

01

Submit a domain

POST any root URL. Map will discover all reachable pages by combining sitemap.xml parsing, robots.txt analysis, and recursive link following.

02

We explore the full graph

Internal links, pagination, query parameters, subdomains. Every reachable URL is enumerated. Configurable depth and limit controls scope.

03

Get the full URL list

Receive a deduplicated, sorted list of all discovered URLs. Filter by path prefix, file type, or status code. Pipe directly into crawl or scrape.

What you can build

Know the shape of any website.

3,847 URLs
mapped in 28s

SEO audits at scale

Map every URL on a competitor's site. Identify content gaps, missing pages, and indexing anomalies without crawling each page.

100%
URL coverage

Content migration

Before migrating a site, get a complete URL inventory. Map old paths to new paths. Validate redirects with confidence.

< 30s
full domain scan

Broken link detection

Combine Map with URL Scraper to fetch and validate every page. Surface 404s, redirect chains, and orphaned content instantly.

0

URLs per call

configurable limit

0s

median discovery time

for sites up to 10K pages

0%

deduplication

URL-normalized output

Quick start

Running in minutes.

Grab your API key and point Map at any domain. No setup, no configuration. Just URLs back.

1
Sign up and get your API key
2
POST a domain URL to /v1/map
3
Receive the full URL list in the response
import requests

result = requests.post(
    "https://api.anakin.io/v1/map",
    headers={"X-API-Key": "your_api_key"},
    json={
        "url": "https://example.com",
        "limit": 1000,
        "include_subdomains": False,
    },
).json()

print(f"Discovered {len(result['urls'])} URLs")
for url in result["urls"][:10]:
    print(url)
Authenticate with the X-API-Key header.Get API key

FAQ

Common questions

Map

The web has structure.
Map reveals it.

Stop writing crawlers to find URLs. One call returns everything.

Start mappingView docs