Pricing

Pay per event

Try for free

Go to Apify Store

AgentMap

Try for free

Every URL on a site from robots.txt and its sitemaps, as clean JSON for AI agents. Sitemap indexes, gzip, text, RSS/Atom, lastmod filters. Pay only for URLs delivered.

Pricing

Pay per event

Rating

0.0

(0)

Developer

Justin Rooschuz

Actor stats

Bookmarked

Total users

Monthly active users

5 days ago

Last modified

Categories

Developer tools

SEO tools

You can access the AgentMap programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = { "urls": ["https://docs.apify.com"] }
9
10# Run the Actor and wait for it to finish
11run = client.actor("roosch/agentmap").call(run_input=run_input)
12
13# Fetch and print Actor results from the run's dataset (if there are any)
14print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
15for item in client.dataset(run.default_dataset_id).iterate_items():
16    print(item)
17
18# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

AgentMap: sitemap URL extractor for AI agents API in Python

The Apify API client for Python is the official library that allows you to use AgentMap API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

AgentMap API in JavaScript

AgentMap API through CLI

AgentMap OpenAPI definition

AgentMap API

Website Sitemap Extractor

glassventures/website-sitemap-extractor

Extract all URLs from any website's sitemap. Auto-discovers sitemaps from robots.txt, supports sitemap index files and .gz compression. Filter by URL pattern, date range.

Glass Ventures

Sitemap Extractor

apify/sitemap-extractor

This Apify Actor extracts all URLs from a website's sitemaps and checks their status codes via lightweight HTTP requests. It provides a clean list of valid links, acting as an ideal pre-processor to ensure your larger crawling projects target only active URLs.

Apify

400

3.2

(8)

Sitemap Generator - Crawl Website & Create XML Sitemap

scrappy_garden/sitemap-generator

Generate an XML sitemap for any website. Crawls internal pages from start URLs (with depth + page limits), deduplicates URLs, and stores a ready-to-submit sitemap.xml plus a structured dataset and summary for SEO audits.

Bikram Adhikari

Sitemap URL Extractor

gifted_wagon/sitemap-url-inventory

Traverse public sitemap indexes into a deduplicated URL inventory with source sitemap, lastmod, changefreq, priority, media counts, and partial-failure evidence.

Michael Olmos

eBay Market Analyser: Prices, Competition & Profit

best_actors/ebay-market-analyser

Keywords in, the live eBay market out: price range with postage, seller concentration, China competition, optional real sold data and your profit per sale. 8 eBay sites. Pay only for keywords with real data.

Lewis O'Rorke

UK Contracts Finder Scraper: Public Tenders & Buyers

badboxx_newlife/uk-contracts-finder-scraper

Scrape UK public tenders from Contracts Finder: buyer, value, CPV category, deadline and notice URL. No API key, no personal data.

Francesco Correnti

Sitemap URL Extractor & Checker

veedel_digital/sitemap-extractor

Get every URL from a website's XML sitemaps: finds sitemaps via robots.txt, follows sitemap indexes, reads .xml.gz and text sitemaps. Returns lastmod, priority and hreflang, optionally checks each URL for 404s and redirects. No proxies.

Tim Tonat

Sitemap Auditor

axelhu/sitemap-auditor

Discover XML sitemap indexes and export a bounded, deduplicated URL inventory with alternate-language links.

Axel Hu

Bulk URL Status & Redirect Checker (Free): Broken Links, SEO

euroscrape/bulk-url-checker-free

Free bulk URL checker: HTTP status code, full redirect chain (301, 302, 307, 308), final URL, response time and SEO tags (title, meta description, canonical, robots, H1) for up to 100,000 URLs. Find broken links, 404s, redirect loops and noindex pages after a migration. Export CSV, JSON.

EuroScrape

Sitemap URL Extractor

pipwort/sitemap-url-extractor

Get every page URL a website lists in its sitemaps. Finds sitemaps via robots.txt and common paths, follows nested indexes, reads .gz, text, news and RSS sitemaps, and filters by date or pattern.