You can access the Agent Web Access Plan programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "url": "https://docs.apify.com/",
10    "userAgent": "AgentWebAccessPlan",
11}
12
13# Run the Actor and wait for it to finish
14run = client.actor("l3digital/agent-web-access-plan").call(run_input=run_input)
15
16# Fetch and print Actor results from the run's dataset (if there are any)
17print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
18for item in client.dataset(run.default_dataset_id).iterate_items():
19    print(item)
20
21# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Agent Web Access Plan API in Python

The Apify API client for Python is the official library that allows you to use Agent Web Access Plan API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Agent Web Access Plan API in JavaScript

Agent Web Access Plan API through CLI

Agent Web Access Plan OpenAPI definition

Agent Web Access Plan API

Sitemap Extractor - Hardened URL Inventory

8tp/sitemap-url-extractor-coverage-api

Extract URL inventories from public HTTPS sitemap XML and gzip files with robots.txt discovery, bounded index traversal, and machine-readable coverage receipts. No page crawling, login, browser, proxy, or private-network access.

Hunter M.

Structured Data Extractor for AI Agents

bmiller1009/structured-data-extractor

Extract JSON-LD, schema.org types, OpenGraph, and microdata from a public page for machine-readable consumption.

Sentinel Signal

Agent Accessibility Auditor llms txt Robots AI Schema Check

mambalabs/agent-accessibility-auditor

Can an AI agent read this site. Checks llms.txt, robots AI crawler rules and the Content Signal policy, structured data, render mode, and machine readable endpoints like sitemap, OpenAPI and well known files. Every field is a fact read off a fetch, never a model opinion.

Mamba Labs

SEO Audit Tool: Title, Meta, Schema, Robots, Sitemap

eliai/website-seo-tech-auditor

SEO audit for any URL or whole site: crawl mode finds redirect chains, broken links, duplicate titles; page mode checks title/meta, headings, schema, robots.txt, sitemap, canonical. Machine-readable JSON with a pre-sorted fix list. $0.10 per page audited, failures free.

Broke to Built

Public SaaS Pricing Page Intelligence Agent

jacksu/public-pricing-page-intelligence-agent

Extract bounded plan, price, billing-period, feature, and evidence signals from public SaaS pricing pages with useful-result pricing.

jack su

Web2json Agent

legible_ship/web2json-agent

国强杨

Web Lead Generation Agent

cipher_zero/lead-gen-agent

Jose Miguel Madueño

Robots Meta X-Robots Auditor

junipr/robots-meta-xrobots-auditor

Audit page-level robots directives from meta tags and X-Robots-Tag headers and detect conflicting indexability signals.

junipr

AI Crawler & llms.txt Policy Auditor

quanmatrix/ai-crawler-llmstxt-policy-auditor

Audit robots.txt policies for major AI crawlers and inspect llms.txt discovery files for public websites with structured machine-readable results.

Rafael Barreto Haddad

Web Page to Markdown

alleserojje/web-page-to-markdown

Convert any web page into clean, readable Markdown or plain text — ads, navigation and boilerplate stripped out. Built for feeding AI agents, LLMs and RAG pipelines. Pay only per page.