You can access the AI Web Agent programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "startUrl": "https://apify.com",
10    "instructions": "Go to the pricing page, extract information about all pricing plans, and save it into dataset.",
11    "model": "gpt-4o-mini",
12    "proxyConfiguration": { "useApifyProxy": True },
13}
14
15# Run the Actor and wait for it to finish
16run = client.actor("apify/ai-web-agent").call(run_input=run_input)
17
18# Fetch and print Actor results from the run's dataset (if there are any)
19print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
20for item in client.dataset(run["defaultDatasetId"]).iterate_items():
21    print(item)
22
23# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

AI Web Agent API in Python

The Apify API client for Python is the official library that allows you to use AI Web Agent API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

AI Web Agent API in JavaScript

AI Web Agent API through CLI

AI Web Agent OpenAPI definition

AI Web Agent API

Dynamic Web Scraper

josejet/dynamic-web-scraper

Dynamic Web Scraper is an Apify Actor that gathers information online by simulating user browsing behavior on the web. It reduces the time and amount of scraped web pages by using a model (ChatGPT) to make decisions regarding browser navigation and results evaluation.

Pepa J W̚͠h̾̔̎̿͊͛̄͊e̢̦̲̰̦̋̇͗̾̑oi̟͈̯̝̊̉́̇͑̕ğ̆͘͡e͗͛o͊̔̇̄

164

RAG Web Browser

apify/rag-web-browser

Web browser for OpenAI Assistants, RAG pipelines, or AI agents, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages, and returns their content as Markdown for further processing by an LLM. It can also scrape individual URLs. Supports Model Context Protocol (MCP).

Apify

5.3K

4.4

AI Product Recommendation Agent

matymar/ai-product-recommendation-agent

The AI Product Recommendation Agent helps users find the best products based on their needs using a simple query. It analyzes product listings, reviews, and ratings to provide well-informed recommendations.

Matouš Mařík

5.0

Ai Web Scraper - Natural language and Vision scraper

eloquent_mountain/ai-universal-web-scraper-natural-language

Powerful AI Web Scraper using Google's Gemini Vision. Specify data extraction in natural language. Supports infinite scroll, above-the-fold analysis, automatic cookie consent, pay-per-event pricing, and screenshot storage for debugging.

Paco

161

Smart Scrape AI

llayaa112/smart-scrape-ai

Smart Scrape AI is an autonomous web automation and scraping actor powered by Playwright and AI. It dynamically interprets prompts, navigates websites, performs tasks, extracts data, and provides intelligent answers. Ideal for zero-code, prompt-driven data extraction and interaction workflows.

laya albshlawy

Ai Web Scraper - Extract Data With Ease

eloquent_mountain/ai-web-scraper-extract-data-with-ease

Ai Web Scraper enables scraping for everyone, including non-techies! It uses Google's Gemini LLM to scrape websites with natural language commands. It dynamically extracts data, no selector input needed, handles dynamic content and cookie consent, avoids bot detection, outputs JSON or other formats.

Paco

512

2.0

Ui Generator

tinkerbrains/ui-generator

Get UI designs for your app ideas. Get HTML + TailwindCSS code and a full screenshot of the design in output data. You will need a Anthropic Claude API Key to add in environment variables.

Sanket Dongre

AI Job Search Agent

louisdeconinck/ai-job-search-agent

The AI Job Search Agent automates job hunting by analyzing your LinkedIn profile, identifying relevant roles, searching for matches, and generating personalized cover letters using AI and web scraping.

Louis Deconinck

3.0

Backlink Building Agent

daniil.poletaev/backlink-building-agent

The Backlink Building Agent automates backlink outreach by finding relevant pages & websites, extracting contacts from these websites, and then crafting personalized outreach sequences based on the content to these partners. These sequences can be used on email, LinkedIn, Twitter, & WhatsApp.

Daniil Poletaev

227

5.0

Job Search Assistant AI Agent

harvestlabs/job-search-assistant-ai-agent

Automates the process of finding job listings based on user-defined preferences. Analyzes job postings, scores them based on relevance, and even generates tailored cover letters for each opportunity.