Pricing

Pay per event

Go to Store

Dynamic Web Scraper

Try for free

Developed by

Pepa J W̚͠h̾̔̎̿͊͛̄͊e̢̦̲̰̦̋̇͗̾̑oi̟͈̯̝̊̉́̇͑̕ğ̆͘͡e͗͛o͊̔̇̄

Dynamic Web Scraper is an Apify Actor that gathers information online by simulating user browsing behavior on the web. It reduces the time and amount of scraped web pages by using a model (ChatGPT) to make decisions regarding browser navigation and results evaluation.

0.0 (0)

Pricing

Pay per event

Total users

147

Monthly users

Runs succeeded

>99%

Issues response

10 hours

Last modified

4 months ago

Automation

Open source

You can access the Dynamic Web Scraper programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

$echo '{
<  "startSources": [
<    "Lucerna Bar Cafe, Prague"
<  ],
<  "prompt": "Look for the food menu items and if you find it look for a chicken option"
<}' |
<apify call josejet/dynamic-web-scraper --silent --output-dataset

Dynamic Web Scraper API through CLI

The Apify CLI is the official tool that allows you to use Dynamic Web Scraper locally, providing convenience functions and automatic retries on errors.

Install the Apify CLI

$npm i -g apify-cli
$apify login

Other API clients include:

Dynamic Web Scraper API in Python

Dynamic Web Scraper API in JavaScript

Dynamic Web Scraper OpenAPI definition

Dynamic Web Scraper API

Browser Use Apify

lexis-solutions/browser-use-apify

Open-source AI-powered browser automation based on Browser Use and hosted on Apify. Run any task using Apify's platform and LLMs like ChatGPT, Claude, etc. Easy, scalable, resilient, and hosted solution for web-enabled AI agents.

Lexis Solutions

166

5.0

RAG Web Browser

apify/rag-web-browser

Web browser for OpenAI Assistants, RAG pipelines, or AI agents, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages, and returns their content as Markdown for further processing by an LLM. It can also scrape individual URLs. Supports Model Context Protocol (MCP).

Apify

4.3K

4.3

Web Scraper

apify/web-scraper

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

89K

4.5

AI Product Recommendation Agent

matymar/ai-product-recommendation-agent

The AI Product Recommendation Agent helps users find the best products based on their needs using a simple query. It analyzes product listings, reviews, and ratings to provide well-informed recommendations.

Matouš Mařík

5.0

Ui Generator

tinkerbrains/ui-generator

Get UI designs for your app ideas. Get HTML + TailwindCSS code and a full screenshot of the design in output data. You will need a Anthropic Claude API Key to add in environment variables.

Sanket Dongre

AI Web Agent

apify/ai-web-agent

Use natural language prompts to browse the web, click on elements, fill and submit forms, extract data, and take screenshots using the OpenAI API.

Apify

1.5K

4.2

Web Scraper Task

undrtkr984/web-scraper-task

Matt

118

Dataset Query Engine

jiri.spilka/dataset-query-engine

Use natural language queries to retrieve results from an Apify dataset. This Actor provides a query engine that loads a dataset, executes SQL queries, and synthesizes results.

Jiří Spilka

4.6

Dynamic Markdown Scraper

louisdeconinck/dynamic-markdown-scraper

Effortlessly feed LLM AIs with clean Markdown using our advanced web scraper. Seamlessly scrape dynamic, JavaScript-rendered websites while preserving original formatting. Ideal for AI training, documentation, and content migration.

Louis Deconinck

5.0

Opinion Compass Agent

jan.turon/opinion-compass

An AI agent that analyzes individuals' stances on specific statements using public social media data. You enter a person's name and an opinion statement, and the Actor evaluates multiple sources to provide a detailed assessment with supporting evidence. The agent is built using LangGraph and Python.