Pricing

Pay per event

Go to Store

Dynamic Web Scraper

Try for free

Developed by

Pepa <b>J</b>

Dynamic Web Scraper is an Apify Actor that gathers information online by simulating user browsing behavior on the web. It reduces the time and amount of scraped web pages by using a model (ChatGPT) to make decisions regarding browser navigation and results evaluation.

0.0 (0)

Pricing

Pay per event

Total users

Monthly users

Runs succeeded

>99%

Issues response

10 hours

Last modified

3 months ago

Automation

Open source

You can access the Dynamic Web Scraper programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with your Apify API token
4// Replace the '<YOUR_API_TOKEN>' with your token
5const client = new ApifyClient({
6    token: '<YOUR_API_TOKEN>',
7});
8
9// Prepare Actor input
10const input = {
11    "startSources": [
12        "Lucerna Bar Cafe, Prague"
13    ],
14    "prompt": "Look for the food menu items and if you find it look for a chicken option"
15};
16
17// Run the Actor and wait for it to finish
18const run = await client.actor("josejet/dynamic-web-scraper").call(input);
19
20// Fetch and print Actor results from the run's dataset (if any)
21console.log('Results from dataset');
22console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
23const { items } = await client.dataset(run.defaultDatasetId).listItems();
24items.forEach((item) => {
25    console.dir(item);
26});
27
28// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

Dynamic Web Scraper API in JavaScript

The Apify API client for JavaScript is the official library that allows you to use Dynamic Web Scraper API in JavaScript or TypeScript, providing convenience functions and automatic retries on errors.

Install the apify-client

$npm install apify-client

Other API clients include:

Dynamic Web Scraper API in Python

Dynamic Web Scraper API through CLI

Dynamic Web Scraper OpenAPI definition

Dynamic Web Scraper API

Web Scraper

apify/web-scraper

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

85K

4.4

Web Crawler

rigelbytes/webcrawler

This web crawler is designed to provide users with complete flexibility by allowing them to use their **own proxies**. The scraper collects all pages from the website and returns extracts the **MetaData**, **Title**, and **Content** of the page in MarkDown.

Rigel Bytes

Actor README Generator Agent

jkuzz/actor-readme-generator-agent

Generates a README for an Apify Actor using an AI Agent. You only need to provide the actor id to generate a readable and SEO optimized README for the Actor. The generation process utilizes Apify's Official README Guide. This Agent is open source (link in readme).

Jan Kuželík

Web Scraper Experimental Debug

mtrunkat/web-scraper-experimental-dbgr

Experimental version of Apify Web Scraper with Chrome debugger integrated

Marek Trunkát

Browser Pool

marco.gullo/browser-pool

A Standby Actor for providing a pool of on-demand browsers, accessible through CDP.

Marco Gullo

Xxxlutz Scraper

getdataforme/xxxlutz-scraper

xxxlutz Scraper: Apify Actor extracts product data (name, price, images, SKU, description) from xxxlutz.de using German residential proxies. Returns structured JSON for market analysis and inventory tracking. Complies with DE e-commerce standards.

GetDataForMe

Actor Inspector Agent

jakub.kopecky/actor-inspector-agent

Agent Actor Inspector 🕵️‍♂️: An Apify Actor that rates others on docs 📝, inputs 🔍, code 💻, functionality ⚙️, performance ⏱️, and uniqueness 🌟. Config with actorId array, run, and review results. Helps devs improve, ensures quality, and guides users.

Jakub Kopecký

Summary XL

flamboyant_leaf/summary-xl

SummaryXL analyzes large amounts of data from any API, website, or files, creating concise summaries based on user input. Integrated with platforms like Apify, it processes datasets such as social media posts, focusing on specific topics.

AIRabbit

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

4.7