Dynamic Web Scraper

josejet/dynamic-web-scraper

Dynamic Web Scraper is an Apify Actor that gathers information online by simulating user browsing behavior on the web. It reduces the time and amount of scraped web pages by using a model (ChatGPT) to make decisions regarding browser navigation and results evaluation.

You can access the Dynamic Web Scraper programmatically from your own applications by using the Apify API. You can choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

1echo '{
2  "startSources": [
3    "Lucerna Bar Cafe, Prague"
4  ],
5  "prompt": "Look for the food menu items and if you find it look for a chicken option"
6}' |
7apify call josejet/dynamic-web-scraper --silent --output-dataset

Dynamic Web Scraper API through CLI

The Apify CLI is the official tool that allows you to use Dynamic Web Scraper locally, providing convenience functions and automatic retries on errors.

Install the Apify CLI

1npm i -g apify-cli
2apify login

Other API clients include:

Dynamic Web Scraper API in Python

Dynamic Web Scraper API in JavaScript

Dynamic Web Scraper OpenAPI definition

Dynamic Web Scraper API

Developer

Pepa <b>J</b>

Actor Metrics

1 monthly user
0 No bookmarks yet
>99% runs succeeded
Created in Feb 2025
Modified 2 days ago

Categories

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

76.2k

460

Dynamic Markdown Scraper

louisdeconinck/dynamic-markdown-scraper

Effortlessly feed LLM AIs with clean Markdown using our advanced web scraper. Seamlessly scrape dynamic, JavaScript-rendered websites while preserving original formatting. Ideal for AI training, documentation, and content migration.

Louis Deconinck

RegExp Scraper

ib4ngz/regexp-scraper

This actor scrapes data from a list of provided URLs using regular expressions for precise and customizable pattern matching. It can handle both static and dynamic web pages and supports depth-based crawling to explore links and extract data from multiple levels of the web.

Iqbal R

Ai Web Scraper - Extract Data With Ease

eloquent_mountain/ai-web-scraper-extract-data-with-ease

Ai Web Scraper enables scraping for everyone, including non-techies! It uses Google's Gemini LLM to scrape websites with natural language commands. It dynamically extracts data, no selector input needed, handles dynamic content and cookie consent, avoids bot detection, outputs JSON or other formats.

Paco

146

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

6.4k

121

🔥 Fast Indeed Jobs Scraper

memo23/apify-indeed-cheerio

Web scraper for Indeed.com job listings. Add Indeed URLs to customize searches. Set max jobs, concurrency, and other parameters to optimize performance while respecting site resources. Efficiently extracts job data, balancing speed with ethical practices. Ideal for gathering targeted job market info

Muhamed Didovic

121

Indeed job scraper

curious_coder/indeed-scraper

This is an actively maintained scraper which can extract job postings and hiring company details at scale from any indeed search results page for a fixed monthly rental price. Well documented with examples and demos

Curious Coder

1.2k

Rent Scraper

getdataforme/rent-scraper

The Rent Scraper is a web crawler that extracts rental listings from Rent.com. It collects key details such as rent price, location, size, number of bedrooms, bathrooms, and listing status. The scraper efficiently handles dynamic content, providing accurate, up-to-date rental insights.

GetDataForMe

Forrent Scraper

getdataforme/forrent-scraper

The ForRent Scraper is a web crawler that extracts rental listings from ForRent. It gathers key details such as rent price, location, size, number of bedrooms, bathrooms, and listing status. The scraper handles dynamic content and pagination, providing accurate, up-to-date rental insights.

GetDataForMe

Point2homes Scraper

getdataforme/point2homes-scraper

The Point2Homes Scraper is a web crawler that extracts real estate listings from Point2Homes. It gathers key details like price, location, size, bedrooms, bathrooms, and listing status. The scraper handles pagination and dynamic content, providing up-to-date, accurate insights.

GetDataForMe