1 day trial then $50.00/month - No credit card required now

Cloudflare Web Scraper

dtrungtin/cloudflare-web-scraper

1 day trial then $50.00/month - No credit card required now

Prevents Puppeteer from being detected as a bot in services like Cloudflare and allows you to pass captchas without any problems

Start URLs

startUrlsarrayRequired

URLs to start with.

Wait for seconds

waitForSecondsintegerOptional

Wait for seconds

Default value of this property is 10

Wait for page title (Not include)

waitForTitlestringOptional

Wait for page title which doesn't include

Wait for url

waitForUrlstringOptional

Wait for the URL

Page function

pageFunctionstringOptional

Function that takes a Cheerio handle ($) as argument and returns data as output

Proxy configuration

proxyConfigobjectRequired

The best option is usually Automatic proxy. But you can also use your own proxies or no proxy

Developer

Tin Duong

Actor Metrics

19 monthly users
1 bookmark
91% runs succeeded
2.3 hours response time
Created in Sep 2024
Modified 4 months ago

Categories

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

36.6k

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

6.4k

120

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

76.1k

457

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

5.3k

Download HTML from URLs

mtrunkat/url-list-download-html

This actor takes a list of URLs and downloads HTML of each page.

Marek Trunkát

8.3k

Tiktok Shop Scraper

excavator/tiktok-shop-scraper

This is the Actor for crawling data from the TikTok shop product URLs. For example: https://shop.tiktok.com/view/product/XXXXXXXXXX These URLs are only available for TikTok Shop US. You can test it here: https://apify.com/excavator/tiktok-shop-product

Excavator

Youtube Video Downloader

epctex/youtube-video-downloader

Effortlessly download YouTube videos of your preferred quality with our user-friendly Video Downloader. Try it now!

epctex

769

🔥 LinkedIn Jobs Scraper

bebity/linkedin-jobs-scraper

ℹ️ Designed for both personal and professional use, simply enter your desired job title and location to receive a tailored list of job opportunities. Try it today!

Bebity

6.2k

205

Instagram Followers Count Scraper

apify/instagram-followers-count-scraper

Scrape the number of followers & follows from any Instagram profile. Schedule the scraper to run regularly to monitor how the numbers change. You can also export scraped data, run the scraper via API, monitor runs or integrate with other tools.

Apify

3.6k