Pricing

$10.00/month + usage

Go to Store

Incremental Web Crawler

Try for free

flamboyant_leaf/incrementalcrawler-v2

Developed by

AIRabbit

The Incremental Crawler efficiently fetches URLs of recently added or updated web pages on a target site, optimizing resources by focusing only on new content. Ideal for keeping up with the latest updates, it integrates seamlessly into workflows for content monitoring and analysis.

0.0 (0)

Pricing

$10.00/month + usage

Monthly users

Runs succeeded

>99%

Last modified

4 months ago

Automation Integrations

URL

urlstringRequired

The URL to check for new pages

Days Ago

daysAgointegerOptional

Number of days to look back for new URLs

Default value of this property is 1

Language

languagestringOptional

Language for search results

Default value of this property is "en"

Country

countrystringOptional

Country for search results

Default value of this property is "us"

Search Domain

searchDomainstringOptional

Domain to use for search

Default value of this property is "google.com"

Next Run ID

nextRunIdstringOptional

ID of the next task to run

Next Run Attribute

nextRunAttributestringOptional

Attribute to replace in the next run (default: startUrls)

Default value of this property is "startUrls"

Max Results

maxResultsintegerOptional

Maximum number of results to fetch

Default value of this property is 10

Pricing

Pricing model

Rental

To use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.

Free trial

1 day

Price

$10.00

Incremental Web Crawler

flamboyant_leaf/IncrementalCrawler-v2

AIRabbit

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

42.4k

4.6/5

Twitter (X.com) Scraper Unlimited: No Rate-Limits

apidojo/twitter-scraper-lite

Introducing Twitter Scraper Unlimited, the most comprehensive Twitter data extraction solution available. Our enterprise-grade scraper offers unmatched capabilities with a transparent event-based pricing model, making it perfect for both small-scale and large-scale data extraction needs.

API Dojo

2.8k

Parsera

parsera-labs/parsera

Extract data from any website using just a URL and column descriptions

Parsera Labs

Youtube Video Downloader

epctex/youtube-video-downloader

Effortlessly download YouTube videos of your preferred quality with our user-friendly Video Downloader. Try it now!

epctex

934

🔥 LinkedIn Jobs Scraper

bebity/linkedin-jobs-scraper

ℹ️ Designed for both personal and professional use, simply enter your desired job title and location to receive a tailored list of job opportunities. Try it today!

Bebity

7.5k

Fast TikTok API (free-watermark videos)

novi/fast-tiktok-api

All in one TikTok APIs. Fastest TikTok API for Trend, Hashtag, Search, Music, User, Comment. Provides no-watermark download link.

Novi

1.1k

Telegram scraper and adder

curious_coder/telegram-scraper

Scrape group members of any telegram group and and auto add them to your group. Schedule this tool to run daily and grow your group by adding your competitors audience.

Curious Coder

7.1k

Instagram Followers Count Scraper

apify/instagram-followers-count-scraper

Scrape the number of followers & follows from any Instagram profile. Schedule the scraper to run regularly to monitor how the numbers change. You can also export scraped data, run the scraper via API, monitor runs or integrate with other tools.

Apify

3.9k