Pricing

from $5.00 / 1,000 website analyzeds

Try for free

Go to Apify Store

Website Key Pages Finder

Try for free

Find key pages (pricing, docs, status, security, privacy, terms) on any website. Crawls start URLs and returns structured URLs with confidence scores and evidence. Great for competitor analysis, lead enrichment, and audits.

Pricing

from $5.00 / 1,000 website analyzeds

Rating

0.0

(0)

Developer

Howard

Actor stats

Bookmarked

Total users

Monthly active users

10 months ago

Last modified

Categories

Automation

Developer tools

Start URLs

startUrls

Required

URLs of websites to find key pages for. Each URL should be a website homepage or any page from the domain (e.g., https://example.com).

Type:array

Max Crawl Depth

maxDepth

Optional

Maximum crawl depth. 0 = homepage only, 1 = homepage + priority pages like /about, /legal, etc. (recommended). Note: True recursive crawling is not currently supported.

Type:integer

Minimum:0

Maximum:1

Default:1

Max Pages per Domain

maxPagesPerDomain

Optional

Maximum number of pages to fetch per domain. Helps control costs and processing time.

Type:integer

Minimum:1

Maximum:100

Default:12

Include Subdomains

includeSubdomains

Optional

Whether to include subdomains when discovering pages (e.g., docs.example.com, status.example.com).

Type:boolean

Default:true

Return Top N Candidates

returnTopN

Optional

Number of top candidates to return per page type. Set higher to see alternative candidates for ambiguous cases.

Type:integer

Minimum:1

Maximum:10

Default:1

Timeout (Seconds)

timeoutSecs

Optional

Timeout in seconds for processing each site.

Type:integer

Minimum:5

Maximum:300

Default:30

Debug Mode

debug

Optional

Whether to include debug information (raw candidates) in output. Useful for understanding why certain pages were selected.

Type:boolean

Default:false

Proxy Configuration

proxyConfiguration

Optional

Proxy settings to avoid IP blocks. Recommended for production use on most sites. Supports Apify Proxy or custom proxy URLs.

Type:object

Default:

{
  "useApifyProxy": false
}

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

167K

4.6

(234)

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, AI Mode, AI overviews, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export data, run the scraper via API, schedule runs, or integrate with other tools.

Apify

199K

4.6

(218)

Instagram Search Scraper

apify/instagram-search-scraper

Scrape Instagram search results: places, businesses, locations, users, popular reels, and hashtags. Add a keyword and extract search results like contact details, categories, metrics, recent posts, hashtag popularity. Export scraped data, schedule via API, integrate with other tools or AI workflows.

Apify

31K

4.8

(32)

TikTok Profile Scraper

clockworks/tiktok-profile-scraper

Extract data from TikTok profiles and videos they post. Get TikTok profile data, URLs, numbers of shares, followers, comments, hearts, video and music metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

50K

4.7

(73)

Facebook Comments Scraper

apify/facebook-comments-scraper

Extract data from hundreds of Facebook comments from one or multiple Facebook posts. Get comment text, timestamp, likes count and basic commenter info. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

46K

4.7

(88)

Website SEO Audit Crawler — On-Page Analyzer

logiover/website-seo-audit-crawler

Crawl a whole website and export an on-page SEO audit to CSV/JSON: meta tag checker, canonical & noindex checker, schema.org type extractor. No browser.

Logiover

127

Page Speed Analyzer — Lighthouse & Web Vitals

nexgendata/page-speed-analyzer

Run Google Lighthouse audits at scale — Core Web Vitals, performance scores, SEO analysis. Track site speed across all pages. No API key. Pay per record.

NexGenData

134

Apify Ideas Radar

yummy_gelato/apify-ideas-radar

Scans Apify Ideas and Store actors to surface build opportunities. Discover mode maps each idea to top actor matches; Search mode validates a keyword with semantic/exact matching, challenge eligibility, and competition/demand summary.

Howard

Instagram Profile Scraper

apify/instagram-profile-scraper

Scrape all Instagram profile info. Just add Instagram usernames, IDs or URLs and extract name, join date, number of followers, location, bio, website, related profiles, video&post count, latest posts. Export scraped data, schedule scraper via API, and integrate with other tools or AI workflows.

Apify

241K

4.7

(175)

Website Change Notification API

gr_59017/website-change-notification-api

Monitors websites for content changes using Cheerio. Compares current and previous page versions and notifies when changes are detected. Ideal for tracking notices, updates, pricing changes, and announcements.