Website Contact Crawler
Pricing
Pay per usage
Pricing
Pay per usage
Rating
5.0
(1)
Developer
Man Mohit verma
Maintained by CommunityActor stats
0
Bookmarked
12
Total users
4
Monthly active users
16 days ago
Last modified
Categories
Share
Website Contact Crawler
Pricing
Pay per usage
Pricing
Pay per usage
Rating
5.0
(1)
Developer
Man Mohit verma
Maintained by CommunityActor stats
0
Bookmarked
12
Total users
4
Monthly active users
16 days ago
Last modified
Categories
Share
List of website URLs to start crawling from (supports hundreds or thousands of seeds as a JSON array).
How many link hops to follow from each starting URL.
Maximum number of pages to scrape per starting URL (including the start page itself). Crawling stops for a site when this limit or the depth limit is reached, whichever comes first. Set to 0 for no limit.
Default region used by phonenumbers for national numbers.
Concurrent page fetches per worker band. With proxyPoolSize=10 and this set to 50, up to 500 pages can be fetched in parallel. Each fetch uses a new residential proxy session (per-request IP rotation), not a fixed IP pool.
Number of parallel worker bands. Total workers = maxConcurrencyPerIp × proxyPoolSize. Does not reserve fixed IPs; each request still rotates to a new residential proxy session.
Maximum simultaneous in-flight requests to the same website host. Helps avoid overwhelming a single domain when many seeds share infrastructure. Set to 0 to disable the limit.
global: keep one row per contact value across all seeds. perStartingUrl: allow the same value under different starting URLs.
Paths that are added for depth 1 from each start URL.
Skip any URL containing one of these keywords at any depth.