Website Contact Crawler
Pricing
Pay per usage
Pricing
Pay per usage
Rating
5.0
(1)
Developer
Man Mohit verma
Maintained by CommunityActor stats
0
Bookmarked
18
Total users
4
Monthly active users
a month ago
Last modified
Categories
Share
Website Contact Crawler
Pricing
Pay per usage
Pricing
Pay per usage
Rating
5.0
(1)
Developer
Man Mohit verma
Maintained by CommunityActor stats
0
Bookmarked
18
Total users
4
Monthly active users
a month ago
Last modified
Categories
Share
List of website URLs to start crawling from (supports hundreds or thousands of seeds as a JSON array).
How many link hops to follow from each starting URL.
Maximum number of pages to scrape per starting URL (including the start page itself). Crawling stops for a site when this limit or the depth limit is reached, whichever comes first. Set to 0 for no limit.
Default region used by phonenumbers for national numbers.
Concurrent page fetches per worker band. With proxyPoolSize=10 and this set to 50, up to 500 pages can be fetched in parallel. Each fetch uses a new residential proxy session (per-request IP rotation), not a fixed IP pool.
Number of parallel worker bands. Total workers = maxConcurrencyPerIp × proxyPoolSize. Does not reserve fixed IPs; each request still rotates to a new residential proxy session.
Maximum simultaneous in-flight requests to the same website host. Helps avoid overwhelming a single domain when many seeds share infrastructure. Set to 0 to disable the limit.
global: keep one row per contact value across all seeds. perStartingUrl: allow the same value under different starting URLs.
Paths that are added for depth 1 from each start URL.
Skip any URL containing one of these keywords at any depth.