Pro Web Content Crawler (With Images) avatar

Pro Web Content Crawler (With Images)

Try for free

Pay $30.00 for 1,000 results

View all Actors
Pro Web Content Crawler (With Images)

Pro Web Content Crawler (With Images)

assertive_analogy/pro-web-content-crawler
Try for free

Pay $30.00 for 1,000 results

Pro Web Content Crawler is a powerful tool that digs deep into web content and images. It handles complex sites, dynamic pages, and hidden content, making it perfect for extracting both data and images. Customizable and API-ready for your unique data needs.

Base URL

baseUrlstringRequired

The starting URL for the crawler

Link Selector

linkSelectorstringOptional

CSS selector for finding links on the page

Default value of this property is "a"

Content Selector

contentSelectorstringOptional

CSS selector for extracting content

Default value of this property is "body"

Maximum Depth

maxDepthintegerOptional

The maximum depth of links to follow

Default value of this property is 3

Maximum Pages

maxPagesintegerOptional

The maximum number of pages to crawl

Default value of this property is 100

Developer
Maintained by Community
Actor metrics
  • 2 monthly users
  • 2 stars
  • Created in Oct 2024
  • Modified about 15 hours ago