Metadata Scraper avatar

Metadata Scraper

Try for free

2 hours trial then $20.00/month - No credit card required now

Go to Store
Metadata Scraper

Metadata Scraper

louisdeconinck/metadata-scraper
Try for free

2 hours trial then $20.00/month - No credit card required now

Automatically scrape metadata such as title, description, heading and article from websites. It will crawl the start URLs and then scrape the metadata from the detail pages automatically navigating through the pagination.

Start URLs

startUrlsarrayOptional

URLs to start with including the urls to scrape and the pagination urls.

Max Requests per Crawl

maxRequestsPerCrawlintegerOptional

Maximum number of requests that can be made by this crawler.

Default value of this property is 100

URLs to Ignore

urlsToIgnorearrayOptional

URLs to ignore when processing.

Developer
Maintained by Community

Actor Metrics

  • 10 monthly users

  • 2 stars

  • >99% runs succeeded

  • Created in Oct 2024

  • Modified 2 months ago