Download HTML from URLs

  • mtrunkat/url-list-download-html
  • Modified
  • Users 5.8k
  • Runs 174.1k
  • Created by Author's avatarMarek Trunkát

This actor takes a list of URLs and downloads HTML of each page.

This actor simply scrapes the full HTML code for all given URLs. In input you can define which proxies should be used.

Additionally, you can define a selector that will be awaited for each of the URLs simply by adding waitForSelector field to userData property of the request:

{
    "requestListSources": [{
        "url": "https://example.com",
        "userData": {
            "waitForSelector": ".class-i-want-to-wait-for"
        }
    }]
}

Industries

See how Download HTML from URLs is used in industries around the world