Download HTML from URLs

  • mtrunkat/url-list-download-html
  • Modified
  • Users 6.1k
  • Runs 179.2k
  • Created by Author's avatarMarek Trunkát

This actor takes a list of URLs and downloads HTML of each page.

To run the code examples, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token. For a more detailed explanation, please read about running Actors via the API in Apify Docs.

import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with API token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "requestListSources": [
        {
            "url": "https://apify.com"
        }
    ],
    "proxyConfiguration": {
        "useApifyProxy": true
    },
    "maxRequestRetries": 1
};

(async () => {
    // Run the Actor and wait for it to finish
    const run = await client.actor("mtrunkat/url-list-download-html").call(input);

    // Fetch and print Actor results from the run's dataset (if any)
    console.log('Results from dataset');
    const { items } = await client.dataset(run.defaultDatasetId).listItems();
    items.forEach((item) => {
        console.dir(item);
    });
})();