Har Files For Url List
apify/har-files-for-url-list
Generates a HTTP Archive (HAR) file for web pages specified in a list of URLs. Optionally, the pages can be loaded using proxies from a specific country - to use this feature, you'll need access to Apify Proxy. On input, the actor accepts JSON object with the following fields: - sourceUrls: An array specifying which web pages to load. The format is same as the 'source' parameter of the RequestList in Apify SDK for Node.js. It can combined URLs as well as a link to a CSV file with the list of URLs. - country: Optional country code On output, the actor stores the resulting HAR files to the run's default key-value store, and also stores a table into the dataset with information about each web page visited and a link to the corresponding HAR file, or description of errors.
- How to run
- Source code
- Statistics
To run the actor, you'll need an Apify account. Simply create a new task for the actor by clicking the green button above, modify the actor input configuration, click Run and get your results.
API
To run the actor from your code, send a HTTP POST request to the following API endpoint:
https://api.apify.com/v2/acts/apify~har-files-for-url-list/runs?token=<YOUR_API_TOKEN>The POST payload including its Content-Type header is passed as INPUT to the actor (usually application/json). The actor is started with the default options; you can override them using various URL query parameters.
Example
curl https://api.apify.com/v2/acts/apify~har-files-for-url-list/runs?token=<YOUR_API_TOKEN> \
-d '{
"country": null,
"sourceUrls": [
{ "url": "http://www.example.com/" },
{ "url": "https://www.wikipedia.org/" },
{ "url": "https://www.apify.com/" },
{ "requestsFromUrl": "https://apifier-user-uploaded-files-prod.s3.amazonaws.com/46FWvpepkbTtGvDxL-url_list.csv" }
]
}' \
-H 'Content-Type: application/json' \
-X POSTTo use the API, you'll need to replace <YOUR_API_TOKEN> with the API token of your Apify account (view here).
For more information, view the list of actor's API endpoints or the full API reference.
