Monolith
No credit card required
Monolith
No credit card required
A data hoarder’s dream come true: bundle any web page into a single HTML file. This Actor is a wrapper of the popular open-source library.
Adam KlimentActor Metrics
9 monthly users
No reviews yet
3 bookmarks
>99% runs succeeded
Created in May 2024
Modified 2 days ago
Monolith Actor on Apify
This Actor wraps the Monolith Project to crawl a web page URL and bundle the entire content in a single HTML file, without installing and running the tool locally.
What are Actors?
Actors are serverless microservices running on the Apify Platform. They are based on the Actor SDK and can be found in the Apify Store. Learn more about Actors in the Apify Whitepaper.
Usage
Apify Console
- Go to the Apify Actor page
- Click "Run"
- In the input form, fill in URL(s) to crawl and bundle
- The Actor will run and :
- save the bundled HTML files in the run's default key-value store
- save the links to the KVS with original URL and monolith process exit status to the dataset
Apify CLI
1apify call netmilk/monolith --input='{ 2 "urls": ["https://news.ycombinator.com/"] 3}'
Using Apify API
1curl --request POST \ 2 --url "https://api.apify.com/v2/acts/netmilk~monolith/run" \ 3 --header 'Content-Type: application/json' \ 4 --header 'Authorization: Bearer YOUR_API_TOKEN' \ 5 --data '{ 6 "urls": ["https://news.ycombinator.com/"], 7 } 8}'
Input Parameters
The Actor accepts a JSON schema with the following structure:
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
urls | array | Yes | - | List of URLs to monolith |
urls[] | string | Yes | - | URL to monolith |
Example Input
1{ 2 "urls": ["https://news.ycombinator.com/"], 3}
Output
The Actor provides three types of outputs:
Dataset Record
| Field | Type | Required | Description |
|---|---|---|---|
url | string | Yes | A link to the Apify key-value store object where the monolithic html is available for download |
kvsUrl | array | Yes | Exit status of the monolith process |
status | number | No | The original start URL for the monolith process |
Example Dataset Item (JSON)
1{ 2 "url": "https://news.ycombinator.com/", 3 "kvsUrl": "https://api.apify.com/v2/key-value-stores/JRFLHRy9DOtdKGpdm/records/https___news.ycombinator.com_", 4 "status": "0" 5}
Performance & Resources
- Memory Requirements:
- Minimum: 4168 MB RAM
- Processing Time:
- 30s per compex page like bbc.co.uk
For more help, check the Monolith Project documentation or raise an issue in the Actor page detail on Apify.
