Website Content Crawler avatar
Website Content Crawler

Pricing

Pay per usage

Go to Store
Website Content Crawler

Website Content Crawler

Developed by

Apify

Apify

Maintained by Apify

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

4.6 (38)

Pricing

Pay per usage

1282

Total users

48.3k

Monthly users

6.9k

Runs succeeded

>99%

Issue response

5 days

Last modified

13 hours ago

DA

apify_client._errors.ApifyApiError: You must rent a paid Actor in order to run it.

Closed

dresma_apify opened this issue
8 months ago

Prepare the Actor input

run_input = { "keywords": ["fridge"], "pages": 1, "maxRequests": 50, }

Run the Actor and wait for it to finish

run = client.actor("crafter/amazon-keyword-scraper").call(run_input=run_input)

jiri.spilka avatar

Hi, thank you for using Apify.

Apify offers tools for web scraping and automation. We have an app store with Actors, which can be created either by Apify or by the community.

In this case, the "Website Content Crawler" was created and is maintained by Apify. However, the "crafter/amazon-keyword-scraper" tool was developed by a community member (crafter) and requires a $5 subscription fee to use. Since this Actor is not maintained by Apify but runs on the Apify platform, a subscription is required to use it.

Please note the information on console.apify.com: To use this Actor, you must pay a monthly fee to the developer. This fee is deducted from your prepaid usage each month after the free trial period. Additionally, you will incur costs for using the Apify platform.

For more information about rental Actors, you can visit: Rental Actors. These are Actors that require a recurring fee after the trial period. This fee allows developers to invest more time and effort into maintaining and improving their Actors, ensuring high quality and ongoing support.

I'll close this issue now. Please let us know if you have any further questions or concerns.