![AI Web Scraper [No API Key Needed] avatar](https://images.apifyusercontent.com/Atvmz0LBJRri3Gjwgk8WdgMSQQVjtqTYdSitWfu4nIY/rs:fill:250:250/aHR0cHM6Ly9hcGlmeS1pbWFnZS11cGxvYWRzLXByb2QuczMudXMtZWFzdC0xLmFtYXpvbmF3cy5jb20vYnBUdVliRUU5TmYxTkdOT08vZUJBNk9GMTNhZ1pkRWlTZ0Itcm9ib3QucG5n.webp){kind=avatar}
AI Web Scraper [No API Key Needed]
Pay $160.00 for 1,000 requests
AI Web Scraper [No API Key Needed]
Pay $160.00 for 1,000 requests
Scrape structured data effortlessly - just describe what you need in plain language, and get precise results tailored to your request. Simplify data extraction with a tool designed for ease and accuracy, no coding required.
Effortlessly extract structured data from web pages by simply describing what you need. This AI-powered web scraper is designed for precision and ease of use, allowing you to customize your data extraction with natural language prompts. Additionally, it attempts to bypass captchas to ensure uninterrupted scraping. Perfect for developers and data analysts looking to streamline their web scraping tasks.
Features
- Start URLs: Specify the URLs to begin your scraping.
- Natural Language Prompts: Define the desired output by describing it in plain language.
- Custom Depth: Configure the scraping depth to suit your needs.
- Captcha Bypass: Attempts to bypass captchas to ensure uninterrupted scraping.
- Initial Cookies: Pre-set cookies for all pages the scraper opens.
- Save HTML: Option to store the full transformed HTML of all pages.
- Save Markdown: Option to convert and store the transformed HTML as Markdown.
Configuration
Input Schema
The actor accepts the following input parameters:
| Field | Type | Description | Default Value |
|---|---|---|---|
| start_urls | Array | List of URLs to start scraping from. | [{"url": "https://apify.com"}] |
| prompt | String | Natural language description of the desired scraping output. | "List me all the features with their description." |
| max_depth | Integer | The maximum depth for recursive scraping. | 0 |
| initial_cookies | String | Cookies that will be pre-set to all pages the scraper opens. | [] |
| save_html_to_key_value_store | Boolean | If enabled, stores full transformed HTML of all pages found to the default key-value store. | true |
| save_markdown_to_key_value_store | Boolean | If enabled, converts the transformed HTML of all pages found to Markdown, and stores it under the markdown field in the output dataset. | true |
Example Input
1{ 2 "start_urls": [ 3 { "url": "https://apify.com" } 4 ], 5 "prompt": "List me all the features with their description.", 6 "max_depth": 0 7}
How to Use
- Set the start URLs to specify the pages you want to scrape.
- Write a prompt to describe your desired output.
- Set the maximum depth to control recursive scraping.
- Run the actor and get structured results based on your input!
Output
The actor outputs structured data in JSON format, tailored to your provided prompt.
Explore More Actors
✨ Looking for additional solutions? Check out more actors on Apify that can help with your web automation and data extraction needs. Discover a wide range of tools tailored for different scenarios at 🌐 Explore Vulnv's Actors on Apify.
📧 For inquiries or support, feel free to reach out to us at apify@vulnv.com.
VulnVActor Metrics
2 monthly users
-
1 star
>99% runs succeeded
Created in Dec 2024
Modified 4 days ago
