AI Web Scraper [No API Key Needed] avatar

AI Web Scraper [No API Key Needed]

Deprecated
Go to Store
This Actor is deprecated

This Actor is unavailable because the developer has decided to deprecate it. Would you like to try a similar Actor instead?

See alternative Actors
AI Web Scraper [No API Key Needed]

AI Web Scraper [No API Key Needed]

vulnv/ai-web-scraper-no-api-key-needed

Scrape structured data effortlessly - just describe what you need in plain language, and get precise results tailored to your request. Simplify data extraction with a tool designed for ease and accuracy, no coding required.

Developer
Maintained by Community

Start URLs

start_urlsarrayRequired

URLs to start with

Prompt

promptstringRequired

Describe the desired output of the scraper, for example 'Find all articles and their authors'.

Default value of this property is "List me all the features with their description."

Maximum depth

max_depthintegerRequired

Depth to which to scrape to

Default value of this property is 0

Initial cookies

initial_cookiesstringOptional

Cookies that will be pre-set to all pages the scraper opens. This is useful for pages that require login. The value is expected to be a JSON array of objects with name and value properties. For example: [{"name": "cookieName", "value": "cookieValue"}].

You can use the EditThisCookie browser extension to copy browser cookies in this format, and paste it here.

Default value of this property is "[]"

Save HTML to Key-Value store

save_html_to_key_value_storebooleanOptional

If enabled, the crawler stores full transformed HTML of all pages found to the default key-value store and saves links to the files as htmlUrl field in the output dataset. Storing HTML in key-value store is preferred to storing it into the dataset with the saveHtml option, because there's no size limit and it's easier for debugging as you can easily view the HTML.

Default value of this property is true

Save Markdown

save_markdown_to_key_value_storebooleanOptional

If enabled, the crawler converts the transformed HTML of all pages found to Markdown, and stores it under the markdown field in the output dataset.

Default value of this property is true