Under maintenance

2 hours trial then $15.00/month - No credit card required now

Go to Store

This Actor is under maintenance.

This Actor may be unreliable while under maintenance. Would you like to try a similar Actor instead?

See alternative Actors

AI Web Scraper

vulnv/ai-web-scraper

Try for free

2 hours trial then $15.00/month - No credit card required now

Scrape structured data effortlessly - just describe what you need in plain language, and get precise results tailored to your request. Simplify data extraction with a tool designed for ease and accuracy, no coding required.

Start URLs

start_urlsarrayRequired

URLs to start with

Prompt

promptstringRequired

Describe the desired output of the scraper, for example 'Find all articles and their authors'.

Default value of this property is "List me all the features with their description."

OpenAI API Key

api_keystringRequired

API key for OpenAI

Model

modelEnumRequired

The model to use for the OpenAI API

Value options:

"gpt-4o": string"gpt-4o-mini": string"o1": string

Default value of this property is "gpt-4o-mini"

Crawler type

crawler_typeEnumOptional

Type of the crawler to use

Value options:

"playwright": string"http": string

Default value of this property is "http"

Maximum depth

max_depthintegerRequired

Depth to which to scrape to

Default value of this property is 0

Initial cookies

initial_cookiesstringOptional

Cookies that will be pre-set to all pages the scraper opens. This is useful for pages that require login. The value is expected to be a JSON array of objects with name and value properties. For example: [{"name": "cookieName", "value": "cookieValue"}].

You can use the EditThisCookie browser extension to copy browser cookies in this format, and paste it here.

Default value of this property is "[]"

Proxy configuration

proxy_configurationobjectOptional

Select proxies to be used by your crawler.

Save HTML to Key-Value store

save_html_to_key_value_storebooleanOptional

If enabled, the crawler stores full transformed HTML of all pages found to the default key-value store and saves links to the files as htmlUrl field in the output dataset. Storing HTML in key-value store is preferred to storing it into the dataset with the saveHtml option, because there's no size limit and it's easier for debugging as you can easily view the HTML.

Default value of this property is false

Save Markdown

save_markdown_to_key_value_storebooleanOptional

If enabled, the crawler converts the transformed HTML of all pages found to Markdown, and stores it under the markdown field in the output dataset.

Default value of this property is false

Developer

VulnV

Actor Metrics

2 monthly users
1 star
25% runs succeeded
Created in Dec 2024
Modified 2 days ago

Categories

Automation

Integrations

Ai Web Scraper - Extract Data With Ease

eloquent_mountain/ai-web-scraper-extract-data-with-ease

Ai Web Scraper enables scraping for everyone, including non-techies! It uses Google's Gemini LLM to scrape websites with natural language commands. It dynamically extracts data, no selector input needed, handles dynamic content, avoids bot detection, and outputs JSON or other formats.

Paco

AI Web Scraper [No API Key Needed]

vulnv/ai-web-scraper-no-api-key-needed

VulnV

AI Markdown Web Scraper

jordanchalupka/ai-markdown-web-scraper

Turn any webpage into a clean markdown format. Perfect to use as input to your LLM.

Jordan

AI Vision Scraper

zscrape/ai-vision-scraper

AI Vision Scraper automates web tasks, navigating sites, solving CAPTCHAs, and extracting data on demand using a single prompt. From competitor tracking to form submissions, it streamlines workflows and automation across industries like e-commerce, sales, and recruiting.

ZScrape Solutions

AI Website Content Markdown Scraper

quaking_pail/ai-website-content-markdown-scraper

This Apify Actor, "Website Content Crawler with Markdown Extraction," is designed to perform a comprehensive crawl of specified websites, extract their text content, convert it into Markdown format, and store it in a structured dataset. The extracted content is suitable for feeding LLMs.

AI_Builder

240

📩📍 Google Maps Email Extractor

lukaskrivka/google-maps-with-contact-details

Extract Google Maps contact details. Scrape websites of Google Maps places for contact details and get email addresses, website, location, address, zipcode, phone number, social media links. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Lukáš Křivka

10k

285

Google Maps Extractor

compass/google-maps-extractor

Extract data from hundreds of places fast. Scrape Google Maps by keyword, category, location, URLs & other filters. Get addresses, contact info, opening hours, popular times, prices, menus & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

23.7k

537

Linkedin Sales Navigator Scraper

curious_coder/linkedin-sales-navigator-search-scraper

Scrape Linkedin sales navigator search results, lists, new results, profiles to extract email, social media urls, company website, positions.

Curious Coder

2.2k

Tiktok Profile Scraper

clockworks/tiktok-profile-scraper

Extract data from TikTok profiles and videos they post. Get TikTok profile data, URLs, numbers of shares, followers, comments, hearts, video and music metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

5.6k

336

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.