Pricing

$30.00 / 1,000 results

Go to Apify Store

OpenAI Web Scraper

Try for free

Crawl web pages and extract structured information using OpenAI

Pricing

$30.00 / 1,000 results

Rating

0.0

(0)

Developer

Tin

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

Categories

Developer tools

Start URLs

startUrls

Required

URLs to start with.

Type:array

Next page CSS selector

nextPageSelector

Optional

CSS selector pointing to the next page links or item detail page links

Type:string

Default:a[rel='next']

Next page REGEX patterns

nextPageRegex

Optional

Regex patterns used to detect next page URLs or item detail page links

Type:string[]

Default:

[
  "page=\\\\d+"
]

Max pages

maxPages

Required

Limit of pages to be scraped

Type:integer

Minimum:1

Default:10

Question for OpenAI

question

Required

The question to send to OpenAI for data extraction.

Type:string

Default:Extract the title, price and condition of the ebay item.

Output Schema Extension (https://zod.dev/)

outputSchema

Optional

Type:string | null

Country Code

countryCode

Optional

Country code used for proxy geolocation (e.g. US, DE, VN).

Type:string

Default:US

Options:

USDEVNFRGB

AI Web Extractor

uxinfra/uxinfra-web-extractor

Intelligent web content extraction with AI-powered structuring. Extracts articles, products, reviews, and structured data from any website.

UXINFRA

AI Search

desearch/ai-search

allows you to perform AI-powered web searches, gathering relevant information from multiple sources, including web pages, research papers, and social media discussions.

Desearch

Web Scraper Mcp

sovereigntaylor/web-scraper-mcp

Ricardo Akiyoshi

Best Web Search API

crawlkit/best-web-search-api

Search the web and get structured results with AI-powered relevance. Powered by Crawlkit.

Crawlkit

AI Web Scraper - Powered by Crawl4AI

raizen/ai-web-scraper

A blazing-fast AI web scraper powered by Crawl4AI. Perfect for LLMs, AI agents, AI automation, model training, sentiment analysis, and content generation. Supports deep crawling, multiple extraction strategies and flexible output (Markdown/JSON). Seamlessly integrates with Make.com, n8n, and Zapier.

Raizen Technology

317

1.0

Web Search Scraper

yesintelligent/web-search-scraper

Advanced web search scraper and data extraction API that delivers real-time search results with comprehensive content snippets. Perfect for research, competitive analysis, content discovery, and automated information gathering. Extract structured data from web searches with high accuracy and speed.

yesintelligent

Web Scraper

apify/web-scraper

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

107K

4.7

Universal AI Web Scraper

stanvanrooy6/universal-ai-web-scraper

Turn any website into an API. Extract structured data using plain English. Features anti-bot bypass, dynamic rendering, and web search. No coding needed.

Stan Van Rooy

Web Text Extractor

rl1987/web-text-extractor

R.L.

Dynamic Web Scraper

josejet/dynamic-web-scraper

Dynamic Web Scraper is an Apify Actor that gathers information online by simulating user browsing behavior on the web. It reduces the time and amount of scraped web pages by using a model (ChatGPT) to make decisions regarding browser navigation and results evaluation.