Deprecated

Pricing

Pay per usage

See alternative Actors

Go to Store

Web Navigator API

Deprecated

See alternative Actors

Developed by

carvedai

Navigate and scrape websites using LLMs via API

0.0 (0)

Pricing

Pay per usage

Total users

Monthly users

Last modified

7 months ago

Automation

Open source

Navigates and scrapes website using LLMs and returns page HTML and screenshot.

Features

Autonomously browse websites with an objective
Optionally disable ad blocker
Provides both HTML and screenshot

Examples

This example gets contact info from a pet business website.

run_input = {
    "url": "https://www.dancingdogmassage.com",
	"objective": "Get contact info"
}
run = client.actor("carvedai/web-navigator-api").call(run_input=run_input)
print(list(client.dataset(run["defaultDatasetId"]).iterate_items()))

Expected Output:

{
    "page_content": "<!DOCTYPE html>...",
    "page_screenshot": "iVBORw...",
}

Support

Reach out to us if you need anything.

Email: hello at carvedai.com

Made by CarvedAI

Web Scraper

apify/web-scraper

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

82.1k

4.5

Google Indexing API Bulk URL Submission

mabdulmoghni/google-indexing-api-bulk-url-submission

This Actor allows you to submit multiple URLs for indexing in bulk through Google's Indexing API. It avoids the need to manually request each URL to be indexed via the Google Search Console interface. With this tool, you can quickly submit up to 100 URLs at once.

Mohamed Moo

Extract Eventbrite online events

scrapingxpert/extract-eventbrite-online-events

Eventbrite is a popular platform for creating and browsing events, but it doesn't have an API for directly extracting online events. Fortunately, Apify script finds the latest online occasions without coding. The extracted data can be downloaded in different formats or used for custom workflows.

scrapingxpert

149

5.0

Facebook Marketplace Scraper

apify/facebook-marketplace-scraper

Extract data from one or multiple Facebook Marketplace listings. Scrape data on apartments, whole categories, items for sale, prices, location and sellers. Export scraped data in JSON, CSV, and Excel, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

843

3.9

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

48.3k

4.6

Twitter (X.com) Scraper Unlimited: No Rate-Limits

apidojo/twitter-scraper-lite

Introducing Twitter Scraper Unlimited, the most comprehensive Twitter data extraction solution available. Our enterprise-grade scraper offers unmatched capabilities with a transparent event-based pricing model, making it perfect for both small-scale and large-scale data extraction needs.

API Dojo

5.3k

4.1

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.40 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

API Dojo

14.6k

3.8

Apartments.com Search Results with Details Scraper

memo23/apify-apartments-cheerio

Effortlessly scrape comprehensive property data from Apartments.com, including detailed listing info, rental pricing, amenities, and high-quality images – giving you unparalleled insights and saving countless hours of manual work.

Muhamed Didovic

4.0

Actors MCP Server

apify/actors-mcp-server

Connect Apify Actors to AI applications (AI Agents) using Anthropic's Model Context Protocol (MCP). This MCP server provides integration of any Apify Actor through the MCP framework.

Apify

892

4.6

Web Scraping API

zeeb0t/web-scraping-api---scrape-any-website

Web Scraping API that quickly and reliably scrapes any website—no selectors required. Premium proxies, CAPTCHA solving, JavaScript rendering, and automated structured data extraction are all included. It’s just $2 per 1,000 web pages scraped, with no minimum spend.

Anthony Ziebell

384

5.0

Real-time knowledge for LLMs

ai-developer/real-time-knowledge-for-llms

Unlock the Full Potential of Your LLM with Real-Time Web Knowledge! Say goodbye to outdated responses, misinformation, and hallucinations. Now you can ground your Language Model with the freshest information from the web. NO API NEEDED!