Deprecated

Pricing

Pay per usage

See alternative Actors

Go to Store

Web Navigator API

Deprecated

See alternative Actors

Developed by

carvedai

Navigate and scrape websites using LLMs via API

0.0 (0)

Pricing

Pay per usage

Total users

Monthly users

Last modified

8 months ago

Automation

Open source

Navigates and scrapes website using LLMs and returns page HTML and screenshot.

Features

Autonomously browse websites with an objective
Optionally disable ad blocker
Provides both HTML and screenshot

Examples

This example gets contact info from a pet business website.

run_input = {
    "url": "https://www.dancingdogmassage.com",
	"objective": "Get contact info"
}
run = client.actor("carvedai/web-navigator-api").call(run_input=run_input)
print(list(client.dataset(run["defaultDatasetId"]).iterate_items()))

Expected Output:

{
    "page_content": "<!DOCTYPE html>...",
    "page_screenshot": "iVBORw...",
}

Support

Reach out to us if you need anything.

Email: hello at carvedai.com

Made by CarvedAI

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

7.6k

4.7

Facebook marketplace scraper

curious_coder/facebook-marketplace

Scrape facebook marketplace listings and export data to CSV, JSON or use as API

Curious Coder

4.3

Screenshot Taker

jancurn/screenshot-taker

Takes a screenshot of one or more web pages using the Chrome browser. The actor enables the setting of custom viewport size, page load timeout, delay, proxies, and output image format.

Jan Čurn

665

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.40 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

API Dojo

14.8k

3.6

Web Scraping API

zeeb0t/web-scraping-api---scrape-any-website

Web Scraping API that quickly and reliably scrapes any website—no selectors required. Premium proxies, CAPTCHA solving, JavaScript rendering, and automated structured data extraction are all included. It’s just $2 per 1,000 web pages scraped, with no minimum spend.

Anthony Ziebell

425

5.0

Real-time knowledge for LLMs

ai-developer/real-time-knowledge-for-llms

Unlock the Full Potential of Your LLM with Real-Time Web Knowledge! Say goodbye to outdated responses, misinformation, and hallucinations. Now you can ground your Language Model with the freshest information from the web. NO API NEEDED!

aideveloper

🔍 Upwork - 🔥High Quality Job Scrapper

paulo663636/upwork---high-quality-job-scrapper

This API performs web scraping on Upwork, providing real-time access to job listings from various categories. It fetches up to 50 job records at a time, delivering valuable details. The API is designed to deliver fresh data every 10 minutes, ensuring you always have the latest job postings.

Paulo Oliveira

Facebook Comments Scraper

datavoyantlab/facebook-comments-scraper

Extract Facebook comments from any post, page, or group. Download hundreds of comments with user data and engagement metrics in JSON, CSV, or Excel format.

DataVoyantLab

161

Dark Web Scraper

epctex/darkweb-scraper

Uncover valuable insights with our Dark Web Scraper. Extract sensitive data, including crypto wallets, API keys, emails, phone numbers, and more, from the depths of the Dark Web. You can specify search terms, and customize and retrieve OSINT data out of the box.

epctex

1.3k

Scrape And Bypass Any Url Using Scrappey

dormic/apify-scrappey

A template for scraping data from web pages using the Scrappey.com API service integrated with an Apify Actor. This actor provides a robust solution for handling complex web scraping scenarios, including sites with anti-bot protection such as Cloudflare, Datadome, PerimeterX and all other forms.

Pim

5.0

TikTok Profile Scraper

clockworks/tiktok-profile-scraper

Extract data from TikTok profiles and videos they post. Get TikTok profile data, URLs, numbers of shares, followers, comments, hearts, video and music metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.