Pricing

from $50.00 / 1,000 tool calls

Try for free

Go to Apify Store

Web Scraping MCP — Crawl, Search & Wikipedia for Agents

Try for free

MCP server exposing website crawling, Google search and Wikipedia lookup as agent tools. Connect Claude, Cursor, n8n or the OpenAI Agents SDK.

Pricing

from $50.00 / 1,000 tool calls

Rating

0.0

(0)

Developer

NexGenData

Actor stats

Bookmarked

Total users

Monthly active users

4 days ago

Last modified

Web Scraping MCP

A Model Context Protocol server that gives AI agents web-data tools — website crawling, Google search and Wikipedia lookup — as callable tools. For research, scraping and RAG agents.

📊 Sample Output

This actor runs as a standby MCP server: it starts, answers tool calls at its /mcp endpoint and writes no dataset rows, so there is no row table to show. See the tool list and the sample inputs below.

🔧 Input reference

Field	Type	Default	What it does
`debug`	boolean	`false`	Enable verbose logging in the MCP server stdout. Helpful when wiring a new AI client (Claude Desktop, Cursor, n8n) and you want to see every tool invocation. Leave off in producti…
`maxToolCallSeconds`	integer	`90`	Maximum time a single MCP tool invocation may run before the server aborts it and returns a timeout error to the AI client. Increase only if your agent issues unusually long-runni…

💰 Pricing

Event	Price (USD)	When it is charged
Actor Start (`apify-actor-start`)	$5e-05	Charged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event).
Tool call (`tool-call`)	$0.05	Per-tool invocation via MCP Standby

Pay-per-event: you pay only for what the run delivers. A run that delivers nothing bills no result events (only the actor-start event, when the actor defines one). Example: a run that delivers 100 results costs 100 × $0.05 = $5.00 plus the start fee.

More from the NexGenData MCP servers for AI agents family:

30 more in this family on the NexGenData Store page.

🛠 Tools (3)

crawl_website — Crawl a website and extract its content.
google_search — Search Google and return results.
wikipedia_lookup — Look up a Wikipedia article.

🔌 Connect (Claude Desktop / Cursor / n8n / OpenAI Agents SDK)

Add this MCP server to your client config:

{
  "mcpServers": {
    "web-scraping": {
      "url": "https://nexgendata--web-scraping-mcp-server.apify.actor/mcp"
    }
  }
}

Sample agent prompt:

Search Google for a topic, crawl the top result, and summarize the page.

Pricing: $0.05 per tool call (Pay-Per-Event) — about 20 per $1. Actor start fee $5e-05 per run. Live prices are in the Pricing table below.

Use case	Actor
AI web scraper (LLM-formatted output)	ai-web-scraper
SEO web analysis MCP (Lighthouse + tech stack)	seo-web-analysis-mcp-server
News MCP (headline search across publishers)	news-mcp-server
Reddit MCP (post + comment search)	reddit-mcp-server
Academic research MCP (papers + citations)	academic-research-mcp-server
Multi-server MCP gateway	enterprise-mcp-gateway

How NexGenData Pricing Works

Every NexGenData actor uses pay-per-event pricing — you only pay for results that actually land in your dataset or per MCP tool call. No monthly minimum, no seat fees.

Actor Start: a single-event charge each time the actor spins up.
Tool call: charged per MCP tool call.
No charge for retries or internal proxy rotation — absorbed by the platform.

Support

NexGenData ships updates regularly. Bug reports via the Apify console issues tab get a response within 24 hours.

Home: thenextgennexus.com Full catalog: apify.com/nexgendata

Real Estate MCP — Property Search & Details for AI Agents

nexgendata/real-estate-mcp-server

MCP server exposing US property search and full listing detail (Redfin-sourced) as agent tools. Connect Claude, Cursor, n8n or the OpenAI Agents SDK. No API key. Pay per record.

NexGenData

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, AI Mode, AI overviews, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export data, run the scraper via API, schedule runs, or integrate with other tools.

Apify

197K

4.6

(218)

💡 Indeed Jobs Scraper

valig/indeed-jobs-scraper

$0.1/1K jobs | Scrape job listings, salaries, and company details from Indeed with customizable search filters and structured output.

Vali G

29K

4.7

(18)

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including caption, metrics, images, mentions, coauthors, recent comments, sponsored status, video duration, views. Export scraped data, schedule scraper via API, integrate with other tools or AI workflows.

Apify

136K

4.3

(139)

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

165K

4.6

(234)

RAG Web Browser

apify/rag-web-browser

Web search and fetch tool for AI agents and RAG pipelines. It queries Google Search, scrapes the top N pages using a full web browser, and returns their content as clean Markdown for further processing by an LLM. Can also fetch individual URLs.

Apify

187K

4.7

(36)

Travel MCP — Airbnb, Hotels & TripAdvisor for AI Agents

nexgendata/travel-mcp-server

MCP server exposing Airbnb, hotel and TripAdvisor search as agent tools. Connect Claude, Cursor, n8n or the OpenAI Agents SDK to live travel data.

NexGenData

Playwright Browser MCP — Automate & Scrape for Agents

nexgendata/playwright-mcp-server

MCP server exposing Playwright browser automation — navigate, click, fill forms, extract content and screenshot — as 17 agent tools. Connect Claude, Cursor, n8n. No API key. Pay per record.

NexGenData

108

5.0

(1)

TikTok Scraper

clockworks/tiktok-scraper

Extract data from TikTok videos, hashtags, and users. Use URLs or search queries to scrape TikTok profiles, hashtags, posts, URLs, shares, followers, hearts, names, video, and music-related data. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

305K

4.8

(370)

Legal Data MCP — Case Law, Dockets & Filings for AI Agents

nexgendata/legal-mcp-server

MCP server exposing case law, court dockets, FINRA BrokerCheck and trademark data as 10 agent tools. Connect Claude, Cursor, n8n or the OpenAI Agents SDK. Not legal advice.

NexGenData