# AI Web Scraper & Lead Finder (Claude/Cursor MCP) (`neon_innovation_lab/universal-mcp-cloud-gateway`) Actor

Connect AI agents to scrapers, web research, and live databases with zero server timeouts, 90% token savings, and instant cloud scaling.

- **URL**: https://apify.com/neon\_innovation\_lab/universal-mcp-cloud-gateway.md
- **Developed by:** [Neon Innovation Lab](https://apify.com/neon_innovation_lab) (community)
- **Categories:**
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $2.00 / 1,000 tool executions

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## Universal MCP Cloud Gateway for Claude, Cursor & OpenAI Agents

> **Connect AI agents to scrapers, web research, and live databases with zero server timeouts, 90% token savings, and instant cloud scaling.**

[![Model Context Protocol](https://img.shields.io/badge/MCP-2026--07--28%20Spec-blue.svg)](https://modelcontextprotocol.io)
[![Linux Foundation AAIF](https://img.shields.io/badge/AAIF-Certified-green.svg)](https://aaif.io)
[![Claude & Cursor Compatible](https://img.shields.io/badge/Compatible-Claude%20%7C%20Cursor%20%7C%20OpenAI-orange.svg)](#quick-setup)

Stop dealing with fragile local terminal scripts, broken Docker setups, and crashing MCP servers. **Universal MCP Cloud Gateway** gives your AI agents (**Claude Desktop, Cursor, OpenAI Agents SDK, and Google Antigravity**) a high-speed, 24/7 cloud runtime to execute web scrapers, company lead lookups, and long-running background research tasks.

***

### Why Developers & Teams Choose Universal MCP Cloud Gateway

- ⚡ **Zero Server Timeouts:** Uses the ratified **AAIF `io.modelcontextprotocol/tasks`** standard to execute heavy research and scraping jobs in the background without HTTP connection drops.
- 💰 **89% Token Tax Savings:** Naive MCP servers dump 3,000+ tokens of raw JSON schemas into your prompt before work starts. Universal Gateway prunes tool schemas dynamically, keeping overhead under 400 tokens.
- 🌐 **1-Click Cloud Deployment:** Runs 24/7 on Apify high-availability cloud infrastructure with a dedicated public HTTPS endpoint and automated SSL.
- 🛡️ **Zero-Trust Enterprise Security:** Validates agent identity (`X-Agent-ID`, `X-Agent-Role`) and maintains an immutable audit trail for governance and compliance.

***

### Included High-Impact Tools

| Tool Name | What It Does | Best For |
| :--- | :--- | :--- |
| **`web_reader`** | Strips popups, cookie walls, and clutter to extract clean, token-efficient Markdown from any URL. | AI market research, competitor analysis, documentation reading. |
| **`lead_dossier`** | Instantly extracts detected technology stack, security posture, and company profile for any domain. | B2B lead qualification, sales outreach, technical diligence. |
| **`live_framework_docs`** | Pulls verified, version-accurate 2026 documentation for Next.js, React 19, Tailwind v4, Supabase, and Stripe. | Eliminating code hallucinations in Cursor and Claude. |
| **`tasks_manager`** | Spawns and monitors asynchronous durable background jobs with status polling and progress tracking. | Long-running scrapers, batch jobs, and automated data pipelines. |

***

### 1-Minute Setup Guide

#### 1. Claude Desktop

Add this block to your `claude_desktop_config.json`:

```json
{
  "mcpServers": {
    "universal-cloud-gateway": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-sse",
        "https://YOUR_ACTOR_RUN_URL/mcp"
      ]
    }
  }
}
```

#### 2. Cursor IDE

1. Open **Cursor Settings** -> **Features** -> **MCP Servers**.
2. Click **+ Add New MCP Server**:
   - **Name:** `universal-cloud-gateway`
   - **Type:** `sse` (or `http`)
   - **Server URL:** `https://YOUR_ACTOR_RUN_URL/mcp`
3. Click Save. Cursor now has direct access to cloud web reading and lead dossiers!

#### 3. OpenAI Agents SDK / Python

```python
from openai import OpenAI

client = OpenAI()
## Connect to Universal MCP Cloud Gateway via standard JSON-RPC
response = client.chat.completions.create(
    model="gpt-5",
    messages=[{"role": "user", "content": "Analyze stripe.com tech stack using lead_dossier"}]
)
```

***

### Specification Standards & Architecture

- **Standard:** Linux Foundation (AAIF) Model Context Protocol `2026-07-28` specification.
- **Stateless Core:** Eliminates `Mcp-Session-Id` sticky sessions, scaling horizontally behind load balancers.
- **Edge Headers:** Supports fast header routing via `Mcp-Method` and `Mcp-Name`.
- **Zero-Connection Discovery:** Exposes `GET /.well-known/mcp` for instant capability introspection.

***

### License & Support

Published and maintained by **Neon Innovation Lab**. For enterprise custom endpoints, private VPC peering, or dedicated tool integrations, contact `support@neoninnovationlab.com`.

# Actor input Schema

## `apiKey` (type: `string`):

Optional custom secret key to protect your remote MCP gateway. Leave empty for open access.

## `mode` (type: `string`):

Pruned mode saves 85-90% context tokens (<400 tokens). Full mode returns extended schemas.

## `enableTasks` (type: `boolean`):

Enables the AAIF io.modelcontextprotocol/tasks extension for long-running workflows without HTTP timeouts.

## Actor input object example

```json
{
  "mode": "pruned",
  "enableTasks": true
}
```

# Actor output Schema

## `gatewayUrl` (type: `string`):

Copy and paste this URL directly into your Claude Desktop, Cursor, or OpenAI Agent configuration.

## `discoveryUrl` (type: `string`):

Public AAIF 2026-07-28 discovery manifest URL.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {};

// Run the Actor and wait for it to finish
const run = await client.actor("neon_innovation_lab/universal-mcp-cloud-gateway").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {}

# Run the Actor and wait for it to finish
run = client.actor("neon_innovation_lab/universal-mcp-cloud-gateway").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{}' |
apify call neon_innovation_lab/universal-mcp-cloud-gateway --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,neon_innovation_lab/universal-mcp-cloud-gateway"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/jgT9LYIwAvAMhFCwu/builds/weG7fIufhtVzyeRyI/openapi.json