Pricing

Pay per usage

Try for free

Go to Apify Store

Scrappey Web Scraper – Managed Browser & Proxy API

Try for free

Scrape data from modern, JavaScript-heavy web pages using the Scrappey.com API integrated with an Apify Actor. A robust solution for complex scraping scenarios — managed browser sessions, proxy rotation, and full browser automation.

Pricing

Pay per usage

Rating

5.0

(2)

Developer

Pim

Actor stats

Bookmarked

171

Total users

Monthly active users

14 days ago

Last modified

Scrappey Web Scraper for Apify

A web scraping actor for reliable access to modern, JavaScript-heavy websites. Handles automated verification flows, managed browser sessions, proxy rotation, and full browser automation. Powered by the Scrappey.com API.

Features

Managed Web Access - Reliably retrieve content from dynamic sites that require a real browser environment
Verification Flow Handling - Automatically work through common challenge and verification steps where access is permitted
Browser Automation - Full browser control with 20+ action types including click, type, scroll, and JavaScript execution
Session Management - Maintain cookies and state across multiple requests
Proxy Support - Built-in proxy rotation with country selection, premium, and mobile proxy options
All HTTP Methods - Support for GET, POST, PUT, DELETE, and PATCH requests
Data Extraction - CSS selectors, regex patterns, screenshots, and video recording

Quick Start

Input Configuration

{
    "scrappeyApiKey": "your-api-key",
    "url": "https://example.com",
    "cmd": "request.get"
}

Get your API key at https://scrappey.com

Basic GET Request

{
    "scrappeyApiKey": "your-api-key",
    "url": "https://httpbin.rs/get",
    "cmd": "request.get"
}

POST Request with Data

{
    "scrappeyApiKey": "your-api-key",
    "url": "https://httpbin.rs/post",
    "cmd": "request.post",
    "postData": {
        "username": "user",
        "password": "pass"
    }
}

Browser Automation

{
    "scrappeyApiKey": "your-api-key",
    "url": "https://example.com/login",
    "browserActions": [
        { "type": "wait_for_selector", "cssSelector": "#login-form" },
        { "type": "type", "cssSelector": "#username", "text": "myuser" },
        { "type": "type", "cssSelector": "#password", "text": "mypassword" },
        { "type": "click", "cssSelector": "#submit", "waitForSelector": ".dashboard" }
    ]
}

Automatic Verification Handling

{
    "scrappeyApiKey": "your-api-key",
    "url": "https://example.com",
    "automaticallySolveCaptchas": true
}

Geo-Targeted Requests

{
    "scrappeyApiKey": "your-api-key",
    "url": "https://example.com",
    "proxyCountry": "UnitedStates",
    "premiumProxy": true
}

Screenshot Capture

{
    "scrappeyApiKey": "your-api-key",
    "url": "https://example.com",
    "screenshot": true,
    "screenshotUpload": true
}

Input Options

Required

Option	Type	Description
`scrappeyApiKey`	string	Your Scrappey API key
`url`	string	Target URL

HTTP Method

Option	Type	Default	Description
`cmd`	string	`request.get`	HTTP method: `request.get`, `request.post`, `request.put`, `request.delete`, `request.patch`
`postData`	object	-	Request body for POST, PUT, PATCH
`requestType`	string	`browser`	`browser` for full rendering, `request` for HTTP-only (faster)

Proxy Configuration

Option	Type	Description
`proxy`	string	Custom proxy URL (http://user:pass@ip:port)
`proxyCountry`	string	Request a proxy from a specific country (e.g., UnitedStates, Germany)
`premiumProxy`	boolean	Use premium residential proxies
`mobileProxy`	boolean	Use mobile carrier proxies

Verification Handling

Option	Type	Description
`automaticallySolveCaptchas`	boolean	Automatically work through detected verification steps

Response Options

Option	Type	Description
`screenshot`	boolean	Capture page screenshot
`screenshotUpload`	boolean	Upload screenshot to storage
`video`	boolean	Record browser session
`cssSelector`	string	Extract content by CSS selector
`innerText`	boolean	Include page text content
`includeImages`	boolean	Include image URLs
`includeLinks`	boolean	Include link URLs

Session and Cookies

Option	Type	Description
`session`	string	Session ID for state persistence
`cookiejar`	array	Cookies to set before request
`localStorage`	object	Local storage data to set

Output Data

{
    "url": "https://example.com",
    "cmd": "request.get",
    "verified": true,
    "statusCode": 200,
    "currentUrl": "https://example.com",
    "userAgent": "Mozilla/5.0...",
    "cookies": [],
    "cookieString": "",
    "responseHeaders": {},
    "requestHeaders": {},
    "html": "<html>...</html>",
    "innerText": "Page content...",
    "ipInfo": {
        "country": "United States",
        "city": "New York"
    },
    "session": "session-id",
    "timeElapsed": 1234,
    "screenshot": "base64...",
    "screenshotUrl": "https://...",
    "timestamp": "2025-01-09T12:00:00.000Z"
}

Browser Actions

Execute automated browser interactions:

Action	Description
`click`	Click an element
`type`	Type text into input
`wait`	Wait for milliseconds
`wait_for_selector`	Wait for element to appear
`scroll`	Scroll to element or bottom
`hover`	Hover over element
`keyboard`	Press keyboard keys
`dropdown`	Select dropdown option
`execute_js`	Run JavaScript code
`if`	Conditional execution
`while`	Loop execution
`goto`	Navigate to URL

{
    "browserActions": [
        { "type": "wait_for_selector", "cssSelector": "#login-form" },
        { "type": "type", "cssSelector": "#email", "text": "user@example.com" },
        { "type": "type", "cssSelector": "#password", "text": "password123" },
        { "type": "click", "cssSelector": "#submit", "waitForSelector": ".dashboard" },
        { "type": "execute_js", "code": "document.querySelector('.user-name').innerText" }
    ]
}

Error Codes

Code	Description	Solution
CODE-0001	Server overload	Retry with backoff
CODE-0002	Request not completed	Try a different proxy
CODE-0007	Proxy error	Check proxy credentials
CODE-0010	Access not completed	Use a premium proxy
CODE-0029	Too many sessions	Wait for cleanup
CODE-0032	Verification not completed	Retry request

Local Development

Setup

git clone https://github.com/pim97/apify-scrappey
cd apify-scrappey
npm install

Run Locally

# Set input in storage/key_value_stores/default/INPUT.json
npm run start:dev

Run Tests

$npm test

Build

$npm run build

Deploy to Apify

apify login
apify push

CI/CD

The repository includes GitHub Actions for automatic deployment:

Tests run on every push and pull request
Deployment to Apify triggers on:
- Push to main/master branch
- New release published

Set APIFY_TOKEN secret in your repository settings.

Resources

Support

License

MIT License

RAG Web Browser

simpleapi/rag-web-browser

SimpleAPI

RAG Web Browser

scraper-engine/rag-web-browser

Scraper Engine

RAG Web Browser

api-empire/rag-web-browser

API Empire

RAG Web Browser

scrapio/rag-web-browser

Scrapio

DEPRICATED Browser Mcp

nahom.network/depricated-browser-mcp

The Browser MCP Actor combines Browser with the Model Context Protocol (MCP) to let AI agents control web browsers via a standardized interface. It enables navigation, data extraction, form filling, testing, and complex web automation.

Nahom D

Browser Use Apify

lexis-solutions/browser-use-apify

Open-source AI-powered browser automation based on Browser Use and hosted on Apify. Run any task using Apify's platform and LLMs like ChatGPT, Claude, etc. Easy, scalable, resilient, and hosted solution for web-enabled AI agents.

Lexis Solutions

366

5.0

Stealth Web Scraper

lentic_clockss/stealth-web-scraper

Get rendered HTML, plain text, and extracted fields from Cloudflare-protected and JavaScript-heavy pages without building your own browser-and-proxy stack.

kane liu

126

RAG Web Browser

scrapier/rag-web-browser

🌐 RAG Web Browser (rag-web-browser) is an intelligent tool for retrieving and generating answers from web sources with RAG. ⚡ Speed up research, get accurate citations, and streamline workflows for developers & analysts.

Scrapier

RAG Web Browser

apify/rag-web-browser

Web search and fetch tool for AI agents and RAG pipelines. It queries Google Search, scrapes the top N pages using a full web browser, and returns their content as clean Markdown for further processing by an LLM. Can also fetch individual URLs.

Apify

113K

3.7

Web Scraper

apify/web-scraper

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

120K

4.5