Under maintenance

Pricing

Pay per usage

Try for free

Go to Apify Store

Web Search & Scrape by XCrawl Proxy

Under maintenance

Try for free

Search the web or scrape any URL using XCrawl residential proxy network. Bypass anti-bot systems with automatic JS rendering fallback, global IP rotation, and configurable concurrency (1-20). Perfect for market research, LLM data collection, and content aggregation.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Charles

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Web Search & Scrape by XCrawl Proxy API

Below, you can find a list of relevant HTTP API endpoints for calling the Web Search & Scrape by XCrawl Proxy Actor. For this, you’ll need an Apify account. Replace <YOUR_API_TOKEN> in the URLs with your Apify API token, which you can find under Integrations in Apify Console. For details, see the API reference.

Run Actor

POST
https://api.apify.com/v2/acts/empathetic_chorus~xcrawl-search-scrape/runs?token=<YOUR_API_TOKEN>

Note: By adding the method=POST query parameter, this API endpoint can be called using a GET request and thus used in third-party webhooks. Please refer to our Run Actor API documentation.

Run Actor synchronously and get dataset items

POST
https://api.apify.com/v2/acts/empathetic_chorus~xcrawl-search-scrape/run-sync-get-dataset-items?token=<YOUR_API_TOKEN>

Note: This endpoint supports both POST and GET request methods. However, only the POST method allows you to pass input data. For more information, please refer to our Run Actor synchronously and get dataset items API documentation.

Get Actor

GET
https://api.apify.com/v2/acts/empathetic_chorus~xcrawl-search-scrape?token=<YOUR_API_TOKEN>

For more information, please refer to our Get Actor API documentation.

Actors can be used to scrape web pages, extract data, or automate browser tasks. Use the Web Search & Scrape by XCrawl Proxy API programmatically via the Apify API.

You can choose from:

Web Search & Scrape by XCrawl Proxy API in Python

Web Search & Scrape by XCrawl Proxy API in JavaScript

Web Search & Scrape by XCrawl Proxy API through CLI

Web Search & Scrape by XCrawl Proxy OpenAPI definition

You can start Web Search & Scrape by XCrawl Proxy with the Apify API by sending an HTTP POST request to the Run Actorendpoint. An Actor’s input and its content type can be passed as a payload of the POST request, and additional options can be specified using URL query parameters. The Web Search & Scrape by XCrawl Proxy is identified within the API by its ID, which is the creator’s username and the name of the Actor.

When the Web Search & Scrape by XCrawl Proxy run finishes you can list the data from its default dataset(storage) via the API or you can preview the data directly on Apify Console.

Xcrawl Search Scrape Actor

empathetic_chorus/xcrawl-search-scrape-actor

Charles

Universal AI Web Scraper

stanvanrooy6/universal-ai-web-scraper

Turn any website into an API. Extract structured data using plain English. Features anti-bot bypass, dynamic rendering, and web search. No coding needed.

Stan Van Rooy

1.5

Firecrawl MCP

red.cars/firecrawl-mcp

AI agents that need web data without anti-bot headaches. 20 tools for API-based web scraping, crawl, search, and extract — no proxy rotation, no stealth needed.

AutomateLab

Article Extractor & News Scraper

web.harvester/article-extractor-news-scraper

Extract articles from any news site, blog, or webpage. Get title, full text, author, date, images & metadata using 7 extraction engines (Newspaper4k, Trafilatura, Goose3). Anti-bot bypass, proxy rotation, automatic fallback. Perfect for news monitoring, NLP datasets & content aggregation.

Web Harvester

5.0

Web Article Content Extractor

vulnv/web-article-content-extractor

Extract clean, readable content from news articles, blog posts, and web pages. Batch process multiple URLs, download images, bypass bot protection with proxy support. Perfect for content curation, research, and data analysis.

VulnV

AI Web Crawler

hounderd/ai-web-crawler

Crawl websites and extract clean, LLM-ready markdown content with stealth browser rendering, anti-bot hardening, smart content filtering, and structured metadata extraction. Built for RAG pipelines, AI agents, and data workflows.

Hounderd

Scrape GPT - Universal AI Web Scraper Agent

paradox-analytics/scrape-gpt---universal-ai-web-scraper-agent

AI-powered universal web scraper that works on ANY website without configuration. Extract data from e-commerce, news sites, social media, and more using intelligent LLM-based field mapping. Features JSON-first extraction, automatic pagination, anti-bot bypass, and cost-effective caching.

Paradox Analytics

LinkedIn Company Data Scraper API

moving_beacon-owner1/my-actor-7

Scrape company profiles, industries, employees, and more with scalable concurrency and anti-blocking proxy support.

Jamshaid Arif

Firecrawl AI-Powered Web Search & Scrape

alizarin_refrigerator-owner/firecrawl-ai-powered-web-search-scrape

Search the web and get clean, LLM-ready content in one API call. Powered by Firecrawl's /v1/search endpoint. Returns markdown, HTML, or extracted data. Perfect for SEO research, competitor analysis, and AI training data collection.