Pricing

Pay per usage

Go to Store

SuperScraper API

Try for free

Developed by

Apify

Generic REST API for scraping websites: send a URL and get back HTML. This Actor is a drop-in replacement for ScrapingBee, ScrapingAnt, and ScraperAPI services. And it is open-source!

4.2 (6)

Pricing

Pay per usage

Total users

698

Monthly users

Runs succeeded

85%

Issues response

83 days

Last modified

8 months ago

Developer tools

Open source

Back to issues Create new issue

How to manage page redirects

Closed

rocksoft opened this issue

ScrapingBee use Response Headers that are useful when the page redirects.

Spb-initial-status-code: The initial status code returned by the scraped page.
Spb-resolved-url: The resolved URL of the scraped page.

Pavlína Vencovská (paja)

Hi,

thanks for reaching out, we'll look into it and let you know what can be done.

Radoslav Chudovský (rado.ch)

Hi, for now, you can get both the initial status code and resolved URL in the response by setting the json_response parameter to true.

Pavlína Vencovská (paja)

Hi,

I'm going to close the issue for now, but if anything else come up, please, let us know.

Add comment

Page Scraping Analyzer

apify/page-analyzer

Performs analysis of a webpage to figure out the best way how to scrape its data. Provide a URL and data points to find and get back a detailed dashboard showing how the data can be scraped. Works with initial and rendered HTML, JavaScript variables and dynamically loaded data.

Apify

1.3K

4.4

RAG Web Browser

apify/rag-web-browser

Web browser for OpenAI Assistants, RAG pipelines, or AI agents, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages, and returns their content as Markdown for further processing by an LLM. It can also scrape individual URLs. Supports Model Context Protocol (MCP).

Apify

4.4K

4.3

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

8.9K

4.7

google-search

parse/google-search

parse

409

MySQL Insert

petr_cermak/MySQL-insert

This act takes a crawler execution and inserts it's results into a remote MySQL database.

Petr Cermak

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

8.2K

5.0

Chroma Integration

apify/chroma-integration

This integration transfers data from Apify Actors to a Chroma and is a good starting point for a question-answering, search, or RAG use case.

Apify

4.7

Cheap Google Search Results Scraper

tuningsearch/cheap-google-search-results-scraper

Scrape Google Search Engine Results Page (SERP). Select the country or language and extract organic results like a Google SERP API.

tuningsearch

5.0

Microsoft Text to Speech

jupri/microsoft-tts

💫 Use Microsoft Edge TTS service to convert texts into speech

cat

Web Scraper

apify/web-scraper

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

90K

4.5