Pricing

Pay per usage

Go to Store

SuperScraper API

Try for free

Developed by

Apify

Generic REST API for scraping websites: send a URL and get back HTML. This Actor is a drop-in replacement for ScrapingBee, ScrapingAnt, and ScraperAPI services. And it is open-source!

4.2 (6)

Pricing

Pay per usage

Total users

649

Monthly users

Runs succeeded

80%

Issues response

69 days

Last modified

6 months ago

Developer tools

Open source

Back to issues Create new issue

How to manage page redirects

Closed

rocksoft opened this issue

ScrapingBee use Response Headers that are useful when the page redirects.

Spb-initial-status-code: The initial status code returned by the scraped page.
Spb-resolved-url: The resolved URL of the scraped page.

Pavlína Vencovská (paja)

Hi,

thanks for reaching out, we'll look into it and let you know what can be done.

Radoslav Chudovský (rado.ch)

Hi, for now, you can get both the initial status code and resolved URL in the response by setting the json_response parameter to true.

Pavlína Vencovská (paja)

Hi,

I'm going to close the issue for now, but if anything else come up, please, let us know.

Add comment

HTML Scraper pro

scrapingxpert/html-scraper-pro

The HTML Scraper Pro is a powerful tool designed to extract the HTML source code and metadata from websites. It uses advanced web scraping techniques to retrieve the full HTML content of web pages,page title and HTTP status code.This tool is ideal for data extraction, website analysis, and archiving

scrapingxpert

Scraper Api

zfcsoftware/scraper-api

This api allows you to scrape sites such as websites with rate limits, websites with protection such as Cloudflare. It is cheap and fast. It uses trusted proxies and works for most sites. The ip address used is not used again, a reliable ip is used for each request.

ZFC YAZILIM

224

Web Scraper Task

undrtkr984/web-scraper-task

Matt

113

Magicbricks.com Property Search Scraper

ecomscrape/magicbricks-property-search-scraper

The Magicbricks.com Property Search Scraper extracts property information from Magicbricks.com. Capture data such as name, address, features and more by providing Property Search Query URLs.

ecomscrape

Magicbricks.com Property Details Page Scraper

ecomscrape/magicbricks-property-details-page-scraper

The Magicbricks.com Property Details Page Scraper allows for easy extraction of detailed property data listed on Magicbricks.com. Simply provide the property page URLs, and it will gather key details such as price, address, features and more, ensuring smooth integration and efficient use.

ecomscrape

HTML/Web Media Scraper

aweworkz/html-web-media-scraper

Extracts various media files, such as images, videos, audio, and other related media elements, from multiple websites. It then provides the corresponding descriptions or the alt="" content. You may need to use proxies to run this actor for some websites with bot blocking features.

aweworkz

153

My Actor

david15999/my-actor

HTML scraper

David Emanuel Moreira

Web Scraper

apify/web-scraper

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.