Pricing

Pay per usage

Go to Store

URL Redirects

Try for free

Developed by

Manish Chiniwalar

Actor that takes a list of URLs and provides a list of loaded URLs after redirects

0.0 (0)

Pricing

Pay per usage

Total users

301

Monthly users

Runs succeeded

>99%

Last modified

3 years ago

Developer tools

Open source

Apify Actor - URL Redirects

For a list of input URLs, get a list of final URLs that are loaded after redirects.

Input parameters

Field	Type	Description
`urlList`	String	(Option 1) List of URLs. One per line.`
`sources.requestsFromUrl`	String	(Option 2) URL to a file with the list of URLs
crawlerOptionsOverrides	Object	Crawler options Overrides. [See for overrides ↗](https://sdk.apify.com/docs/api/basiccrawler#new-basiccrawleroptions)

Output

{
  "origionalUrl": "http://google.com/",
  "attemptedUrl": "http://www.google.com",
  "loadedUrl": "https://www.google.com/",
  "loadedUrlNormalized": "https://www.google.com",
  "isOk": true,
  "statusCode": 200,
  "statusText": "",
  "#errorMessage": "[<errors>]",
  "#isFailed": "<true/false>"
}

Download HTML from URLs

mtrunkat/url-list-download-html

This actor takes a list of URLs and downloads HTML of each page.

Marek Trunkát

8.4k

URL Parser: Parse for domains, subdomains, slugs, and more

sorrek/url-parser

A more powerful URL parser to extract domain names, subdomains, slugs, extensions/TLDs, and more

Sorrek

Find Sitemap from url

eesti/find-sitemap-from-url

A powerful [Apify Actor] that finds sitemap URLs for any website. This Actor helps you discover XML sitemaps by checking common locations, robots.txt files, and analyzing HTML content for sitemap links.

ando

Get URLs from link

boring_code/get-urls-from-link

Extracts URLs from a sitemap or webpage with intuitive path matching. Use comma-separated patterns to include or exclude URL paths with smart matching: '/tags/' for exact paths, '/product' for paths starting with, or simple text for substring matches.

Audrius L.

5.0

Get Urls

maged120/get-urls

scrap links from any website, now has a RENTAL version https://apify.com/maged120/get-urls-rental

Maged Safwat

4.1

Sitemap Scraper

pvillalva/sitemap-scraper

The Sitemap Scraper extracts and outputs all URLs from a given sitemap.

Percival Villalva

Sitemap To Request Queue

pocesar/sitemap-to-request-queue

Download sitemap XMLs and put them in a RequestQueue

Paulo Cesar

105

Example Sitemap Cheerio

jancurn/example-sitemap-cheerio

An example actor that first downloads a sitemap in XML format and the crawls each page from the sitemap using the fast CheerioCrawler from Apify SDK.

Jan Čurn

Get Urls Pro

maged120/get-urls-pro

This Apify actor crawls websites, extracts and creates a hierarchy of links, allowing you to visualize the structure of a website. The crawler can be configured to use either standard HTTP requests with BeautifulSoup (fast HTML parsing) or Selenium (for JavaScript-heavy pages)

Maged Safwat

5.0

Sitemap Sniffer

vaclavrut/sitemap-sniffer

Sitemap sniffer will check the most used variants of sitemaps and you can use that for crawling. This will just save you time so you don't have to check manually.