No credit card required

Download HTML from URLs

mtrunkat/url-list-download-html

Try for free

No credit card required

This actor takes a list of URLs and downloads HTML of each page.

Back to issues Create new issue

getting 403 from angel.co, used to work previously

Closed

heady_sitar opened this issue

I am getting 403 from angel.co, previously used to work example URL:

https://links.angel.co/u/click?_t=26b4e8aeb47d4cd3acd5eba415f76f62&_m=da905790e1494e94ad3eba8edf73710c&_e=EKPEaUzxQqZD1HpvY5ey7j03nTstLbXhEp-NiREiCyCdodRttkWo4LLYHHFuICZSy60HH3taso6W3z7e5CHzAvDUxiLnP25WujdlxEMbZ_-ke9Gng2U_vP9mOByvIvcZpEubz9dG3w_49X4oKYVEGqLb89kOoGpSoU80R2B0363SC6F01WXY9Gcdsd5TJ6E1bv1t8RgSOxK1GT3Atapx9pA7Ru8nkL9rJ0xlyBrtw1513U5rxLPIrgqgfyBDGYC5AuCfm-yv7YFCzelE8Dx6DDOAduorPpp22kIKZ8RBQpTlfA0mfomJNSQ8EODognnUs34U0VQmDTMtNTISr2m58KX4_y5tBzOwH16ZFdkC78B5-kTqQEC-ZNTamNJ9M1ERzw6bhtipXy-py7fnttlAMrY5kJUY5Jq_9KVARfJnmuGyLYLydgk5AjIkoUnQFVMG-ZsQj7HYyuEB0wbFuG3a3g%3D%3D

heady_sitar

Do you have updates on this ?

Zuzka Pelechová (zuzka)

Sorry, missed your message before, the page seems to have started blocking heavily. I mean more then the scope of this actor as it is fairly generic. Can you tell me more about the use case?

heady_sitar

no worries, we only need to get the HTML of the page back to then extract information. Do you know another scraper ?

Zuzka Pelechová (zuzka)

Hey I tried with webscraper but it seems you will need a custom solution as the page seems to be blocking really heavily. You can get a custom solution here: https://apify.com/custom-solutions.

Add comment

Developer

Marek Trunkát

Actor Metrics

57 monthly users
10 stars
>99% runs succeeded
Created in Feb 2018
Modified 7 months ago

Categories

Automation

Actor in Rust Example

lukaskrivka/rust-actor-example

Example actor built in Rust programming language. Downloads HTML from any page. Works on Apify platform and locally.

Lukáš Křivka

LinkedIn Company URL - Mass Profile Finder

anchor/LinkedIn-company-url-finder

Say goodbye to endless scrolling! LinkedIn Company URL Finder revolutionizes your search for LinkedIn company pages. No more manual hunting through lists of names – simply input your company list and voila! Instant access to their LinkedIn URLs. Don't waste time, automate your search today!

Anchor

3.1k

Zillow Search Scraper

maxcopell/zillow-scraper

Extract data about properties for sale and rent on Zillow using the Zillow API, but with no daily call limits. Scrape millions of listings and download your data as HTML, JSON, CSV, Excel, XML. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Maximillian Copelli

871

Shein Scraper

natanielsantos/shein-scraper

Scrape product data from Shein with this reliable tool. Extract price, images, description, sizes, category, shipping price and much more. Download your data as HTML table, JSON, CSV, Excel, XML, and RSS feed.

Nataniel Santos

396

Transfermarkt Scraper

curious_coder/transfermarkt

⚽ Use this free tool as an API for the Transfermarkt website. Scrape and extract data from competition, club or player pages, or almost any Transfermarkt page. Download your data as HTML table, JSON, CSV, Excel, XML, and RSS feed.

Curious Coder

2.6k

Zillow Scraper

eunit/zillow-scraper

Extract data about properties for sale and rent on Zillow using the Zillow API, but with no daily call limits. Scrape millions of listings and download your data as HTML, JSON, CSV, Excel, or XML. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Emmanuel Uchenna

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

71.5k

223

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

4.6k

Playwright Scraper

apify/playwright-scraper

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Apify

848