No credit card required

Download HTML from URLs

mtrunkat/url-list-download-html

Try for free

No credit card required

This actor takes a list of URLs and downloads HTML of each page.

All issues Create new issue

getting 403 from angel.co, used to work previously

Closed

heady_sitar opened this issue

I am getting 403 from angel.co, previously used to work example URL:

https://links.angel.co/u/click?_t=26b4e8aeb47d4cd3acd5eba415f76f62&_m=da905790e1494e94ad3eba8edf73710c&_e=EKPEaUzxQqZD1HpvY5ey7j03nTstLbXhEp-NiREiCyCdodRttkWo4LLYHHFuICZSy60HH3taso6W3z7e5CHzAvDUxiLnP25WujdlxEMbZ_-ke9Gng2U_vP9mOByvIvcZpEubz9dG3w_49X4oKYVEGqLb89kOoGpSoU80R2B0363SC6F01WXY9Gcdsd5TJ6E1bv1t8RgSOxK1GT3Atapx9pA7Ru8nkL9rJ0xlyBrtw1513U5rxLPIrgqgfyBDGYC5AuCfm-yv7YFCzelE8Dx6DDOAduorPpp22kIKZ8RBQpTlfA0mfomJNSQ8EODognnUs34U0VQmDTMtNTISr2m58KX4_y5tBzOwH16ZFdkC78B5-kTqQEC-ZNTamNJ9M1ERzw6bhtipXy-py7fnttlAMrY5kJUY5Jq_9KVARfJnmuGyLYLydgk5AjIkoUnQFVMG-ZsQj7HYyuEB0wbFuG3a3g%3D%3D

heady_sitar

Do you have updates on this ?

Zuzka Pelechová (zuzka)

Sorry, missed your message before, the page seems to have started blocking heavily. I mean more then the scope of this actor as it is fairly generic. Can you tell me more about the use case?

heady_sitar

no worries, we only need to get the HTML of the page back to then extract information. Do you know another scraper ?

Zuzka Pelechová (zuzka)

Hey I tried with webscraper but it seems you will need a custom solution as the page seems to be blocking really heavily. You can get a custom solution here: https://apify.com/custom-solutions.

Add comment

Developer

Marek Trunkát

Actor metrics

60 monthly users
100.0% runs succeeded
days response time
Created in Feb 2018
Modified about 1 month ago

Categories

Automation

Content Checker

jakubbalada/content-checker

Monitor a website or web page for content changes. Automatically saves before and after screenshots and sends an email notification when content changes are detected.

Jakub Balada

AI Web Agent

apify/ai-web-agent

Use natural language prompts to browse the web, click on elements, fill and submit forms, extract data, and take screenshots using the OpenAI API.

Apify

423

Merge, Dedup & Transform Datasets

lukaskrivka/dedup-datasets

The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

Lukáš Křivka

1.7k

Pinecone GPT Chatbot

tri_angle/pinecone-gpt-chatbot

Pinecone GPT Chatbot combines OpenAI's GPT models with Pinecone's database to generate insightful responses. Its interactive chatbot interface presents precise and comprehensive answers to user queries. Benefit from semantic understanding, efficient workflows, and enriched knowledge integration!

Tri⟁angle

Send Email

apify/send-mail

The actor automatically sends an email to a specific address. This actor is useful for notifications and reporting. With only 3 lines of javascript code, you'll be on top of your scraping actors and never miss important results or issues.

Apify

2.4k

Instagram Followers Count Scraper

apify/instagram-followers-count-scraper

Scrape the number of followers & follows from any Instagram profile. Schedule the scraper to run regularly to monitor how the numbers change. You can also export scraped data, run the scraper via API, monitor runs or integrate with other tools.

Apify

Anti Captcha Recaptcha

petr_cermak/anti-captcha-recaptcha

🧰 Actor for solving Google reCAPTCHA using the anti-captcha.com service. You need to have an anti-captcha subscription.

Petr Cermak

1.3k

Page Scraping Analyzer

apify/page-analyzer

Performs analysis of a webpage to figure out the best way how to scrape its data. Provide a URL and data points to find and get back a detailed dashboard showing how the data can be scraped. Works with initial and rendered HTML, JavaScript variables and dynamically loaded data.

Apify

1.1k

Google Sheets Import & Export

lukaskrivka/google-sheets

Import data from datasets or JSON files to Google Sheets. Programmatically process data in Sheets. Easier and faster than the official Google Sheets API and perfect for importing data from scraping.

Lukáš Křivka

867