Web Scraper avatar
Web Scraper
Try for free

No credit card required

View all Actors
Web Scraper

Web Scraper

apify/web-scraper
Try for free

No credit card required

Crawls arbitrary websites using the Chrome browser and extracts data from pages using a provided JavaScript code. The actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

User avatar

Shopee scraper problem

Open

lojahub opened this issue
3 months ago

I'm trying to use the scraper to extract information about searching for items in the store, but without success. After some research, I noticed that the information on the page only loads after a few seconds. Any tips on how to resolve this?

URL example: https://shopee.com.br/search?keyword=chinelo

User avatar

Hello and thank you for your interest in this Actor!

Usually with dynamic-loaded websites, it should be enough to set the Performace and Limits > Navigations waits until to networkidle0 - this way, the scraper should wait until there are no active (asynchronous) requests between the client and the server.

Unfortunately, there seems to be some issue with the Actor itself - even locally, the website just doesn't load properly. We already have an idea about what might be the culprit, but we'll need to run some tests first to be absolutely sure.

I'll keep you posted about any updates regarding this issue. Thank you! (and sorry for the inconvenience).

User avatar

lojahub

3 months ago

Hi Jindřich Bär, first of all thank you for the message and interest helping. I'm waiting for news. Thank you !

User avatar

lojahub

3 months ago

Hello, Jindřich Bär hoping you're doing great, do you have any news regarding the problem ?

Developer
Maintained by Apify
Actor metrics
  • 3.8k monthly users
  • 98.7% runs succeeded
  • 5.0 days response time
  • Created in Mar 2019
  • Modified 13 days ago