Shopee Api Scraper
14 days trial then $50.00/month - No credit card required now
This Actor may be unreliable while under maintenance. Would you like to try a similar Actor instead?
See alternative ActorsShopee Api Scraper
14 days trial then $50.00/month - No credit card required now
Query Shopee's unofficial API for product searches by keyword, category, or shop. Access detailed information including prices, orders, stock levels, and ratings. Also retrieve related entities like the category tree, shop listings, and keyword suggestions.
Requests are unsuccessful.
Closed
Until yesterday, I was able to crawl the Search and Category pages. However, it stopped functioning today. Here’s a sample log for you to examine.
2024-03-26T07:36:01.758Z ACTOR: Pulling Docker image of build Hxt9I5HGeNpZglgpG from repository. 2024-03-26T07:36:33.719Z ACTOR: Creating Docker container. 2024-03-26T07:36:33.959Z ACTOR: Starting Docker container. 2024-03-26T07:36:35.940Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1920x1080x24+32 -nolisten tcp 2024-03-26T07:36:35.942Z Executing main command 2024-03-26T07:36:37.335Z INFO System info {"apifyVersion":"3.1.16","apifyClientVersion":"2.9.3","crawleeVersion":"3.8.2","osType":"Linux","nodeVersion":"v20.11.1"} 2024-03-26T07:36:38.345Z 2024-03-26 07:36:38.344 INFO SinglePagePuppeteerCrawler: Starting the crawler. 2024-03-26T07:37:02.871Z 2024-03-26 07:37:02.871 WARN SinglePagePuppeteerCrawler: Reclaiming failed request back to the list or queue. Detected a session error, rotating session... 2024-03-26T07:37:02.873Z Website not loaded properly 2024-03-26T07:37:02.875Z at SinglePagePuppeteerCrawler.postNavigationHooks (file:///home/myuser/dist/actor.js:117:27) {"id":"knmwoQzcSXFXDcj","url":"https://shopee.co.id/api/v4/search/search_items?by=relevancy&keyword=laptop","retryCount":1} 2024-03-26T07:37:23.301Z 2024-03-26 07:37:23.300 WARN SinglePagePuppeteerCrawler: Reclaiming failed request back to the list or queue. Detected a session error, rotating session... 2024-03-26T07:37:23.302Z We... [trimmed]
Marc Plouhinec (marc_plouhinec)
Hi,
Yes Shopee modified their website, I'm working on it since this morning. I deployed a new version 2h ago: https://apify.com/marc_plouhinec/shopee-api-scraper/changelog But it seems that the performance is not as good as before, I continue my investigation.
Best Regards,
Marc
IC_apify
Hello,
We appreciate the update. Unfortunately, the revised version is still not functioning. Kindly notify us when this issue has been resolved.
Regards, Amarnath.
Marc Plouhinec (marc_plouhinec)
Hi Amarnath,
I have been working on it since yesterday morning. Puppeteer is detected, so I have to replace it with the low level CDP protocol.
I have a proof of concept where I can successfully search products by keyword, and I'm currently implementing it in my scraper application.
I hope to solve this issue tomorrow.
Best Regards,
Marc
Marc Plouhinec (marc_plouhinec)
Hi Amarnath,
I have just deployed a new version of my scraper that works with Shopee again.
It was not easy, I put some details in the changelog: https://apify.com/marc_plouhinec/shopee-api-scraper/changelog
There are still some optimizations I need to re-enable (caching, fingerprint injection), so the performance should improve in the next release.
Best Regards,
Marc
Marc PlouhinecActor Metrics
31 monthly users
-
10 stars
90% runs succeeded
Created in Jan 2024
Modified 6 months ago
