eBay Scraper avatar

eBay Scraper

Try for free

3 days trial then $50.00/month - No credit card required now

Go to Store
eBay Scraper

eBay Scraper

dtrungtin/ebay-items-scraper
Try for free

3 days trial then $50.00/month - No credit card required now

Unofficial eBay API to extract data from eBay based on keywords or categories. Scrape prices, product descriptions, images, location, availability, brand, and more. Download extracted data in structured format and use it in reports, spreadsheets, databases, and applications.

Developer
Maintained by Community

Actor Metrics

  • 49 Monthly users

  • 5.0 / 5 (1)

  • 20 bookmarks

  • >99% runs succeeded

  • 12 hours response time

  • Created in Oct 2021

  • Modified a day ago

Categories
UL

Crawler wasn't able to retrieve desired listing count

Open
ultramarine_leaf opened this issue
a month ago

When I ran the crawler, i was trying to get 10k listings. It seems to have gotten stuck at around 500. Attached is the error I kept seeing appear in the logs

UL

ultramarine_leaf

a month ago

I am also running into this error:

ERROR CheerioCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.ebay.fr/itm/267158076764?nordt=true","retryCount":1,"id":"WvV3COFhwjmuTHm"} 2025-02-14T03:06:20.594Z Error: Something is wrong! Retry ... 2025-02-14T03:06:20.596Z at exports.handleDetail (/usr/src/app/src/routes.js:107:15) 2025-02-14T03:06:20.598Z at CheerioCrawler.handlePageFunction [as userProvidedHandler] (/usr/src/app/main.js:44:28) 2025-02-14T03:06:20.600Z at /usr/src/app/node_modules/apify/build/crawlers/cheerio_crawler.js:516:62 2025-02-14T03:06:20.602Z at wrap (/usr/src/app/node_modules/apify/node_modules/@apify/timeout/index.js:73:33) 2025-02-14T03:06:20.606Z at /usr/src/app/node_modules/apify/node_modules/@apify/timeout/index.js:88:13 2025-02-14T03:06:20.609Z at AsyncLocalStorage.run (node:async_hooks:319:14) 2025-02-14T03:06:20.611Z at /usr/src/app/node_modules/apify/node_modules/@apify/timeout/index.js:87:25 2025-02-14T03:06:20.613Z at new Promise () 2025-02-14T03:06:20.615Z at addTimeoutToPromise (/usr/src/app/node_modules/apify/node_modules/@apify/timeout/index.js:81:12) 2025-02-14T03:06:20.616Z at CheerioCrawler._handleRequestFunction (/usr/src/app/node_modules/apify/build/crawlers/cheerio_crawler.js:516:50)

dtrungtin avatar

Look like the issue from network at that time. I run to crawl one detail url and it's working https://console.apify.com/view/runs/jvsWBlEETt0CKNWBy

Please check at your side to run only one detail url.

UL

ultramarine_leaf

a month ago

i tried it again. It seems like it works for a small number of records at the beginning, but if you set the number of items too high, then the crawler is getting blocked by ebay. Is there a way to fix this?

dtrungtin avatar

Please contact support guy (chat box at bottom right) to check your proxy available IPs. Increase more IPs will help this issue. https://apify.com/proxy