Autotrader Scraper
3 days trial then $15.00/month - No credit card required now
Autotrader Scraper
3 days trial then $15.00/month - No credit card required now
Uncover valuable car listing data on Autotrader.com with our Autotrader Scraper. Scrape and extract descriptions, images, prices, mileage, addresses, names, engine information, the transmission of the car, contact details, and more without any limitations. Filter by any field to find your ideal car.
Scraper doesn't stop / get everything.
Closed
I've given the scraper a few pages to scrape. There are a total of 2.7k results on them. It was working good till result 2009. However, after that the scraper just cotninued running for 30 more minutes before I aborted it. It was "handling tasks" but not adding anything to the results
Task ID: mdRLfEiodfTmRvcdd
Hey there,
Thank you for reaching out, and letting us know about your inquiry. I passed this information to the Engineering Team and will get back to you as soon as possible.
Best
Hey there,
Thank you for reaching out, and letting us know about your inquiry. It seems like Autotrader implemented a new soft limitation that doesn't allow users to retrieve more than 12 pages. That's why the actor tried to retrieve the next page, but could not find anything. Also, that is the reason for the result amount. We just deployed a new version to stop the actor properly, but there are no methods of going over the limitation except the users manually breaking down their searches.
Best
hopeful_sorter
Okay, I noticed that when I tried scraping myself that's why I also tried to break down the searches of up to 400-500 results but do you know the exact cap here? Just so I know how much to break them down.
We only encountered the cap of 12 pages. Other than that, there are no other limitations on the result count as far as we saw.
epctexActor Metrics
6 monthly users
-
5 stars
>99% runs succeeded
6.1 hours response time
Created in Feb 2020
Modified 10 hours ago
