🔍🚗 Mobile.de Scraper
3 days trial then $9.99/month - No credit card required now
🔍🚗 Mobile.de Scraper
3 days trial then $9.99/month - No credit card required now
Effortlessly scrape car data from Germany's largest vehicle marketplace, Mobile.de. Get access to millions of entries of cars, motorbikes, etc. across Europe. Fast, cheap & reliable. Rental version for larger use cases.
"automaticPaging": true - Still not getting results
Hi, thank you for adding the pagination feature. Maybe I'm doing something wrong, but I still can't get 1000 records from the actor - it stops after 20 results.
Pagination is enabled. What else wrong? How can I get 1000 records, if possible in English?
Here is my run data:
{ "automaticPaging": true, "maxItems": 1000, "searchCategory": "Car", "searchPageURLs": [ "https://suchen.mobile.de/fahrzeuge/search.html?dam=false&ft=ELECTRICITY&isSearchRequest=true&pageNumber=2&s=Car&sb=rel&vc=Car&lang=en" ], "sort": "Standard", "searchPageURLMaxItems": 20, "searchTerms": [ "e36" ], "models": [] }
Hey,
you're almost there! :D. You just need to set the 📈 Maximum result count per search URL (look at the image) to 1000.
Or just copy this JSON:
1{ 2 "automaticPaging": true, 3 "maxItems": 1000, 4 "searchCategory": "Car", 5 "searchPageURLMaxItems": 1000, 6 "searchPageURLs": [ 7 "https://suchen.mobile.de/fahrzeuge/search.html?dam=false&ft=ELECTRICITY&isSearchRequest=true&pageNumber=2&s=Car&sb=rel&vc=Car&lang=en" 8 ], 9 "searchTerms": [ 10 "e36" 11 ], 12 "sort": "Standard" 13}
Is this working?
apidev
Yea, great - that worked! Thank you.
Is it able to scrap more than 1000 results - like 50K records? In that case JSON will be like this?
1{ 2 "automaticPaging": true, 3 "maxItems": 50000, 4 "searchCategory": "Car", 5 "searchPageURLMaxItems": 50000, 6 "searchPageURLs": [ 7 "https://suchen.mobile.de/fahrzeuge/search.html?dam=false&ft=ELECTRICITY&isSearchRequest=true&pageNumber=2&s=Car&sb=rel&vc=Car&lang=en" 8 ], 9 "searchTerms": [ 10 "e36" 11 ], 12 "sort": "Standard" 13}
Also can I start scraping from the first/initial page of results - the one that contain "ref=quickSearch" https://suchen.mobile.de/fahrzeuge/search.html?dam=false&ft=ELECTRICITY&isSearchRequest=true&ref=quickSearch&s=Car&sb=rel&vc=Car&lang=en
or I need to start from the the second page of results that contain "pageNumber=2" https://suchen.mobile.de/fahrzeuge/search.html?dam=false&ft=ELECTRICITY&isSearchRequest=true&pageNumber=2&s=Car&sb=rel&vc=Car&lang=en
Or both of those parameters doesn't matter?
Hey,
glad it worked :D. To your questions:
Is it able to scrap more than 1000 results - like 50K records?
At this time, the maximum amount of results per search query is 2000. The website is limiting the amount intentionally, but we have found a way to possibly extract all results (lets call it deep search). It is going to take some time to implement however (probably a few days to a week), if you would really love to see that feature.
In that case JSON will be like this?
Yes, that is correct.
Also can I start scraping from the first/initial page of results - the one that contain "ref=quickSearch" https://suchen.mobile.de/fahrzeuge/search.html?dam=false&ft=ELECTRICITY&isSearchRequest=true&ref=quickSearch&s=Car&sb=rel&vc=Car&lang=en or I need to start from the the second page of results that contain "pageNumber=2" https://suchen.mobile.de/fahrzeuge/search.html?dam=false&ft=ELECTRICITY&isSearchRequest=true&pageNumber=2&s=Car&sb=rel&vc=Car&lang=en Or both of those parameters doesn't matter?
If the automatic paging is ON, it does not matter. The actor ALWAYS starts on the first page, so you don't have to worry about that.
3x1tActor Metrics
10 monthly users
-
2 bookmarks
>99% runs succeeded
11 hours response time
Created in Dec 2024
Modified 3 days ago
