🔍🚗 Mobile.de Scraper
Pricing
$9.99/month + usage
🔍🚗 Mobile.de Scraper
Effortlessly scrape car data from Germany's largest vehicle marketplace, Mobile.de. Get access to millions of entries of cars, motorbikes, etc. across Europe. Fast, cheap & reliable. Rental version for larger use cases.
0.0 (0)
Pricing
$9.99/month + usage
2
Monthly users
12
Runs succeeded
98%
Response time
1.1 days
Last modified
3 days ago
"automaticPaging": true - Still not getting results
Closed
Hi, thank you for adding the pagination feature. Maybe I'm doing something wrong, but I still can't get 1000 records from the actor - it stops after 20 results.
Pagination is enabled. What else wrong? How can I get 1000 records, if possible in English?
Here is my run data:
{ "automaticPaging": true, "maxItems": 1000, "searchCategory": "Car", "searchPageURLs": [ "https://suchen.mobile.de/fahrzeuge/search.html?dam=false&ft=ELECTRICITY&isSearchRequest=true&pageNumber=2&s=Car&sb=rel&vc=Car&lang=en" ], "sort": "Standard", "searchPageURLMaxItems": 20, "searchTerms": [ "e36" ], "models": [] }
Hey,
you're almost there! :D. You just need to set the 📈 Maximum result count per search URL (look at the image) to 1000.
Or just copy this JSON:
1{ 2 "automaticPaging": true, 3 "maxItems": 1000, 4 "searchCategory": "Car", 5 "searchPageURLMaxItems": 1000, 6 "searchPageURLs": [ 7 "https://suchen.mobile.de/fahrzeuge/search.html?dam=false&ft=ELECTRICITY&isSearchRequest=true&pageNumber=2&s=Car&sb=rel&vc=Car&lang=en" 8 ], 9 "searchTerms": [ 10 "e36" 11 ], 12 "sort": "Standard" 13}
Is this working?
apidev
Yea, great - that worked! Thank you.
Is it able to scrap more than 1000 results - like 50K records? In that case JSON will be like this?
1{ 2 "automaticPaging": true, 3 "maxItems": 50000, 4 "searchCategory": "Car", 5 "searchPageURLMaxItems": 50000, 6 "searchPageURLs": [ 7 "https://suchen.mobile.de/fahrzeuge/search.html?dam=false&ft=ELECTRICITY&isSearchRequest=true&pageNumber=2&s=Car&sb=rel&vc=Car&lang=en" 8 ], 9 "searchTerms": [ 10 "e36" 11 ], 12 "sort": "Standard" 13}
Also can I start scraping from the first/initial page of results - the one that contain "ref=quickSearch" https://suchen.mobile.de/fahrzeuge/search.html?dam=false&ft=ELECTRICITY&isSearchRequest=true&ref=quickSearch&s=Car&sb=rel&vc=Car&lang=en
or I need to start from the the second page of results that contain "pageNumber=2" https://suchen.mobile.de/fahrzeuge/search.html?dam=false&ft=ELECTRICITY&isSearchRequest=true&pageNumber=2&s=Car&sb=rel&vc=Car&lang=en
Or both of those parameters doesn't matter?
Hey,
glad it worked :D. To your questions:
Is it able to scrap more than 1000 results - like 50K records?
At this time, the maximum amount of results per search query is 2000. The website is limiting the amount intentionally, but we have found a way to possibly extract all results (lets call it deep search). It is going to take some time to implement however (probably a few days to a week), if you would really love to see that feature.
In that case JSON will be like this?
Yes, that is correct.
Also can I start scraping from the first/initial page of results - the one that contain "ref=quickSearch" https://suchen.mobile.de/fahrzeuge/search.html?dam=false&ft=ELECTRICITY&isSearchRequest=true&ref=quickSearch&s=Car&sb=rel&vc=Car&lang=en or I need to start from the the second page of results that contain "pageNumber=2" https://suchen.mobile.de/fahrzeuge/search.html?dam=false&ft=ELECTRICITY&isSearchRequest=true&pageNumber=2&s=Car&sb=rel&vc=Car&lang=en Or both of those parameters doesn't matter?
If the automatic paging is ON, it does not matter. The actor ALWAYS starts on the first page, so you don't have to worry about that.
Pricing
Pricing model
RentalTo use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.
Free trial
3 days
Price
$9.99
