What does Mobile.de Scraper do?

Mobile.de Scraper for ads allows you to scrape any ads from chosen urls from mobile.de. Here are main functionalities:

1. Extract all mobile.de data from chosen urls
2. Extract all mobile.de data with limited pages from chosen urls
3. Export any mobile.de data in many formats, also easy to integrate with your own external systems within minutes

Input

Full input sample:

1{
2"start_urls": [
3{
4"url": "https://suchen.mobile.de/fahrzeuge/search.html?dam=false&isSearchRequest=true&pageNumber=2&ref=srpNextPage&refId=c1089a09-16a9-997d-326d-e8e9ddeceb83&s=Car&sb=rel&vc=Car"
5}
6],
7"scrape_page_limit": 45
8}

• run_mode By default, test mode is enabled, for the real scraped, please select Production option (prod)

• start_urlsshould be ads search page. i.e. https://suchen.mobile.de/fahrzeuge/search.html?dam=false&isSearchRequest=true&pageNumber=2&ref=srpNextPage&refId=c1089a09-16a9-997d-326d-e8e9ddeceb83&s=Car&sb=rel&vc=Car.

• scrape_page_limit if this data is set, only the first scrape_page_limit of start_urls will be scraped. To remove this limit, remove this scrape_page_limit from input.

• Note: Due to mobile.de limitation at 50 pages, in order to scrape all ads, you should enter multiple urls with sub-search criteria.

Output

Output sample for simple data

1{
2  "url": "https://suchen.mobile.de/fahrzeuge/details.html?id=395079745&action=topOfPage&dam=false&isSearchRequest=true&ref=srp&refId=2f9ce888-eda2-5efa-15ae-ce938ee065a1&s=Car&sb=rel&searchId=2f9ce888-eda2-5efa-15ae-ce938ee065a1&vc=Car",
3  "id": 395079745,
4  "title": "Audi A6 Avant 50 TDI Q sport S line MATRIX ACC 20\" AV",
5  "segment": "Car",
6  "category": "Kombi",
7  "kba": {
8    "hsn": "0588",
9    "tsn": "BNH"
10  },
11  "make": "Audi",
12  "model": "A6",
13  "previewImage": "https://img.classistatic.de/api/v1/mo-prod/images/2f/2f32eb02-5dea-40cf-ac96-dcc32e5f1200?rule=mo-160.jpg",
14  "previewThumbnails": [
15    "https://img.classistatic.de/api/v1/mo-prod/images/4c/4c9e4be7-4d2b-43ed-870d-8eb0b248cd60?rule=mo-160.jpg",
16    "https://img.classistatic.de/api/v1/mo-prod/images/78/78f07db6-02ea-42f7-9d04-15a0286e4625?rule=mo-160.jpg",
17    "https://img.classistatic.de/api/v1/mo-prod/images/ad/addba8e0-6e92-4d8f-91ad-55642e25b0ee?rule=mo-160.jpg"
18  ],
19  "price": {
20    "gross": 41490,
21    "net": 34865.55,
22    "vat": "19% MwSt."
23  },
24  "priceRating": "REASONABLE_PRICE",
25  "attributes": [
26    [
27      {
28        "value": "EZ 06/2020"
29      },
30      {
31        "value": "66.600 km"
32      },
33      {
34        "value": "210 kW (286 PS)"
35      }
36    ],
37    [
38      {
39        "value": "Kombi"
40      },
41      {
42        "value": "Unfallfrei",
43        "bold": true
44      },
45      {
46        "value": "Diesel"
47      },
48      {
49        "value": "Automatik"
50      },
51      {
52        "value": "HU Neu"
53      },
54      {
55        "value": "4/5 Türen"
56      }
57    ],
58    []
59  ],
60  "attributes_test": [
61    [
62      {
63        "value": "Unfallfrei",
64        "bold": true
65      },
66      {
67        "value": "EZ 06/2020"
68      },
69      {
70        "value": "66.600 km"
71      },
72      {
73        "value": "210 kW (286 PS)"
74      },
75      {
76        "value": "Diesel"
77      }
78    ],
79    []
80  ],
81  "attr": {
82    "cn": "DE",
83    "z": "01917",
84    "loc": "Kamenz",
85    "fr": "06/2020",
86    "pw": "210 kW (286 PS)",
87    "ft": "Diesel",
88    "ml": "66.600 km",
89    "cc": "2.967 cm³",
90    "tr": "Automatik",
91    "gi": "Neu",
92    "ecol": "Weiß",
93    "eu": "Deutsche Ausführung",
94    "door": "4/5",
95    "sc": "5",
96    "c": "EstateCar",
97    "emc": "Euro6",
98    "pvo": "1"
99  },
100  "isVideoEnabled": true,
101  "imageCount": 25,
102  "isFinancingAvailable": true,
103  "supportedLeasingType": null,
104  "leasingRate": null,
105  "sellerInfo": {
106    "name": "Autohaus Elitzsch GmbH",
107    "sellerType": "DEALER",
108    "country": "DE",
109    "location": "DE-01917 Kamenz",
110    "logo": "https://img.classistatic.de/api/v1/mo-prod/images/04/04bcd3b9-5ff5-4ca3-b21a-06842fd8392a?rule=mo-80.jpg",
111    "phone": "+49 (0)3578 343490",
112    "rating": {
113      "score": 4.6,
114      "count": 35
115    }
116  }
117}

Delisting ads

• First solution: This feature requires to run full scraped. If the ads don't appear in the last full scraped run, then those ads have been delisted.
• Second solution: Use input detail_page_urls to check if ads has been delisted

1{
2	"url": "https://suchen.mobile.de/auto-inserat/volkswagen-t-roc-1-5-tsi-r-line-ledplus-navi-ahk-pano-dab-bayreuth/3911454010.html",
3	"is_delisted": true
4}

Support

If this ready made scraper does not match your need (input, output, pricing) or you get any issue or you need to scrape other websites, please contact us at: realspidery@gmail.com or on X: realspidery