Onthemarket Scraper

🏡 What is Onthemarket Real Estate Properties Scraper?

This Onthemarket properties Scraper will enable you scrape any sale/rent listing from collection from onthemarket.co.uk.

You can simply take your listing url from browser and enter it into this actor. This actor will crawl through all pages of particular listing and generate dataset for you.

Listing url is something you get when you perform the search on onthemarket site. Example listing urls :

• https://www.onthemarket.com/for-sale/property/e20/
• https://www.onthemarket.com/for-sale/property/london/?radius=0.25
• https://www.onthemarket.com/to-rent/property/london/

🚪 What can this Onthemarket Scraper do?

📈 Extract Onthemarket market data listings on Onthemarket

👀 This actor is not just scraper but also has monitoring capability. You can turn on monitoring mode and it will give you only newly added properties compared to your previous scrapes.

📩 This actor also helps yu to identify which properties are not listed anymore. Please refer to Identifying delisted properties

⬇️ Download Onthemarket real estate data in Excel, CSV, JSON, and other formats

🌳 What Onthemarket data can I extract using this tool?

📝	📝
Listing Title	Full Address
Listing URL	Localiy
Bathrooms	Bedrooms
Agent Name	Agent Phone
Listing Type	Property Type
Latitude	Longitude
Furnishing Type	Summary
Text Description	Formatted HTML Description
Amenities	Images
Price	Size
Listing Date	Schools
Floor Plans	DaysSinceAddedReduced

⬇️ Input

For simple usecase, you just need to provide browser url of onthemarket search result page & that's all. You can leave other fields as they are to be sensible defaults.

Input example

{
    "listUrls": [
        {
            "url": "https://www.onthemarket.com/for-sale/property/e20/"
        }
    ],
    "propertyUrls": [
        {
            "url": "https://www.onthemarket.com/details/12297424/"
        }
    ],
    "fullScrape": true,
    "monitoringMode": false,
    "maxProperties" : 1000
}

You can either provide listUrls to search properties from or provide propertyUrls directly to crawl.

Understading monitoring mode :

• fullScrape : This option is by default turned on. When enabled it always force actor to scrape complete listing from all pagination pages regardless of monitoring is enabled or not.

• monitoringMode : This open when turned on will only scrape newly added property listings compared to previously scraped properties by this actor. It's important to turn off fullScrape setting if you are using this mode. If you keep fullScrape on, it will re-scrape complete listing again.

• enableDelistingTracker : This option when turned on will start tracking date against each property under Apify Key Value store. This KV store can be queried later to find out which properties are delisted.

• addEmptyTrackerRecord : This option when turned on will add empty record having only id of property to Apify dataset. This helps you identify whether property is still listed compared to your own database in incremental mode.

• maxProperties : If provided scraping will limit the scraped properties to given number. This limit will be applied per input url provided. Also, this limit will be rounded to nearest multiple of 30.

⬆️ Output

The scraped data is stored in the dataset of each run. The data can be viewed or downloaded in many popular formats, such as JSON, CSV, Excel, XML, RSS, and HTML.

Output example

The result for scraping a single property like this:

{
	"id": "18393925",
	"url": "https://www.onthemarket.com/details/18393925/",
	"title": "3 bedroom penthouse for sale",
	"displayAddress": "One Waterside, Midland Road, Bath BA2",
	"locality": "Bath",
	"bathrooms": 3,
	"bedrooms": 3,
	"agent": "Londra Estate - London",
	"postcode": "BA2 3FT",
	"agentPhone": "020 8115 3322",
	"propertyType": "Penthouse",
	"price": "£747,500",
	"priceRaw": 747500,
	"shortPrice": "£748k",
	"priceQualifier": null,
	"secondaryPrice": null,
	"coordinates": {
		"latitude": 51.383562,
		"longitude": -2.376994
	},
	"type": "sale",
	"sizeMin": "1,151 sq ft / 107 sq m",
	"sizeMinSqM": 107,
	"sizeMinSqFt": 1151,
	"furnishing": null,
	"summary": "A collection of high-specification studio, 1, 2 and 3 bedroom apartments, including a limited selection of penthouse homes, set within an exceptional riverside location just a short walk from Bath city centre.Designed to reflect the character and heritage of Bath while offering contemporary city...",
	"features": [
		"Selection of studio, 1, 2 and 3 bedroom apartments plus penthouses",
		"Prime riverside location near the River Avon",
		"Approximately 15-minute walk to Bath city centre",
		"Contemporary open-plan layouts"
	],
	"floorplans": [
		"https://media.onthemarket.com/properties/18393925/1631717094/floor-plan-0-original.jpg",
		"https://media.onthemarket.com/properties/18393925/1631717094/floor-plan-1-original.png"
	],
	"externalFloorplans": [],
	"keyInfo": [
		{
			"title": "Tenure",
			"value": "Leasehold  |  999 yrs left"
		},
		{
			"title": "Council tax",
			"value": "Ask agent"
		},
		{
			"title": "Mobile signal",
			"value": {
				"date": "2024-03-14T17:28:56.424Z",
				"three": "green",
				"vodafone": "enhanced",
				"ee": "green",
				"o2": "enhanced"
			}
		},
		{
			"title": "Heating",
			"value": "Gas, Electric, Underfloor heating, Gas central, Under floor, Eco friendly"
		}
	],
	"description": "A collection of high-specification studio, 1, 2 and 3 bedroom apartments, including a limited selection of penthouse homes, set within an exceptional riverside location just a short walk from Bath city centre.",
	"descriptionHtml": "<html><head></head><body><p>A collection of high-specification studio, 1, 2 and 3 bedroom apartments, including a limited selection of penthouse homes, set within an exceptional riverside location just a short walk from Bath city centre.</p><p>Designed to reflect the character and heritage of Bath while offering contemporary city living, these beautifully crafted homes feature spacious open-plan layouts, high-quality finishes and large windows that maximise natural light. Many apartments enjoy views over the River Avon or the surrounding landscape, creating a calm and elegant living environment.</p></body></html>",
	"images": [
		"https://media.onthemarket.com/properties/18393925/1628026568/image-0-1024x1024.jpeg",
		"https://media.onthemarket.com/properties/18393925/1628026568/image-1-1024x1024.jpg",
		"https://media.onthemarket.com/properties/18393925/1628026568/image-2-1024x1024.jpeg",
		"https://media.onthemarket.com/properties/18393925/1628026568/image-3-1024x1024.jpg"
	],
	"schools": [
		{
			"name": "Oldfield Park Infant School",
			"distance": "0.2mi."
		},
		{
			"name": "Parkside Children's Centre",
			"distance": "0.5mi."
		},
		{
			"name": "St Andrew's Church School",
			"distance": "0.5mi."
		}
	],
	"stations": [
		{
			"name": "Oldfield Park",
			"distance": "0.3mi."
		},
		{
			"name": "Bath Spa",
			"distance": "1.0mi."
		}
	],
	"daysSinceAddedReduced": "Added > 14 days",
	"commercial": false,
	"premium": false,
	"exclusive": false,
	"recentlyAdded": false,
	"newHome": false,
	"developmentProperty": false,
	"forSale": true,
	"toRent": false,
	"propertyLabels": [
		"Online viewing"
	],
	"poi": true,
	"totalViews": "2500+",
	"transTypeId": "resale",
	"studentChannel": false,
	"matterportVirtualTour": true,
	"virtualtours": [
		"https://my.matterport.com/show/?m=QkB47GnfwZj"
	],
	"videotours": [],
	"documents": [],
	"mobileReception": {
		"o2": "enhanced",
		"three": "green",
		"vodafone": "enhanced",
		"ee": "green",
		"date": "March 14, 2024"
	},
	"areaStats": {
		"avgHomePrices": {
			"title": "3 bedroom penthouses",
			"price": "£659,962"
		},
		"crimes": {
			"level": "very-low",
			"label": "Very low"
		}
	}
}

❓Limitations

Since Onthemarket allows only 1000 properties per listing/search result, you might want to break down your listing urls into smaller area if it has more than 1K results. Good News is that even if multiple list urls contains overlapping results, they will get deduplicated within same run data.

🤝 Related Actors

• Rightmove Scraper: Scrape sale/rent listings from rightmove.co.uk.
• Zoopla Scraper: Scrape property sale/rent listings, prices, and details from Zoopla.
• Rightmove Full Address & House Number Finder: Find full addresses and house numbers for Rightmove listings.
• Rightmove Land Registry Full Address & House Number Finder: Get full address and house number using Land Registry data for Rightmove properties.
• Rightmove EPC Full Address Finder: Find EPC and full address details for Rightmove listings.
• Rightmove Commercial Scraper: Scrape commercial property listings from Rightmove.
• Rightmove Sold House Properties Scraper: Scrape sold house price data from Rightmove.
• Rightmove Agents Scraper: Extract agent and agency details from Rightmove.
• Zoopla Sold Properties Scraper: Scrape sold property data from Zoopla.
• Zoopla Commercial Properties Scraper: Scrape commercial property listings from Zoopla.

🔎 Identifying delisted properties

This actor provides you monitoring mode configuration using which you can get only incremental updates about newly added properties. In case, you also want to identify which properties are delisted from platform, you can use any of the following techniques with the help of this actor.

1. Running Always in full scraper mode : Run this actor always in full scrape mode and cross check the new incoming batch of data with your existing database. If any property that exists in yoru database but not in newly scraped data batch, that means it's not listed anymore

2. Use Key Value Store generated by scraper : If your are monitoring very large batch of data and you don't want to scrape everything all the time, this method involves bit of technicality but achieves the goal efectively. Apify has storage feature called Key-value store. When you run this scrape, this scraper stores every single property in key value store along with timestamp in onthemarket-properties store. Inside this store, key is property id itself and value is timestamp like this

   { lastSeen : '2023-11-02T05:59:25.763Z'}
   

   Whenever you run this scraper, it will update the timestamp against particular id if it finds property on the platform. e.g. if we have 2 proprties with id prop1 and prop2 and we scraped them both on November 1, key value storage would look like this :

   prop1 -> { lastSeen : '2023-11-01T05:59:25.763Z'}
   prop2 -> { lastSeen : '2023-11-01T05:59:25.763Z'}
   

   Now if you run this scraper again on December 1 and prop1 is not on the platform anymore but prop2 is still there, key value storage would change like this :

   prop1 -> { lastSeen : '2023-11-01T05:59:25.763Z'}
   prop2 -> { lastSeen : '2023-12-01T05:59:25.763Z'}
   

   That means if any property has lastSeen less than latest batch you loaded, that property is delisted now. You can directly iterate through whole Key value storage using Apify key value storage API to identify this. Please refer to this API documentation to do the same. Please remember store name generated by this scrape will be onthemarket-properties.

   Alternatively, you can iterate through your existing database active properties and use this API to identify listing status.

� Pricing Model & Usage Logic

This actor uses Apify's Pay-Per-Event (PPE) billing model, with usage tracked and charged based on the number of properties processed and additional multipliers. Charges are triggered at specific usage thresholds and events.

🟢 Charge Events & Tiers

The actor uses a tiered pricing model based on the number of properties processed. Each tier has a specific rate per 1,000 properties:

🔻 Cost Efficiency as You Scale: The tier-based pricing model is designed to reduce your cost per property as your usage increases. The more properties you process, the lower your per-unit cost becomes, helping keep your overall costs under control as you scale up to higher volumes.

Starter Tier (starter-tier-1K)

For the first 25,000 properties processed, the cost per 1,000 properties is $2.00 USD. This tier is ideal for small to medium jobs and ensures a low entry cost for initial usage.

Growth Tier (growth-tier-1K)

For properties processed from 25,000 up to 50,000 the cost per 1,000 properties drops to $1.50 USD. This tier rewards higher volume usage with a reduced rate, making it cost-effective for scaling up.

Scale Tier (scale-tier-1K)

For properties processed from 50,000 up to 200,000 the cost per 1,000 properties is $1.00 USD. This tier is designed for large-scale operations, offering further discounts as your volume increases.

Enterprise Tier (enterprise-tier-1K)

For properties processed above 200,000 the cost per 1,000 properties is $0.60 USD. This tier is for enterprise-level usage, providing the lowest rate for very high-volume processing.

Each charge event is triggered automatically as your processed property count crosses into the next tier. The actor tracks usage and applies the correct rate for each tier, ensuring transparent and predictable billing.

These pricing tiers are applied on a monthly basis, and your usage count resets at the start of each new month. This ensures you always start fresh and only pay for what you use each month.

Example:

• Scraping 300,000 properties in a month:
  • $2.00 per 1K properties for the first 25,000 properties ($50)
  • $1.00 per 1K properties upto 50,000 properties ($25)
  • $0.80 per 1K properties upto 200,000 properties ($120)
  • $0.60 per 1K properties above 200,000 properties ($60)
  • Total: $255.00

📊 Cost Per 1K Units – How Billing Works

The pricing is calculated in batches of 1,000 units. This means:

• Initial Charge: When you start the actor, it reserves and charges you for 1K units (1,000 properties or their equivalent based on multipliers).
• Continuous Usage: You can continue scraping in the same run or across multiple runs. As long as your usage stays within that 1K batch, no additional charges are applied.
• Next Batch: Only when you exhaust the 1K quota, the system charges you for the next 1K batch. This billing cycle repeats for every 1K units consumed.
• Pay-As-You-Go: You only pay for the batches you actually use. If you scrape 1,500 properties in total (across runs), you'll be charged for 2 batches (2K units).

Example Timeline:

1. Start run #1 → Charged for 1K units (can scrape up to 1,000 properties)
2. Scrape 800 properties in run #1 (200 units remaining in current 1K batch)
3. Start run #2 → Use the remaining 200 units + 100 from next 1K batch → Charged for 2nd 1K batch
4. Continue in run #3 → Still within the 2K batch until you exceed it
5. When you exceed 2K total → Automatically charged for 3rd 1K batch

This ensures predictable billing in discrete 1K chunks, making it easier to manage your usage and costs.

⚡ Additional Usage Parameters (Multipliers)

The following options increase the usage count for each property scraped, affecting your billing. These multipliers are cumulative.

Feature	Multiplier	Impact
Monitoring Mode	+2.0x	Tracks only newly listed properties compared to previous runs; requires additional tracking logic
Delisting Tracker	+1.5x	Enables tracking of delisted properties with timestamps in KV Store; requires additional storage
Empty Tracker Records	+0.5x	Adds tracker ID records in incremental mode for delisting identification
Apify Proxy	+1.0x	Uses Apify proxy service for enhanced reliability and geo-targeting
Additional Memory	+1.0x per 256MB	Charges for each 256MB block above the 256MB base allocation

Example Calculation:

• Scraping 100 properties with:

  • Monitoring Mode: ON (2.0x)
  • Delisting Tracker: ON (1.5x)
  • Apify Proxy: ON (1.0x)

  Total Units Charged = 100 × (1 + 2.0 + 1.5 + 1.0) = 100 × 5.5 = 550 units

  This would stay within the first 1K batch with no additional charge.

Cost Optimization Tips

✅ Use Monitoring Mode Strategically – Enable monitoring to scrape only new properties and avoid re-scraping old listings ✅ Delisting Tracker Selectively – Only enable if you need to identify delisted properties ✅ Batch Your Scrapes – Running multiple targeted scrapes may be more cost-effective than one massive scrape ✅ Monitor Your Usage – Keep track of your monthly usage to understand which tier you're in ✅ Budget Planning – Set a monthly budget via ACTOR_MAX_TOTAL_CHARGE_USD environment variable to control spending

💡 Tip: Run this actor on 256MB–512MB memory for optimal performance and cost efficiency. The actor is highly optimized for this setting. Only increase memory if you have specific needs, as additional memory will increase your usage charges. Memory charges are applied for every 256MB block above the 256MB base allocation.

�🙋‍♀️ For custom solutions

In case you need some custom solution, you can contact me : dhrumil@techvasu.com

Or learn more about me on github : https://github.com/dhrumil4u360

Or learn more about me on github : https://github.com/dhrumil4u360