Hotpads.com Property Scraper

Overview

Extract public HotPads listing pages. This is a standalone Apify Actor for HotPads with its own input schema, source adapter, dataset, run summary, diagnostics, and output files.

Features

• Extracts publicly visible listing fields and structured page data.
• Opens detail pages when available to enrich title, price, address, features, media, and facts.
• Deduplicates records by source listing URL or identifier.
• Emits only source-backed live records with dataOrigin: "live-page".
• Omits unknown values instead of inventing them or inserting JSON null values.
• Saves per-run status and access-block diagnostics in storage/key_value_stores/default.

Default source URL

https://hotpads.com/san-francisco-ca/apartments-for-rent

Input

Field	Type	Default	Description
startUrls	array	source default	Public search, listing, or detail URLs for this portal.
maxItemsPerActor	integer	10	Maximum detailed records.
maxPagesPerActor	integer	2	Maximum list/search pages.
includeDetails	boolean	true	Enrich records from detail pages.
includeRawData	boolean	true	Keep selected structured source data.
proxyEnabled	boolean	false	Use an authorized Apify or user-supplied proxy.
maxRequestRetries	integer	3	Bounded retry/backoff for transient failures.

Sample live output

{
    "actorName": "hotpads-scraper",
    "sourcePortal": "HotPads",
    "recordType": "property",
    "listingId": "pad",
    "listingUrl": "https://hotpads.com/33-8th-at-trinity-place-san-francisco-ca-94103-23y7253/pad",
    "title": "33 8th at Trinity Place",
    "description": "The trinity collection is made of four towers designed by award-winning architect Arquitectonica, offering an extraordinary living experience minutes by walk from the San Francisco performing arts district and Hayes Valley.These luxurious",
    "listingType": "sale",
    "propertyType": "apartment",
    "price": {
        "display": "4074",
        "value": 4074,
        "currency": "USD",
        "minimum": 4074,
        "maximum": 6318
    },
    "address": {
        "full": "33 8th St",
        "street": "33 8th St",
        "locality": "San Francisco",
        "region": "CA",
        "postalCode": "94103",
        "country": "US",
        "latitude": 37.778447347753,
        "longitude": -122.41362188604
    },
    "features": {
        "bedrooms": 0,
        "bathrooms": 1,
        "area": {
            "display": "382–736 sqft",
            "value": 382,
            "unit": "sqft"
        }
    },
    "photos": [
        "https://photos.zillowstatic.com/fp/01ae778a92392c6dcf1a5755615b23d2-rentals_large_1200_1200.webp",
        "https://photos.zillowstatic.com/fp/13d0177a4fd770a9a90b1d20ad48b956-rentals_large_1200_1200.webp",
        "https://photos.zillowstatic.com/fp/dcf39697d78ddb4a79ff9216dbc4d118-rentals_large_1200_1200.webp",
        "https://photos.zillowstatic.com/fp/bca149b4269cad871060de0a77f6be4b-rentals_large_1200_1200.webp",
        "https://photos.zillowstatic.com/fp/6fb9b6893b7e18209f85a76b809bef0b-rentals_large_1200_1200.webp"
    ],
    "amenities": [
        "Club House",
        "Covered Parking",
        "Detached Garage",
        "Dishwasher",
        "Dual-Pane Glass",
        "Elevator",
        "Fitness Center",
        "Fully Equipped Kitchen",
        "Garage",
        "Garbage Disposal",
        "High-speed Internet Ready",
        "Indoor Corridor",
        "Laundry: Shared",
        "Microwave Oven",
        "Off Street Parking",
        "On-Site Maintenance",
        "Security: Gated Entry"
    ],
    "facts": {
        "Monthly fee": "$75/mo",
        "Sunday": "9:00 AM to 6:00 PM",
        "Monday": "9:00 AM to 6:00 PM",
        "Tuesday": "9:00 AM to 6:00 PM",
        "Wednesday": "9:00 AM to 6:00 PM",
        "Thursday": "9:00 AM to 6:00 PM",
        "Friday": "9:00 AM to 6:00 PM",
        "Saturday": "9:00 AM to 6:00 PM",
        "Monthly rent & fees": "$4,073.5",
        "One-time fees": "$1,055 - $1,305",
        "bedroomsDisplay": "Studio–2 bd",
        "bathroomsDisplay": "1 ba",
        "rentDisplay": "$4,074 - $6,318/mo"
    },
    "missingFields": [
        "agent"
    ],
    "scrapedAt": "2026-09-10T13:09:47.987Z",
    "dataOrigin": "live-page"
}

Local development

Run this folder as its own Actor:

$apify run --input-file storage/key_value_stores/default/INPUT.json

Validate the Actor contract and stored live records:

apify validate-schema
node dataset-validator.js

Access and compliance

If the source portal returns a challenge or access denial, the Actor records diagnostics and omits that page rather than fabricating output. Use only public pages and an authorized purpose. Proxy access can incur account costs and does not authorize bypassing CAPTCHA, authentication, robots directives, or other access controls.

Output files

• .actor: Actor metadata and schemas.
• src: This portal's standalone adapter and shared extraction runtime.
• storage/datasets/default: Apify-style local result records.
• storage/key_value_stores/default/RUN_SUMMARY.json: run result and diagnostics summary.
• output/dataset.json and output/dataset.jsonl: exported live-only result files.