Yellow Pages Australia Scraper

This actor scrapes business listings from Yellow Pages Australia based on search criteria like business type and location. It extracts comprehensive business data including contact details, address, operating hours, ratings, and more.

Features

• Search for businesses by type (e.g., "electrician", "plumber", "restaurant")
• Filter by location (e.g., "Melbourne, VIC", "Sydney, NSW")
• Set result limits and pagination
• Comprehensive proxy support (Apify Proxy or custom proxies)
• Transform output to include only fields you need
• Custom dataset naming and data storage options
• Automatic migration of old URL format
• Data extraction from DOM and JSON-LD structured data
• Deduplication of sponsored/organic listings

Proxy Support

The actor supports proxy configuration to avoid rate limiting and IP-based blocking:

Using Apify Proxy

The recommended option is to use Apify Proxy, which offers multiple IP addresses and country selection:

{
  "proxy": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"],
    "apifyProxyCountry": "AU"
  }
}

Using Custom Proxies

Alternatively, you can provide your own proxy URLs:

{
  "proxy": {
    "useApifyProxy": false,
    "proxyUrls": [
      "http://username:password@proxy1.example.com:8080",
      "http://username:password@proxy2.example.com:8080"
    ]
  }
}

Usage

Input Parameters

Parameter	Type	Description
searchUrl	String	Optional: Direct Yellow Pages search URL. Example: https://www.yellowpages.com.au/search?search_terms=plumber&geo_location_terms=Sydney. Old URL format (/search/listings?clue=...) is auto-migrated.
businessType	String	Type of business to search for (e.g., "electrician", "plumber")
location	String	Location to search in (e.g., "Melbourne, VIC", "Sydney, NSW")
limit	Integer	Maximum number of business listings to scrape (default: 30)
pageNumber	Integer	Page number to start scraping from (default: 1)
proxy	Object	Proxy configuration (see "Proxy Support" section)

Advanced Options

Parameter	Type	Description
dev_transform_fields	Array	Transform the output by selecting only specific fields. For nested objects use dot notation (e.g., "addressDetails.locality").
dev_dataset_name	String	Custom dataset name with placeholders: {ACTOR} = actor name, {DATE} = date (YYYYMMDD), {TIME} = time (HHMMSS). Use "default" to use Apify's default dataset.
dev_dataset_clear	Boolean	Clear the dataset before inserting new data

Output Format

The actor stores results in the default dataset with the following structure (for each business):

{
  "listingId": "580769029",
  "name": "Cherry Enterprises",
  "address": "31 Spring Street, Melbourne, VIC 3000",
  "phone": "(03) 9663 1143",
  "website": "https://www.example.com",
  "scrapedFromPage": 1,

  "primaryCategoryName": "Electrical Contractors",
  "categoryText": "Electrical Contractors, Electric Contractors-Commercial & Industrial",

  "detailsPageUrl": "https://www.yellowpages.com.au/melbourne-vic/bpp/cherry-enterprises-580769029",
  "logoUrl": "https://i2.ypcdn.com/ypau/images/default-thumbnail.jpg",

  "openingHoursToday": "OPEN until 5:30 pm",
  "openingHoursDetails": {
    "Mon - Fri": "8:00 am - 6:00 pm",
    "Sat": "9:00 am - 4:00 pm"
  },
  "openingHoursStructured": ["Mo-Fr 08:00-18:00", "Sa 09:00-16:00"],

  "rating": "4.5",
  "reviewCount": 12,

  "longDescription": "We provide exceptional service and workmanship...",
  "slogan": "Data Communications Service In Tullamarine & Surroundings",
  "isAd": false,
  "hasPhotos": true,
  "features": "website,reviews,phone,open-now",
  "yearsInBusiness": "36 Years",
  "yearsWithYellowPages": "9 Years",
  "servingArea": "Serving Melbourne, VIC",
  "listingType": "free",

  "addressDetails": {
    "streetAddress": "31 Spring Street",
    "locality": "Melbourne",
    "region": "VIC",
    "postalCode": "3000",
    "country": "AU"
  },
  "latitude": -37.869648,
  "longitude": 144.20999
}

Fields Notes

• slogan: Business tagline displayed on the listing (e.g., "Fast Reliable Service, Fixed Price Jobs")
• isAd: Whether the listing is a sponsored/paid advertisement
• hasPhotos: Whether the listing has uploaded gallery photos (vs default thumbnail)
• features: Comma-separated listing capabilities from analytics (e.g., "website,reviews,phone,open-now,preferred")
• yearsInBusiness: How long the business has operated (e.g., "36 Years")
• yearsWithYellowPages: How long listed on Yellow Pages (e.g., "9 Years")
• addressDetails: Structured address from JSON-LD data, available for listings with addresses
• latitude/longitude: Search location center point from JSON-LD Place data
• openingHoursStructured: ISO format opening hours from JSON-LD (e.g., "Mo-Fr 08:00-18:00")
• listingType: From analytics data (e.g., "free", "sub")

Output Destinations

1. Apify Platform Datasets

Default Dataset

When dev_dataset_name is set to "default" or left blank:

• Each business listing is stored as a separate item in the default dataset
• This is the recommended option for most users

Custom Named Datasets

When dev_dataset_name contains a custom value (e.g., "yellow-pages-{DATE}"):

• All business listings are pushed as a batch to this custom dataset

Field Transformation Examples

Basic Contact Information

["name", "phone", "website", "address"]

Location Data for Mapping

["name", "latitude", "longitude", "address", "primaryCategoryName"]

Detailed Business Info

["name", "phone", "address", "rating", "reviewCount", "openingHoursToday", "longDescription"]