HiPages AU Business Scraper

Scrapes business listings from HiPages AU. Extract comprehensive business information including contact details, ratings, reviews, and images.

Features

Core Capabilities

• Comprehensive Data Extraction: Business names, contact info, ratings, reviews, images, and more
• Flexible Filtering: Search by category, state, and suburb across 100+ service categories
• Pagination Support: Automatically handles pagination to fetch all results
• Detailed Scraping: Optional deep scraping for full business profiles with ABN, member since, services, and complete recommendation history
• Proxy Support: Built-in proxy configuration for reliable, undetected scraping

Perfect for Lead Generation

• Direct Contact Information: Extract phone numbers and mobile numbers for immediate outreach
• Qualified Leads: Filter by ratings, total hired count, and recommendations to find high-quality businesses
• Service Area Targeting: Identify businesses serving specific suburbs and regions
• Verification Data: ABN and license information for lead validation
• Engagement Metrics: Star ratings, total recommendations, and hire counts to prioritize leads

AI-Ready Data Structure

• Structured JSON Output: Clean, consistent data format perfect for AI processing and analysis
• Rich Context: Business descriptions, services, and customer reviews for AI understanding
• Sentiment Analysis Ready: Customer recommendations with full text for sentiment and quality analysis
• Searchable Metadata: Category, location, and service area data for AI-powered search and matching
• Training Data: Comprehensive business profiles ideal for training recommendation systems and chatbots

Input Parameters

Parameter	Type	Description	Default
category	string	Service category (e.g., 'excavation', 'electricians')	excavation
state	string	Australian state code (nsw, vic, qld, sa, wa, tas, nt, act)	vic
suburb	string	Suburb name (auto-converted to lowercase with underscores)	clayton
maxBusinesses	integer	Maximum businesses to scrape (1-1000)	100
pageLimit	integer	Results per request (1-10)	10
scrapeDetails	boolean	Enable detailed profile scraping (slower but comprehensive)	false
scrapeRecommendations	boolean	Scrape all customer recommendations (requires scrapeDetails)	false
proxy	object	Optional proxy configuration for reliable scraping	null

Output Format

Basic Business Data

Each business record includes:

{
  "businessId": "...",
  "name": "...",
  "title": "",
  "phone": "...",
  "mobile": "...",
  "serviceArea": "...",
  "highlights": ["Exceptional Customer Service", "Highly Referred"],
  "hasLicense": true,
  "hasValidAbn": true,
  "starRating": {
    "rating": 5.0,
    "totalHired": 49,
    "totalRatings": 27
  },
  "totalRecommendations": 28,
  "latestRecommendation": {
    "comment": "I would highly recommend this business...",
    "userName": "Kimberley"
  },
  "galleryImages": [...],
  "profilePageUrl": "...",
  "searchContext": {
    "category": "excavation",
    "state": "vic",
    "suburb": "clayton"
  }
}

Detailed Business Data (when scrapeDetails: true)

Additional fields in detailedInfo:

{
  "detailedInfo": {
    "businessName": "Full Business Name",
    "abn": "12345678901",
    "memberSince": "2020",
    "description": "Full business description...",
    "location": "Service area details",
    "services": ["Service 1", "Service 2", ...],
    "galleryImages": [...],
    "reviews": ["Review 1", "Review 2", ...],
    "recommendations": [
      {
        "author": "John D",
        "location": "Melbourne, VIC",
        "date": "15 Jan 2024",
        "comment": "Excellent service...",
        "verified": true,
        "hiredOnHipages": true
      }
    ],
    "totalRecommendations": 25
  }
}

Available Categories

100+ categories including:

• Air Conditioning
• Electricians
• Plumbers
• Painters
• Carpenters
• Builders
• Landscapers
• And many more...