Baitoru Jobs Scraper

Overview

Access Baitoru (バイトル), one of Japan's most popular job platforms for part-time, temporary, and full-time positions. This actor automates the extraction of job listings including compensation details, work schedules, and employer information from the Japanese employment market.

Features

• Part-time (アルバイト) and full-time (正社員) job extraction
• Japanese location and station-based filtering
• Hourly and monthly wage data capture
• Work schedule and shift information
• Proxy rotation with automatic fallback (residential → datacenter)
• CAPTCHA detection and session rotation
• Automatic retry on failures with exponential backoff
• Deduplication of results by application URL
• Dataset validation with auto-fix capability

Output Format

Each scraped listing produces a JSON object with these fields:

{
	"job_id": "採コボ 26051W20★15",
	"job_url": "https://s.baitoru.com/DW0aO4vE",
	"employment_type": "正社員",
	"bonus": "10,000円",
	"company_name": "株式会社ＣＡＰサービス",
	"job_title": "【簡単もくもく作業】内勤受付事務",
	"location": "東京都渋谷区 / 渋谷駅",
	"job_category": [
		"データ入力",
		"タイピング(PC・パソコン・インターネット)",
		"企画・マーケティング",
		"法人営業"
	],
	"salary": "月給22.6万円〜",
	"working_hours": "09:00〜18:00",
	"tags": [
		"シフト相談",
		"短期",
		"未経験OK",
		"主婦(夫)",
		"交通費有"
	],
	"age_group": [
		"20代",
		"30代",
		"40代"
	],
	"gender_ratio": {
		"male": "low",
		"female": "high"
	},
	"work_style": "一人で → 大勢で",
	"workplace_environment": "しずか → にぎやか",
	"image_url": "https://image-cdn.baitoru.com/images_job_BS/557100/2604W20.jpg",
	"apply_url": "https://www.baitoru.com/entry/form/job159697098"
}

Proxy Handling

The scraper uses intelligent proxy selection to maintain consistent access.

1. Apify Residential Proxy (country-targeted) — First choice for Baitoru
2. Apify Residential Proxy (any region) — Fallback if country proxy unavailable
3. Apify Datacenter Proxy — Secondary fallback for cost efficiency
4. Direct Connection — Last resort when all proxies fail

Proxies auto-rotate on each request. Blocked sessions are discarded and replaced automatically.

Retry Logic

Robust retry mechanics recover from network errors and temporary blocks.

• Maximum 5 retries per request
• Fresh browser session on each retry
• Automatic proxy rotation between attempts
• Blocked status codes (401, 403, 429) trigger session refresh
• Configurable request timeout (120 seconds)

Anti-block Handling

The scraper simulates genuine browsing patterns to avoid triggering protections.

• navigator.webdriver property masked
• Human-like delays between page interactions (2–5 seconds)
• Browser language and plugin fingerprints normalised
• Session pool with automatic rotation on blocks
• CAPTCHA detection with graceful retry
• Rate limit detection (HTTP 429) with backoff

Sample Input

{
    "keyword": "data analyst",
    "location": "東京",
    "maxItems": 25,
    "proxyEnabled": true,
    "sortBy": "date",
    "remoteOnly": false
}

Sample Output

{
	"job_id": "採コボ 26051W20★15",
	"job_url": "https://s.baitoru.com/DW0aO4vE",
	"employment_type": "正社員",
	"bonus": "10,000円",
	"company_name": "株式会社ＣＡＰサービス",
	"job_title": "【簡単もくもく作業】内勤受付事務",
	"location": "東京都渋谷区 / 渋谷駅",
	"job_category": [
		"データ入力",
		"タイピング(PC・パソコン・インターネット)",
		"企画・マーケティング",
		"法人営業"
	],
	"salary": "月給22.6万円〜",
	"working_hours": "09:00〜18:00",
	"tags": [
		"シフト相談",
		"短期",
		"未経験OK",
		"主婦(夫)",
		"交通費有"
	],
	"age_group": [
		"20代",
		"30代",
		"40代"
	],
	"gender_ratio": {
		"male": "low",
		"female": "high"
	},
	"work_style": "一人で → 大勢で",
	"workplace_environment": "しずか → にぎやか",
	"image_url": "https://image-cdn.baitoru.com/images_job_BS/557100/2604W20.jpg",
	"apply_url": "https://www.baitoru.com/entry/form/job159697098"
}

Usage

Local Development

# Install dependencies
npm install

# Set Apify token (required for proxy)
export APIFY_TOKEN=your_token_here

# Run the actor
npm start

# Validate scraped data
node dataset-validator.js

Apify Platform

# Login to Apify
apify login

# Push actor to platform
apify push

# Run from Apify Console or API

Deployment

1. Ensure all dependencies are installed: npm install
2. Authenticate with Apify: apify login
3. Deploy the actor: apify push
4. Configure input in the Apify Console
5. Schedule runs or trigger via API / webhooks

Limitations

• Results depend on the portal's current HTML structure; layout changes may require selector updates
• Some job details (salary, benefits) may not be available for all listings
• Rate limiting by the portal may reduce throughput during high-volume scrapes
• CAPTCHA challenges may interrupt scraping on heavily protected pages
• Baitoru may modify their anti-bot measures, requiring periodic updates
• Maximum items per run is capped at 1000 to prevent excessive resource usage
• Proxy costs apply when using Apify residential or datacenter proxies