Bayt Jobs Scraper 🌟
Pricing
$19.99/month + usage
Bayt Jobs Scraper 🌟
🎯 Extract detailed job listings from Bayt.com with comprehensive information including job titles, companies, locations, and descriptions. Perfect for job market analysis, recruitment research, and tracking employment opportunities in the Middle East.
0.0 (0)
Pricing
$19.99/month + usage
0
Total users
37
Monthly users
25
Runs succeeded
>99%
Issues response
12 days
Last modified
3 months ago
maxItems Setting Ignored & Infinite Scroll Loop in easyapi/bayt-jobs-scraper
Open
Summary:
The actor easyapi/bayt-jobs-scraper does not respect the maxItems parameter and fails to stop scrolling even when no new data is loaded. This leads to excessive data collection (16,000+ items) and likely duplicates due to infinite scroll loops.
Test Setup:
• Input URLs: 29 job category pages from Bayt (e.g., cyber-security-analyst-jobs, grc-consultant-jobs).
• maxItems: Set to 3,000.
• Expected: Stop globally at 3,000 unique jobs, ideally without duplicates.
Example That Worked Correctly:
• https://www.bayt.com/en/uae/jobs/iam-consultant-jobs/
• Finished after collecting 1 item.
• Scrolled 6 times, then stopped.
• Total request duration ~34s.
• https://www.bayt.com/en/uae/jobs/ciso-jobs/
• Collected 3 items.
• Stopped correctly.
Example That Entered Infinite Scroll Loop:
• https://www.bayt.com/en/uae/jobs/cyber-security-analyst-jobs/
• Scrolled over 224 times, collecting exactly 7 items per scroll.
• Saved over 1,500+ items from this page alone.
• Pattern like:
"Scrolling time...157
Saved 7 items
Scrolling time...158
Saved 7 items
..."
• No evidence of detecting content repetition or stopping when the end is reached.
