Scrape Yandex search results - organic listings, ads, entity cards, AI answers. 13 languages: Russian, Turkish, German, French & more. Pay-per-result from $0.004. JSON output for SEO, rank tracking & market research. Парсер Яндекса с органикой, рекламой и ИИ-ответами.
Breakthrough: Eliminated captchas on pagination requests.
Discovered by capturing Yandex app traffic (Caido): the app's "load more" button sends AJAX requests with primary_reqid linking back to the original search. Yandex's anti-bot treats these as legitimate continuations, not independent bot requests.
Implementation: Page 0 fetches HTML (gets reqid), pages 1+ fire parallel AJAX with primary_reqid + ajax={"main__more":{"endless":1}}. Response is JSON containing HTML in main__more.html.
Also: resolved all relative URLs to absolute, removed scrape_metadata from output, raised maxPages from 20 to 100.
2026-02-16 — Actor Implementation Complete
Full Apify actor with rnet + SafariIos18_1_1, parallel pagination, SERP parser (organic, ads, entity cards, neuro answers, favicons, ratings, sitelinks), PPE charging, multi-language support (en/ru/de/fr/tr), region targeting.
2026-02-15 — Research Phase
Reverse-engineered Yandex Search, Maps, Translate, Suggest, Music, and Favicon APIs from APK static analysis + live traffic. Identified Safari iOS TLS as the only viable fingerprint for search. Benchmarked proxy geo (DE best). Documented all findings in docs/.