Gelbe Seiten Apify Scraper

An Apify Actor that accepts a Gelbe Seiten results URL, loads all result batches through the site's public /ajaxsuche loader, visits each public profile page, deduplicates by profile URL, and pushes structured rows to the default Apify Dataset.

Input

{
  "searchKeyword": "Zahnarzt",
  "searchLocation": "Bonn",
  "maxResults": -1,
  "requestDelay": 0.15
}

The Actor automatically converts searchKeyword and searchLocation into a Gelbe Seiten results URL. maxResults controls the number of unique listings returned. Set it to a positive integer such as 25 for a capped run, or set it to -1 to collect all available results. requestDelay is the pause between pagination and detail-page requests; the default 0.15 seconds provides basic throttling and can be increased if the target site responds slowly or rate-limits requests.

Local run

Install the Apify CLI, then run:

apify actor:push
apify call --input='{"searchKeyword":"Zahnarzt","searchLocation":"Bonn","maxResults":25}'

Or run the Python entrypoint directly after installing dependencies:

python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
python actor.py

For a direct local Actor run with Apify storage emulation:

$apify run --input='{"searchKeyword":"Zahnarzt","searchLocation":"Bonn","maxResults":-1}'

Output

Each Dataset item contains listing fields plus public detail-page fields such as business name, category, address parts, phone, fax, email, website, rating, review count, opening hours, description, and profile URL. Missing fields remain empty. Detail-page failures are retained in detail_fetch_error without discarding the listing.

Notes

• The scraper is intended for public Gelbe Seiten results URLs.
• Gelbe Seiten currently exposes additional results through a POST request to /ajaxsuche; the Actor repeats that request until no more rows are returned.
• The Apify SDK is pinned to the tested v4 line so it stays compatible with the Crawlee/Pydantic dependencies in the Actor image.
• Respect the target site's terms, robots guidance, and request limits. Increase requestDelay if the site responds slowly or begins rate-limiting.