maxListings now has a ceiling per mode instead of one flat 400. With
Fetch full details on it stays at 400, since every listing costs a second
request to its expose page. With it off you can ask for up to 5,000, because
those rows already arrive in the search response and the old cap was charging
the cheap path for the expensive path's problem. Ask for more than the mode
allows and the run lowers it and says so in the log; the run-timeout guard is
unchanged and still delivers whatever was collected.
- README:
priceMin, sizeMin and withDetails were never mentioned on the
page. Every input is now in a table, with the ceiling rule spelled out.
- A long run no longer dies on the clock. With "Full details per listing" on
(the default) the actor opens one page per listing, and that loop had nothing
stopping it: if ImmobilienScout24 was slow, the run was killed by the platform
before it had pushed anything — losing the whole search. The actor now reads
the run's own timeout, reserves the end of it for delivery, and stops
enriching in time. Listings it did not get to open still ship with their
list-level fields, and everything collected is charged and pushed.
- Retries, their waiting time and each request's ceiling now shrink as the
deadline approaches, so one throttled request can no longer eat seven minutes
of a run that has three left.
- Every run now ends with a status message that says what actually happened: a
run stopped by the time limit says so and how to fix it, a monitor run with
nothing new says that (rather than looking empty), and "no listings match" is
only ever said after ImmobilienScout24 served a result list we read that was
genuinely empty. Runs used to finish with no message at all.
- Honest limit in the input form: Max listings now caps at 400 — what one run
actually delivers within the default one-hour run timeout with details on. It
advertised 2,000, which no default run could reach. Raise the run timeout for
bigger pulls.
ImmobilienScout24.de scraper for rentals and sales in any German city or
district. Returns each listing with price, living space, rooms, full address
with zip code, building and energy data, features and the advertising agent.
Filter by price, rooms and size. Includes a monitor mode that alerts on
only-new listings with an optional Slack digest.