Yellow Pages avatar

Yellow Pages

Try for free

Pay $0.30 for 1,000 results

Go to Store
Yellow Pages

Yellow Pages

mcdowell/yellow-pages
Try for free

Pay $0.30 for 1,000 results

Scrape Yellow Pages for addresses, categories, names and phone numbers from listings

KI

Text file input failing

Closed

keeper-info opened this issue
a year ago

I tried using a list of input links from a txt file (attached) and the job fails to parse them, it appears

mcdowell avatar

I have issued an update that fixes this issue. Use the latest build to address the issue

KI

keeper-info

a year ago

Thank you! Now I'm being stopped by the maxRequestsPerCrawl setting. Is there a way to make that configurable? I'm not seeing an option in the config currently, but I don't necessarily want a limit, I'm fine with just limiting the job via execution time, and I imagine this wouldn't be that uncommon of a use case. I want to scrape a large list of specific URLs and get the top 30 results per URL, but it looks like this job is failing after it hits 31 results total.

Developer
Maintained by Community

Actor Metrics

  • 17 monthly users

  • 4 stars

  • 99% runs succeeded

  • 14 hours response time

  • Created in Dec 2022

  • Modified 4 months ago

Categories