Yellow Pages avatar
Yellow Pages
Try for free

7 days trial then $30.00/month - No credit card required now

View all Actors
Yellow Pages

Yellow Pages

mcdowell/yellow-pages
Try for free

7 days trial then $30.00/month - No credit card required now

Scrape Yellow Pages for addresses, categories, names and phone numbers from listings

User avatar

Text file input failing

Open

keeper-info opened this issue
6 months ago

I tried using a list of input links from a txt file (attached) and the job fails to parse them, it appears

User avatar

I have issued an update that fixes this issue. Use the latest build to address the issue

User avatar

keeper-info

6 months ago

Thank you! Now I'm being stopped by the maxRequestsPerCrawl setting. Is there a way to make that configurable? I'm not seeing an option in the config currently, but I don't necessarily want a limit, I'm fine with just limiting the job via execution time, and I imagine this wouldn't be that uncommon of a use case. I want to scrape a large list of specific URLs and get the top 30 results per URL, but it looks like this job is failing after it hits 31 results total.

Developer
Maintained by Community
Actor metrics
  • 25 monthly users
  • 95.7% runs succeeded
  • 0.0 days response time
  • Created in Dec 2022
  • Modified 6 months ago
Categories