Indeed Scraper avatar

Indeed Scraper

Try for free

Pay $5.00 for 1,000 results

View all Actors
Indeed Scraper

Indeed Scraper

misceres/indeed-scraper
Try for free

Pay $5.00 for 1,000 results

Scrape jobs posted on Indeed. Get detailed information from this job portal about saved and sponsored jobs. Specify the search based on location with the output attributes position, location, and description.

Do you want to learn more about this Actor?

Get a demo
CL

OOM (out of memory)

Closed

chartreuse_lilac opened this issue
4 months ago

I get the following issue: "The Actor hit an OOM (out of memory) condition. You can resurrect it with more memory to continue where you left off."

I have resurrected multiple times with the highest memory but continue to fail after a few hundred scrapes.

The issue is not isolated to a single run but on every run.

CL

chartreuse_lilac

4 months ago

Following up, I've resurrected it and noticed that the run time is X5 slower. These issues are only on runs with the recent 0.0.49 build.

See the following run IDs: 2D1fYsxPRTHO9WQtS e2eOM7m28qT68zE8u

MI

amitchoudhary

4 months ago

Facing the same issue, increased run time with consistent OOM issues coming up.

lukaskrivka avatar

Hello,

Thanks a lot for the report. The devs are actively looking into the problem. For now, they increased the max memory to 4 GB which should help. We will update you about the progress.

lukaskrivka avatar

Hello again,

The source of the issue is having "followApplyRedirects": true in input. If you don't need it, please remove it and it will run smoothly. The devs are working on a fix for that option.

lukas.prusa avatar

Hi all, we've fixed the issue that was causing the memory to go up indefinitely :)

However, we are still keeping the max memory to 4 GB for now, because the memory usage is still pretty high. If you encounter any more issues, please let us know.

Thanks and happy scraping!

Developer
Maintained by Apify

Actor Metrics

  • 816 monthly users

  • 118 stars

  • >99% runs succeeded

  • 2.1 days response time

  • Created in Mar 2023

  • Modified a day ago

Categories