Extended GPT Scraper avatar

Extended GPT Scraper

Try for free

No credit card required

View all Actors
Extended GPT Scraper

Extended GPT Scraper

drobnikj/extended-gpt-scraper
Try for free

No credit card required

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Do you want to learn more about this Actor?

Get a demo
CB

Some domains are disappearing from the results

Open

cooperative_bureau opened this issue
9 days ago

Hi I am uploading a list of domains to process, after the task completes I am only uploading results for a part of the domains and the rest are “lost”. Moreover, I load the unprocessed ones again with the next task and they are processed.

Here is an example with one domain that was not included in the report twice and the third time it was processed https://console.apify.com/actors/tasks/t12CcmeQfXMszMbIZ/runs/wtoXCHjOZ1aNSAbAq#output

Thanks!

CB

cooperative_bureau

9 days ago

Is it possible to receive in the results records about domains that could not be processed? Personally, it would solve my problem =)

CB

cooperative_bureau

9 days ago
CB

cooperative_bureau

9 days ago
CB

cooperative_bureau

9 days ago

If I now re-load these 182 failed domains into the job, half of them will be successfully processed.

CB

cooperative_bureau

9 days ago

That is 1600 domains I am processing for the third time and need at least one more time

lukas.prusa avatar

Hi, thanks for opening this issue!

Yes, I agree adding this would make sense :) From what I understand, two things here would improve this situation:

  • Increasing or allow changing the max request retries setting (currently it's just 3)
  • Outputting failed items to output

Both of these would make sense :) We will investigate and discuss it with the team. I will keep you updated here, thanks!

CB

cooperative_bureau

6 days ago

Lukáš, thank you. Then I'm not active for now, waiting for your message =)

Developer
Maintained by Apify
Actor metrics
  • 83 monthly users
  • 37 stars
  • 99.7% runs succeeded
  • 4 days response time
  • Created in Jun 2023
  • Modified 23 days ago