Extended GPT Scraper avatar
Extended GPT Scraper
Try for free

No credit card required

View all Actors
Extended GPT Scraper

Extended GPT Scraper

drobnikj/extended-gpt-scraper
Try for free

No credit card required

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

User avatar

GPT-4 Rate Limits means inputs skipped

Closed

sherbetshop opened this issue
a year ago

OpenAI API error, retrying... {"error":"Rate limit reached for 10KTPM-200RPM in organization org-AueTj3tEf877l7dLkxHbO0UA on tokens per min. Limit: 10000 / min. Please try again in 6ms. Contact us through our help center at help.openai.com if you continue to have issues.","attempt":2}

due to GPT-4 rate limits like above, entries will be skipped after multiple attempts due to still being rate limited. for GPT-4 need an option to basically run slower.

User avatar

Hey there,

you can try to decrease, the memory limit of the actor run from 8192 to 4096 in the actor's input under Options. Then actor will run slower as it will be throttled by the memory limit. You can also ask OpenAI to increase the limits or run the scraper for one URL with some delay.

I hope it helps.

User avatar

sherbetshop

10 months ago

Thanks!

Developer
Maintained by Apify
Actor metrics
  • 79 monthly users
  • 93.2% runs succeeded
  • 1.9 days response time
  • Created in Jun 2023
  • Modified 6 days ago