No credit card required

Extended GPT Scraper

drobnikj/extended-gpt-scraper

No credit card required

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Back to issues Create new issue

GPT-4 Rate Limits means inputs skipped

Closed

sherbetshop opened this issue

OpenAI API error, retrying... {"error":"Rate limit reached for 10KTPM-200RPM in organization org-AueTj3tEf877l7dLkxHbO0UA on tokens per min. Limit: 10000 / min. Please try again in 6ms. Contact us through our help center at help.openai.com if you continue to have issues.","attempt":2}

due to GPT-4 rate limits like above, entries will be skipped after multiple attempts due to still being rate limited. for GPT-4 need an option to basically run slower.

Jakub Drobník (drobnikj)

Hey there,

you can try to decrease, the memory limit of the actor run from 8192 to 4096 in the actor's input under Options. Then actor will run slower as it will be throttled by the memory limit. You can also ask OpenAI to increase the limits or run the scraper for one URL with some delay.

I hope it helps.

sherbetshop

Thanks!

Add comment

Developer

Jakub Drobník

Actor metrics

83 monthly users
21 stars
98.8% runs succeeded
1.4 days response time
Created in Jun 2023
Modified 2 months ago

Categories

Lead generation

Developer tools

Twitter Tweets and Profiles Scraper

web.harvester/twitter-scraper

Easily search and extract tweets from profiles or directly using a URL with our tool. Scrape tweets and replies effortlessly. Download data in formats like JSON, CSV, XML, RSS, or HTML Table, perfect for integration with various applications, databases, and social media analytics tools.

Web Harvester

1.2k

Easy Twitter Search Scraper

web.harvester/easy-twitter-search-scraper

Easily Scrape tweets with our Twitter Search Scraper. Export data in formats like JSON and Excel perfect for integration with various applications, databases, and data analysis tools.

Web Harvester

2.2k

GPT Scraper

drobnikj/gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Jakub Drobník

4.7k

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

17.6k

317

WCC Pinecone Integration

tri_angle/wcc-pinecone-integration

Crawl any website and store its content in your Pinecone vector database. Enhance the accuracy and reliability of your own AI Assistant with facts fetched from external sources or connect this integration to our Pinecone GPT Chatbot assistant available in Apify Store.