No credit card required

Extended GPT Scraper

drobnikj/extended-gpt-scraper

No credit card required

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Back to issues Create new issue

Not able to scrape with a scraper?

Closed

maroon_herb opened this issue

So, I have a GPT-4 key and using it I get this result: Apologies, but as of the current AI model's capabilities, it is unable to visit and analyze websites or extract data dynamically from them just yet. However, I can help with translating, structuring, and categorizing data that you already have. The model also does not support the Swedish language fluently at the moment. For direct from website extraction, it is recommended to use a custom script or an online service focused on web scraping.

Using the exact same input with source and instructions for "GPT Scraper" works, but I would like to be able to use my own API-key and upgrade to GPT-4.

Jakub Drobník (drobnikj)

Hey Markus,

it looks that the model has a problem that you put as start URLs the link to your remote file with links you want to scrape. You need to Link remote text file as start URLs, than scraper will scraper each page and run prompt on them.

Have a nice day!

Add comment

Developer

Jakub Drobník

Actor metrics

83 monthly users
21 stars
98.8% runs succeeded
1.4 days response time
Created in Jun 2023
Modified 2 months ago

Categories

Lead generation

Developer tools

Twitter Tweets and Profiles Scraper

web.harvester/twitter-scraper

Easily search and extract tweets from profiles or directly using a URL with our tool. Scrape tweets and replies effortlessly. Download data in formats like JSON, CSV, XML, RSS, or HTML Table, perfect for integration with various applications, databases, and social media analytics tools.

Web Harvester

1.2k

Easy Twitter Search Scraper

web.harvester/easy-twitter-search-scraper

Easily Scrape tweets with our Twitter Search Scraper. Export data in formats like JSON and Excel perfect for integration with various applications, databases, and data analysis tools.

Web Harvester

2.2k

GPT Scraper

drobnikj/gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Jakub Drobník

4.7k

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

17.6k

317

WCC Pinecone Integration

tri_angle/wcc-pinecone-integration

Crawl any website and store its content in your Pinecone vector database. Enhance the accuracy and reliability of your own AI Assistant with facts fetched from external sources or connect this integration to our Pinecone GPT Chatbot assistant available in Apify Store.