Pay $9.00 for 1,000 pages

GPT Scraper

drobnikj/gpt-scraper

Pay $9.00 for 1,000 pages

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Do you want to learn more about this Actor?

Get a demo

Back to issues Create new issue

Incomplete results

Closed

enchanting_wilderness opened this issue

This actor is exactly what I need, but the results I get seems to incomplete. I have a free account, but I doubt this influences the result. My use-case is very simple. I want a list of all casino's mentioned on a website, but it seems to list only a small number, maximum 3 in one case and maximum 10 in another.

Pavlína Vencovská (paja)

Hi,

thanks for reaching out, we'll look into it and let you know what can be done.

enchanting_wilderness

I hope to hear about it soon @pavlina.

Lukáš Průša (lukas.prusa)

Hi Jasper,

the website you are trying to scrape is very large and can't fully fit into the GPT context window, as indicated by the warn log messages "Content was truncated for...".

There are two options to resolve this:

the easier option is to use the Extended GPT Scraper with your own API key. You can select a model with a larger context window and fit the whole web page into it (e.g. gpt-4-turbo-preview).
use our page processing filters to decrease the page content being sent to GPT. This is a more advanced way and requires knowledge of CSS and HTML selectors.
- Selecting the newly added removeLinkUrls option and adding img to removeElementsCssSelector should help you get more results, though probably still not all of them...

I hope this helps, happy scraping!

enchanting_wilderness

Thanks Lukáš, this helps a lot!

Add comment

Developer

Jakub Drobník

Actor Metrics

155 monthly users
64 stars
>99% runs succeeded
2 days response time
Created in Mar 2023
Modified 4 days ago

Categories

Lead generation

Other

Extended GPT Scraper

drobnikj/extended-gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Jakub Drobník

1.2k

Free GPTs Scraper

seadapp/free-gpts-scraper

Gets you GPT data from Openai. Download your data as JSON, HTML Table, CSV, Execl, RSS Feed

Seadapp

Twitter Tweets and Profiles Scraper

web.harvester/twitter-scraper

Easily search and extract tweets from profiles or directly using a URL with our tool. Scrape tweets and replies effortlessly. Download data in formats like JSON, CSV, XML, RSS, or HTML Table, perfect for integration with various applications, databases, and social media analytics tools.

Web Harvester

2.2k

Easy Twitter Search Scraper

web.harvester/easy-twitter-search-scraper

Easily Scrape tweets with our Twitter Search Scraper. Export data in formats like JSON and Excel perfect for integration with various applications, databases, and data analysis tools.

Web Harvester

3.4k

Get ChatGPT GPT info

manageable_yager/get-chatgpt-gpt-info

Scrape public information about a GPT in the ChatGPT store using it's link.

GPTEEZY Official

Indeed job scraper

curious_coder/indeed-scraper

This is an actively maintained scraper which can extract job postings and hiring company details at scale from any indeed search results page for a fixed monthly rental price. Well documented with examples and demos

Curious Coder

722

Text Scraper (Free)

karamelo/text-scraper-free

Website Text Extractor. Extract Text from Webpages and Feed Your LLMs

karamelo

117

Pinecone GPT Chatbot

tri_angle/pinecone-gpt-chatbot

Pinecone GPT Chatbot combines OpenAI's GPT models with Pinecone's database to generate insightful responses. Its interactive chatbot interface presents precise and comprehensive answers to user queries. Benefit from semantic understanding, efficient workflows, and enriched knowledge integration!

Tri⟁angle

LinkedIn People Profile Scraper

pratikdani/linkedin-people-profile-scraper

Retrieve LinkedIn profile URLs and extract comprehensive profile details. This includes basic information, employment history, skills, company information, biography, location, and more.

Pratik Dani

225

Youtube Channel Scraper

powerful_bachelor/Youtube-Channel-Scraper

The YouTube Channel Scraper is a powerful tool for extracting detailed info from YT channels. It retrieves video count 📹, subscribers count 📊, description 📝, verification status ✅, keywords 🏷️, tags 🔖, view count 👁️, and social media links 🔗. Ideal for researchers, marketers, and creators!!