Pay $9.00 for 1,000 pages

GPT Scraper

drobnikj/gpt-scraper

Pay $9.00 for 1,000 pages

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Do you want to learn more about this Actor?

Get a demo

Back to issues Create new issue

Incomplete results

Closed

enchanting_wilderness opened this issue

This actor is exactly what I need, but the results I get seems to incomplete. I have a free account, but I doubt this influences the result. My use-case is very simple. I want a list of all casino's mentioned on a website, but it seems to list only a small number, maximum 3 in one case and maximum 10 in another.

Pavlína Vencovská (paja)

Hi,

thanks for reaching out, we'll look into it and let you know what can be done.

enchanting_wilderness

I hope to hear about it soon @pavlina.

Lukáš Průša (lukas.prusa)

Hi Jasper,

the website you are trying to scrape is very large and can't fully fit into the GPT context window, as indicated by the warn log messages "Content was truncated for...".

There are two options to resolve this:

the easier option is to use the Extended GPT Scraper with your own API key. You can select a model with a larger context window and fit the whole web page into it (e.g. gpt-4-turbo-preview).
use our page processing filters to decrease the page content being sent to GPT. This is a more advanced way and requires knowledge of CSS and HTML selectors.
- Selecting the newly added removeLinkUrls option and adding img to removeElementsCssSelector should help you get more results, though probably still not all of them...

I hope this helps, happy scraping!

enchanting_wilderness

Thanks Lukáš, this helps a lot!

Add comment

Developer

Jakub Drobník

Actor Metrics

135 monthly users
72 stars
>99% runs succeeded
Created in Mar 2023
Modified 24 days ago

Categories

Lead generation

Other

Extended GPT Scraper

drobnikj/extended-gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Jakub Drobník

1.2k

Free GPTs Scraper

seadapp/free-gpts-scraper

Gets you GPT data from Openai. Download your data as JSON, HTML Table, CSV, Execl, RSS Feed

Seadapp

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

29.8k

775

Get ChatGPT GPT info

manageable_yager/get-chatgpt-gpt-info

Scrape public information about a GPT in the ChatGPT store using it's link.

GPTEEZY Official

Linkedin x GPT prompt

anchor/linkedin-gpt-prompt

Extract LinkedIn profiles, and uses ChatGPT magic automatically on each profile ! Your prompt, the answer you need, the way you want.

Anchor

WCC Pinecone Integration

tri_angle/wcc-pinecone-integration

Crawl any website and store its content in your Pinecone vector database. Enhance the accuracy and reliability of your own AI Assistant with facts fetched from external sources or connect this integration to our Pinecone GPT Chatbot assistant available in Apify Store.

Tri⟁angle

📩📍 Google Maps Email Extractor

lukaskrivka/google-maps-with-contact-details

Extract Google Maps contact details. Scrape websites of Google Maps places for contact details and get email addresses, website, location, address, zipcode, phone number, social media links. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Lukáš Křivka

9.4k

259

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

16.1k

223

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

64k

657