Pricing

Pay per usage

Go to Store

Extended GPT Scraper

Try for free

drobnikj/extended-gpt-scraper

Developed by

Jakub Drobník

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

4.6 (4)

Pricing

Pay per usage

Monthly users

Runs succeeded

98%

Response time

1.4 days

Last modified

3 months ago

AI Lead generation Open source

Back to issues Create new issue

Inquiry Regarding Extended GPT Scraper for Shein Data Extraction

Closed

tarek_eljazeri opened this issue

Hello,

I hope this message finds you well. I am interested in utilizing your Extended GPT Scraper for a project involving data extraction from the Shein website. Before proceeding, I have a few inquiries that I hope you can assist me with:

Could you please confirm if your Extended GPT Scraper is capable of extracting product data from Shein, including attributes such as color, price, size variations, and images?

What is the recommended approach for configuring the scraper to collect data from Shein efficiently? Are there any specific settings or parameters that I should be aware of?

Is it possible to customize the scraper to extract additional data fields beyond the default ones provided? If so, what is the process for implementing these customizations?

Are there any limitations or known issues when using the Extended GPT Scraper with Shein or similar e-commerce websites? How can I mitigate these challenges effectively?

Lastly, could you provide any guidance or best practices for ensuring the accuracy and reliability of the extracted data?

I would greatly appreciate your insights and assistance in addressing these inquiries. Thank you for your time and support.

Best regards, Tarek

Lukáš Průša (lukas.prusa)

Hi Tarek, thanks for raising your questions!

Yes, the scraper is capable of extracting Shein's website with all data attributes, it's just a matter of configuration.

All you basically have to worry about are the Page processing settings, which control what is sent to GPT for processing. Each GPT model has its context window, in which you want to fit the page content, often users run out of context and data from the page is cut off. Please ensure you are using a model with a big enough context window. Other than this, you will mostly just need to properly prompt engineer the GPT to extract what you want.

I don't know what your data processing pipeline looks like, but I assume you want JSON output. You can do that under JSON formatted output settings.

I hope this helps, thanks!

Add comment

Pricing

Pricing model

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.

GPT Scraper

drobnikj/gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Jakub Drobník

5.7k

4.4

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

42.9k

4.6

RAG Web Browser

apify/rag-web-browser

Web browser for OpenAI Assistants, RAG pipelines, or AI agents, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages from the results, and returns their cleaned content as Markdown for further processing by an LLM. It can also scrape individual URLs. Supports MCP.

Apify

1.4k

4.4

Google Maps Scraper

compass/crawler-google-places

Extract data from thousands of Google Maps locations and businesses. Get Google Maps data including reviews, reviewer details, images, contact info, opening hours, location, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

90.8k

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

84k

Twitter (X.com) Scraper Unlimited: No Rate-Limits

apidojo/twitter-scraper-lite

Introducing Twitter Scraper Unlimited, the most comprehensive Twitter data extraction solution available. Our enterprise-grade scraper offers unmatched capabilities with a transparent event-based pricing model, making it perfect for both small-scale and large-scale data extraction needs.

API Dojo

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

20.1k