Pay $9.00 for 1,000 pages

GPT Scraper

drobnikj/gpt-scraper

Pay $9.00 for 1,000 pages

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Back to issues Create new issue

Feature request: Different URL provided in dataset than on Input

Open

Pepa <b>J</b> (JoseJet) opened this issue

If we put URL on input,that gets redirected in the final dataset we will get only the "new" redirected URL. Therefore there is no way how we could match these results to the input.

Would it be possible to introduce additional attribute to dataset for inputURL that will use the value from Input?

Sviatozar Petrenko (svpetrenko)

Thanks for a suggestion! Yeah, it seems like an important feature - I've created a ticket and I'll notify you when it's done

Add comment

Developer

Jakub Drobník

Actor Metrics

144 monthly users
76 stars
>99% runs succeeded
1.6 days response time
Created in Mar 2023
Modified a month ago

Categories

Extended GPT Scraper

drobnikj/extended-gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Jakub Drobník

1.3k

Universal AI GPT Scraper

louisdeconinck/ai-gpt-scraper

Transform any website into structured data with AI-powered extraction. This versatile tool combines advanced web scraping with intelligent content analysis to deliver clean, customized JSON output - perfect for automating data collection from any web source.

Louis Deconinck

Indeed job scraper

curious_coder/indeed-scraper

This is an actively maintained scraper which can extract job postings and hiring company details at scale from any indeed search results page for a fixed monthly rental price. Well documented with examples and demos

Curious Coder

1.2k

LinkedIn People Profile Scraper

pratikdani/linkedin-people-profile-scraper

Retrieve LinkedIn profile URLs and extract comprehensive profile details. This includes basic information, employment history, skills, company information, biography, location, and more.

Pratik Dani

356

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

35.6k

991

Email ✉️ & Phone ☎️ Extractor

anchor/email-phone-extractor

Extract emails, phone numbers, and other contact information like Twitter, LinkedIn, Instagram... from websites you provide. Best for lead generation and data enrichment. Export data in structured formats and dominate your outreach game. Capture your leads almost for free, fast, and without limits.

Anchor

Linkedin x GPT prompt

anchor/linkedin-gpt-prompt

Extract LinkedIn profiles, and uses ChatGPT magic automatically on each profile ! Your prompt, the answer you need, the way you want.

Anchor

WCC Pinecone Integration

tri_angle/wcc-pinecone-integration

Crawl any website and store its content in your Pinecone vector database. Enhance the accuracy and reliability of your own AI Assistant with facts fetched from external sources or connect this integration to our Pinecone GPT Chatbot assistant available in Apify Store.

Tri⟁angle

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

72.6k

965