No credit card required

Extended GPT Scraper

drobnikj/extended-gpt-scraper

No credit card required

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Do you want to learn more about this Actor?

Get a demo

Back to issues Create new issue

Getting invalig cookie error

Closed

Becc_ai opened this issue

Still getting error related to the cookie. The cookie was just pulled from the chrome extenstion Cookie-Editor and pasted in the initial cookie field.

I tried to follow the instruction from that field, but the link to the 'editthiscookie' wasnt working.

Any advice on how to set the cookie correctly for use on facebook?

Lukáš Průša (lukas.prusa)

Oh, yeah, just make sure to change the sameSite cookie field from no_restriction to None :) Make sure to follow this type for the cookies: https://github.com/apify/crawlee/blob/e249406ff09cf5ec3786794dace6d032dde48f0d/packages/types/src/browser.ts#L3

I hope this helps, thanks!

Becc_ai

I changed it to "None", but then the cookie didn't work at all. The scraper couldn't access the fb group of the cookies account. Is there an alternative way to get a fb cookie or alternative way to scraper private fb groups?

Lukáš Průša (lukas.prusa)

Hmm, it's weird that it didn't work... I'm not experienced with FB much, so I don't know whether these cookies are enough, but the scraper should be using them as set. Do these cookies alone work when you try them out in a new browser?

There is some community developed Actor in the store that seems to have cookies as an input option: https://console.apify.com/actors/LbOjFS8sWIy3wl0ak/input. Our Apify scrapers don't have cookies on input for "specific website scrapers", as that's usually against their TOSs.

Becc_ai

The cookie itself did work indeed. Also in other actors. Unfortunately those actors didn't fit my use case.

Let me know if there is any update related to this use case.

Lukáš Průša (lukas.prusa)

Hmm, weird that it didn't work here, it's just passing the cookie down to the crawling. I've tested it again on https://setcookie.net and it did work as expected.

Well, if we find any bugs related to this, then I will let you know here. Thanks and happy scraping!

Add comment

Developer

Jakub Drobník

Actor Metrics

78 monthly users
46 stars
>99% runs succeeded
5.8 days response time
Created in Jun 2023
Modified 6 days ago

Categories

Lead generation

Developer tools

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

26.9k

663

Google Maps Extractor

compass/google-maps-extractor

Extract data from hundreds of places fast. Scrape Google Maps by keyword, category, location, URLs & other filters. Get addresses, contact info, opening hours, popular times, prices, menus & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

18k

357

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

59.3k

507

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

15k

191

Contact Details Scraper

vdrmota/contact-info-scraper

Free email extractor to extract and download emails, phone numbers, Facebook, Twitter, LinkedIn, and Instagram profiles from any website. Extract contact information at scale from lists of URLs and download the data as Excel, CSV, JSON, HTML, and XML.

Vojta Drmota

24.7k

195

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

5.6k

Google Maps Scraper

compass/crawler-google-places

Extract data from hundreds of Google Maps locations and businesses. Get Google Maps data including reviews, images, contact info, opening hours, location, popular times, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

79k

568

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

71.6k

226

Facebook Groups Scraper

apify/facebook-groups-scraper

Extract data from one or multiple public Facebook groups. Get group and post URLs, post text, comments, timestamp, likes and comments count, and basic commentator info. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

7.2k