1 day trial then $25.00/month - No credit card required now

Github Search Scraper

saswave/github-search-scraper

Try for free

1 day trial then $25.00/month - No credit card required now

Github search scraper. Get all data from search results list

Developer

SASWAVE

Actor Metrics

6 monthly users
No reviews yet
4 bookmarks
>99% runs succeeded
20 hours response time
Created in Mar 2024
Modified 4 months ago

Categories

Back to issues Create new issue

Fails on page 10 every time

Closed

aleksandrmoshkov opened this issue

Please see the actor run. I made a resurrect attempt, but it fails at the same page.

SASWAVE (saswave)

We are looking into it, probably anti bot protections

aleksandrmoshkov

I successfully added my cookies, which improved the process, but there were still some errors. In the end, I managed to run 100 pages. I think it would be helpful to include a line in the README stating that the antibot sometimes fails and that it's better to add a cookie.

SASWAVE (saswave)

We found the issue, nothing related to anti bot protections:

When not providing cookies, github sometimes returns 429 responses to slow the requests made to the server

Initially, we ask cookies only if you need to search a url with type=code (mandatory for the extraction to work)

Now you should be able to handle the 100 pages without cookies

Add comment

Zillow Search Scraper

maxcopell/zillow-scraper

Extract data about properties for sale and rent on Zillow using the Zillow API, but with no daily call limits. Scrape millions of listings and download your data as HTML, JSON, CSV, Excel, XML. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Maximillian Copelli

1.4k

4.1/5

Facebook Search Scraper

apify/facebook-search-scraper

Extract Facebook pages search data from pages that match your search query. Get page URL, address, email, website, check-ins, creation date, ad status, category, follower count, messenger link. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Apify

417

4.5/5

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, AI overviews, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export scraped data, run the scraper via API, schedule runs, or integrate with other tools.

Apify

55.1k

4.7/5

Facebook Groups Scraper

apify/facebook-groups-scraper

Extract data from one or multiple public Facebook groups. Get group and post URLs, post text, comments, timestamp, likes and comments count, and basic commentator info. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

8.8k

4.8/5

Zillow Detail Scraper

maxcopell/zillow-detail-scraper

Get details of Zillow properties from URLs. This Actor can be easily integrated with other Zillow Scrapers.

Maximillian Copelli

1.2k

4.3/5

Facebook Pages Scraper

apify/facebook-pages-scraper

Facebook scraping tool to crawl and extract basic data from one or multiple Facebook Pages. Extract Facebook page name, page URL address, category, likes, check-ins, and other public data. Download data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

21.3k

4.6/5

Facebook Photos Scraper

apify/facebook-photos-scraper

Extract data from one or multiple Facebook images. Get image ID, Facebook photo URL, image URL, OCR text, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

1.3k

4.8/5

Facebook page contact info Scraper

apify/facebook-page-contact-information

Get Facebook pages addresses, email, likes, website, check-ins, and phone information

Apify

2.7k

4.7/5

Fast Google Scraper

hooli/easy-google-scraper

Make collecting data from Google easy with Fast Google Scraper. Extract organic and paid Google search engine results pages, then download your data as HTML table, JSON, CSV, Excel, or XML.

Hooli

4.1k

4.7/5

Apollo.io leads scraper

curious_coder/apollo-io-scraper

Scrape leads from apollo io search results including verified emails and phone numbers. This apollo io data scraping bot helps you to extract leads from your apollo search results without subscribing to costly apollo pricing plans