1 day trial then $25.00/month - No credit card required now

Github Search Scraper

saswave/github-search-scraper

Try for free

1 day trial then $25.00/month - No credit card required now

Github search scraper. Get all data from search results list

Back to issues Create new issue

Fails on page 10 every time

Closed

aleksandrmoshkov opened this issue

Please see the actor run. I made a resurrect attempt, but it fails at the same page.

SASWAVE (saswave)

We are looking into it, probably anti bot protections

aleksandrmoshkov

I successfully added my cookies, which improved the process, but there were still some errors. In the end, I managed to run 100 pages. I think it would be helpful to include a line in the README stating that the antibot sometimes fails and that it's better to add a cookie.

SASWAVE (saswave)

We found the issue, nothing related to anti bot protections:

When not providing cookies, github sometimes returns 429 responses to slow the requests made to the server

Initially, we ask cookies only if you need to search a url with type=code (mandatory for the extraction to work)

Now you should be able to handle the 100 pages without cookies

Add comment

Developer

SASWAVE

Actor Metrics

4 monthly users
3 stars
94% runs succeeded
0.76 hours response time
Created in Mar 2024
Modified 12 days ago

Categories

Automation

Other

Lead generation

Twitter Search Scraper

epctex/twitter-search-scraper

Scrape any keyword or hashtag from Twitter. Extract tweets, replies, favorites, retweets, and conversation threads without limit. Gather user-related information such as verification, location, profile image, friends, followers, following, and much more! Get everything with no limits on Twitter!!

epctex

781

Zillow ZIP Code Search Scraper

maxcopell/zillow-zip-search

Scraper to find all Zillow real estate properties for sale, for rent or recently sold from given ZIP code locations.

Maximillian Copelli

431

Zillow Search Scraper

maxcopell/zillow-scraper

Extract data about properties for sale and rent on Zillow using the Zillow API, but with no daily call limits. Scrape millions of listings and download your data as HTML, JSON, CSV, Excel, XML. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Maximillian Copelli

878

Tiktok User Search Scraper

clockworks/tiktok-user-search-scraper

Extract data about users based on TikTok user search. You'll get dull user profiles, including name, nickname, signature, number of followers, number of videos, bio link, and author’s ID.

Clockworks

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, AI overviews, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export scraped data, run the scraper via API, schedule runs, or integrate with other tools.

Apify

49.6k

234

Zillow Detail Scraper

maxcopell/zillow-detail-scraper

Get details of Zillow properties from URLs. This Actor can be easily integrated with other Zillow Scrapers.

Maximillian Copelli

762

Google Images Scraper

hooli/google-images-scraper

Scrape image details from images.google.com. Add your query and number of images and extract image details such as image URL, image source, description, image dimensions, thumbnail, and more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Hooli

763

Apollo.io leads scraper

curious_coder/apollo-io-scraper

Scrape leads from apollo io search results including verified emails and phone numbers. This apollo io data scraping bot helps you to extract leads from your apollo search results without subscribing to costly apollo pricing plans

Curious Coder

19.5k

185

Fast Google Scraper

hooli/easy-google-scraper

Make collecting data from Google easy with Fast Google Scraper. Extract organic and paid Google search engine results pages, then download your data as HTML table, JSON, CSV, Excel, or XML.

Hooli

3.7k

Walmart Data Extractor

epctex/walmart-scraper

Access a vast array of product data from Walmart with our Walmart Scraper. Extract images, brand details, prices, variations, and more. Customize your search with filters, categories, and lists to gather the information you need.

epctex

606