No credit card required

Kickstarter Scraper

qbie/kickstarter-scraper

No credit card required

Search Kickstarter projects based on your selected criteria and get structured data on matching projects. Download your data as HTML table, JSON, CSV, Excel, XML, and RSS feed. Forked from misceres/kickstarter-search.

Back to issues Create new issue

Crawler not working

Open

user-APfWY8uJbhPS7KMKW opened this issue

No sure what is exactly wrong but the crawler does not work and keeps giving an error on each page of the scrape

user-APfWY8uJbhPS7KMKW

2024-11-04T09:28:05.721Z INFO Page opened. {"label":"START","url":"https://www.kickstarter.com/discover/advanced?woe_id=0&term=STLs&sort=newest&page=1&google_chrome_workaround"} 2024-11-04T09:28:07.401Z ERROR BasicCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.kickstarter.com/discover/advanced?woe_id=0&term=STLs&sort=newest&page=1&google_chrome_workaround","retryCount":2,"id":"yk8Dkj2Ao5GLF5N"} 2024-11-04T09:28:07.401Z Error: Could not resolve seed. Will retry... 2024-11-04T09:28:07.402Z at getToken (/usr/src/app/src/utils.js:177:15) 2024-11-04T09:28:07.402Z at processTicksAndRejections (node:internal/process/task_queues:96:5) 2024-11-04T09:28:07.403Z at async exports.handleStart (/usr/src/app/src/routes.js:11:31) 2024-11-04T09:28:07.403Z at async BasicCrawler._handleRequestFunction (/usr/src/app/node_modules/apify/build/crawlers/basic_crawler.js:330:9) 2024-11-04T09:28:07.404Z at async wrap (/usr/src/app/node_modules/@apify/timeout/index.js:73:27)

Add comment

Developer

Matt Warwick

Actor Metrics

23 monthly users
5 bookmarks
>99% runs succeeded
Created in Mar 2023
Modified 2 years ago

Categories

Kickstarter Explorer

jupri/kickstarter

Scrape Kickstarter.com Campaigns

cat

Bulk Email Validator

dxbear/Email-validator

Verify email addresses instantly. Check for accuracy, spam, and disposable email traps to ensure your marketing lists are clean.

Dxbear

143

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

6.4k

121

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

76.2k

459

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

5.3k

Download HTML from URLs

mtrunkat/url-list-download-html

This actor takes a list of URLs and downloads HTML of each page.

Marek Trunkát

8.4k

Google Ads Scraper

silva95gustavo/google-ads-scraper

Extract text, image and video ads from Google Ads, scraped from the ad library provided by Google Ads Transparency Center. Gain access to ad details, ad copy, locations, and more. Dive deeper into the Google Ads Transparency Center for a competitive edge.

Gustavo Silva

Legacy PhantomJS Crawler

apify/legacy-phantomjs-crawler

Replacement for the legacy Apify Crawler product with a backward-compatible interface. The actor uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of front-end JavaScript code.

Apify

1.6k

LinkedIn Ads Scraper

silva95gustavo/linkedin-ad-library-scraper

Extract ads of any format from LinkedIn Ad Library. Gain access to ad details, ad copy, media URL, call-to-action buttons and more. Dive deeper into the LinkedIn Ad Library for a competitive edge.

Gustavo Silva

1.2k

Website Screenshot Generator

apify/screenshot-url

Create a screenshot of a website based on a specified URL. The screenshot is stored as the output in a key-value store. It can be used to monitor web changes regularly after setting up the scheduler.

Apify

3.1k