Lobsters Scraper avatar
Lobsters Scraper
Try for free

3 days trial then $10.00/month - No credit card required now

View all Actors
Lobsters Scraper

Lobsters Scraper

epctex/lobsters-scraper
Try for free

3 days trial then $10.00/month - No credit card required now

Scrape Lobste.rs posts and users based on any search criteria. Retrieve all the comments, domains, tags, titles, number of upvotes, and published dates. Use this extremely fast actor to retrieve all the information right away. Easy use and no limits!

Start URLs

startUrlsarrayOptional

URLs to start with. It should be tag, domain, user, search or detail URL

searchstringOptional

The keyword that you can search on lobste.rs

Maximum number of listing items

maxItemsintegerOptional

Maximum number of listing items that you want as output. Default is all

List end page

endPageintegerOptional

The page number that you want to end with. By default there is no end page. This is applies to all search request and startUrls individually.

Extend output function

extendOutputFunctionstringOptional

Function that takes a JQuery handle ($) as argument and returns data that will be merged with the default output

Custom map function

customMapFunctionstringOptional

Function that takes each of the objects as argument and returns data that will be mapped by the function itself.

Proxy configuration

proxyobjectRequired

Select proxies to be used by your crawler.

Developer
Maintained by Community
Actor metrics
  • 1 monthly users
  • 98.9% runs succeeded
  • 0.0 days response time
  • Created in Apr 2023
  • Modified about 11 hours ago