Lobsters Scraper

  • epctex/lobsters-scraper
  • Modified
  • Users 1
  • Runs 481
  • Created by Author's avatarepctex

Scrape Lobste.rs posts and users based on any search criteria. Retrieve all the comments, domains, tags, titles, number of upvotes, and published dates. Use this extremely fast actor to retrieve all the information right away. Easy use and no limits!

Free trial for 3 days

Then $10.00/month

No credit card required now

Lobsters Scraper

Free trial for 3 days

Then $10.00/month

Start URLs

startUrls

Optional

array

URLs to start with. It should be tag, domain, user, search or detail URL

Search keyword

search

Optional

string

The keyword that you can search on lobste.rs

Maximum number of listing items

maxItems

Optional

integer

Maximum number of listing items that you want as output. Default is all

List end page

endPage

Optional

integer

The page number that you want to end with. By default there is no end page. This is applies to all search request and startUrls individually.

Extend output function

extendOutputFunction

Optional

string

Function that takes a JQuery handle ($) as argument and returns data that will be merged with the default output

Custom map function

customMapFunction

Optional

string

Function that takes each of the objects as argument and returns data that will be mapped by the function itself.

Proxy configuration

proxy

Optional

object

Select proxies to be used by your crawler.