Opensea Collection Scraper

Features

This OpenSea collection Scraper will enable you scrape any collection from OpenSea.io.

OpenSea is also providing APIs but they come with unexplained throttling & community is screaming about it! More about it on this github issue

So, OpenSea API doesn't help here reliably if you want to get complete list of all tokens in particular collection. Moreover, if you visit any collection on website, you will find same token listed more than once on listing page.

So, even with website users there is no official way to get complete detail of collection tokens. Whether you are doing this for your next analysis project, investment analysis or even if you are owner of the collection, this scraper will help you to get complete list of all the tokens in particular collection.

Input

Input example

For simple usecase, you just need to provide browser url of opensea collection & that's all. You can leave other fields as they are to be sensible defaults.

{
  "startUrls": [
    {
      "url": "https://opensea.io/collection/parallelalpha"
    }
  ],
  "extendOutputFunction": "(asset) => {
        const result = {};
        // Uncomment to add a asset id to the output
        // result.id = asset.id;
        return result;
    }",
}

Output

The scraped data is stored in the dataset of each run. The data can be viewed or downloaded in many popular formats, such as JSON, CSV, Excel, XML, RSS, and HTML.

Output example

The result for scraping a single token like this:

{
  "tokenId": "63731686129492883602476657637542425957960651279641304638831699457384181137409",
  "name": "3D",
  "imageUrl": "https://lh3.googleusercontent.com/FOIb59HSNZuMXri0QkaweUCdvT0Nk0r1ZmJ57ugrGdNHs27AuwPZOUhCLzFHPpsxtPbfAUs6mtPF9i1He8QxkJIlvtROrn6uuSNdbX4",
  "contractAddress": "0x2953399124f0cbb46d2cbacd8a89cf0599974963",
  "chain": "MATIC",
  "favoritesCount": 0,
  "bestAsk": 0.1,
  "url": "https://opensea.io/assets/0x2953399124f0cbb46d2cbacd8a89cf0599974963/63731686129492883602476657637542425957960651279641304638831699457384181137409"
}

Modify the output

There is an additional input extendOutputFunction provided using which you can customize the output JSON. If you are good with Javascript, you can simply edit this default function to your use-case and override the output.

Limitations

Since opensea supports browsing only upto 10K items in collection, it's advisible to use this actor for collection upto the size of 10K & max upto 20K.