Advanced Product Hunt Scraper avatar

Advanced Product Hunt Scraper

Try for free

3 days trial then $15.00/month - No credit card required now

View all Actors
Advanced Product Hunt Scraper

Advanced Product Hunt Scraper

danpoletaev/product-hunt-scraper
Try for free

3 days trial then $15.00/month - No credit card required now

Scrape product hunt "Top Products Launching Today" section. Actor crawls products and extracts information about the product: title, description, categories, images, maker info with contact links and website info with raw text and email. Export scraped datasets in JSON, csv, etc. Run via API.

What is product hunt scraper tool?

It's a tool that allows to extract launches with information from Product Hunt and enhance the results with available contact details such as email addresses and links of the maker.

To get the data, just run Product Hunt Crawler and click "Save & Start" button.

With this scraping tool, you can:

  • Extract all launches from the "Top Products Launching Today" section. (From that page: https://www.producthunt.com/all)
  • Extract all launches from the Archive by day. E.g.: https://www.producthunt.com/leaderboard/daily/2024/7/25/all
  • Get text from the launched product's website and email address (if exists)
  • Extract information about the maker, including available links in his/her profile
  • Download information in Excel, CSV, JSON, and other formats
  • Get the YouTube video URL, website URL, and images of the product

Output example

Once the scraper collects data for the first event, you'll see an output visualization on Apify platform. The output will look similar to the following example:

Example of the output

Take a look at JSON to see full output

What data can be extracted from listing?

📈 Extract main information from product hunt product's launches, such as name, short description, description, amount of upvotes

📩 Extract website url and YouTube url

👨‍🍳 Extract information about the maker including available links in his/her profile

☄️ Extract all listings in "Top Products Launching Today" section

📅️ Extract all listings from the Archive by day

💿 Extract product's website raw text and email address (if exists)

⬇️ Download information in Excel, CSV, JSON, and other formats

What business data can I extract from Product hunt?

With this Product Hunt API, you will be able to extract the following information for all products launching today:

✍️ Name, description and # upvotes📥 Raw text and email from website
👨‍🍳 Maker information with links🌆 Images
💿 Youtube video url📱 Categories

How much listings can be scraped?

Usually, it is about 50-120 listing per day. Scraper starts at that url: https://www.producthunt.com/all and crawls all products in section "Top Products Launching Today".

Input

You can choose whether you want to scrape makers and website information.

1{
2    "scrapeMakers": true,
3    "scrapeWebsite": true,
4    "archiveDate": "2024-05-15" // Date of the day you want to scrape in the format YYYY-MM-DD. If not provided, the scraper will scrape the current day.
5}

Output JSON example

You can of course export all extracted events to the format of your choice for easy postprocessing. We support JSON, CSV, XML, RSS, HTML Table, JSONL and Excel. Here's an excerpt from the JSON dataset you'd get:

1[{
2        "date": "2024-03-03T07:01:04.257Z",
3        "launchDate": "2024-03-03T07:01:04.257Z",
4        "url": "https://www.producthunt.com/posts/digital-creators-hub",
5        "title": "Digital Creators' Hub - Content hub & idea discovery engine for digital creators | Product Hunt",
6        "name": "Digital Creators' Hub",
7        "shortDescription": "Content hub & idea discovery engine for digital creators",
8        "description": "Easily discover great ideas, shareable content and free resources in pre-curated topics like AI, digital marketing, Notion, web design, SEO, and more!",
9        "categories": [
10            "Marketing",
11            "Tech",
12            "Search"
13        ],
14        "maker": {
15            "makerHref": "https://www.producthunt.com/@clifftky",
16            "name": "Clifford Tan",
17            "slug": "@clifftky",
18            "title": "Clifford Tan's profile on Product Hunt | Product Hunt",
19            "url": "https://www.producthunt.com/@clifftky",
20            "links": [
21                "https://clifford.io/",
22                "https://twitter.com/clifftky"
23            ],
24            "aboutText": "👋 I'm a creator of web apps, notion templates and productivity hacks."
25        },
26        "websiteUrl": "https://dch.clifford.io",
27        "images": [
28            "https://ph-files.imgix.net/73cc3a49-adc2-4b8f-9111-6ddbc9435cdb.png?auto=compress&codec=mozjpeg&cs=strip&auto=format&w=368&h=220&fit=max&dpr=3",
29            "https://ph-files.imgix.net/496f4e7d-e870-4974-b7bb-5bee27c066d7.png?auto=compress&codec=mozjpeg&cs=strip&auto=format&w=368&h=220&fit=max&dpr=3",
30            "https://ph-files.imgix.net/83679466-e98d-4510-b116-f14c5d1b482d.png?auto=compress&codec=mozjpeg&cs=strip&auto=format&w=368&h=220&fit=max&dpr=3",
31            "https://ph-files.imgix.net/75c75157-96ca-4c91-9c4e-8d9a2b7d71fd.png?auto=compress&codec=mozjpeg&cs=strip&auto=format&w=368&h=220&fit=max&dpr=3",
32            "https://ph-files.imgix.net/993700bc-fab1-4267-b8ac-613ceff77072.png?auto=compress&codec=mozjpeg&cs=strip&auto=format&w=368&h=220&fit=max&dpr=3"
33        ],
34        "upvotes": 57,
35        "website": {
36            "title": "Digital Creators' Hub",
37            "url": "https://dch.clifford.io",
38            "email": "hello@clifford.io",
39            "websiteRawText": " Welcome to the hub for Digital CreatorsEasily discover great ideas shareable content and free resources in precurated topics like AI digital marketing Notion web design SEO and moreStart Exploring Why Digital Creators HubAre you an indie hacker content writer web developer Notion creator AI prompt engineer Canva designer eBook creatorStruggling with ideas or content to make your next great product or run your next marketing campaignDCH is here to helpWe curate useful resources from the web and put them into areas of interest for you the creator Web DesignDiscover web design tools and inspiration all in one placeExplore Web DesignAILearn and use AI tools to run your business efficientlyExplore AIMarketingSharing great content and build an audience for your businessExplore MarketingNotionTemplates databases formulas and more This is your spot for NotionExplore Notion Have a great resource to shareDM me to have your resource includedDM CliffMade with  by CliffTermsPrivacy DCH 2024"
40        }
41    }]

Tips

It is better to run/schedule a scraper at 23:00 PST time, because at 00:01 PST starts new day at product hunt. That way you will get most information for the current day.

Developer
Maintained by Community

Actor Metrics

  • 23 monthly users

  • 8 stars

  • 92% runs succeeded

  • 18 hours response time

  • Created in Feb 2024

  • Modified 2 months ago