Hi 👋

Thank you for your valuable feedback! I’ve reviewed your suggestions and implemented the changes to improve the scraping functionality. Below are the updates:

1. You can now filter products by the minimum amount of upvotes. Use "filter.minVotes" to set minimum amount of upvotes.
2. You can now crawl only top N amount of products. Use "filter.topNProducts" to set the amount of products to crawl.
3. If you set "saveWebsiteContent" to false - we'll not save website content to the dataset. We'll only save email.

Here’s the updated configuration for your reference:

{ "scrapeMakers": true, "scrapeWebsite": true, "archiveDate": "2024-05-15", // Date of the day you want to scrape in the format YYYY-MM-DD. If not provided, the scraper will scrape the current day. "filter": { // Filter is optional - if you don't pass it, we'll crawl all products for the following day "minVotes": 100, // Filter products by the minimum amount of upvotes "topNProducts": 10, // Take top N amount of products }, "saveWebsiteContent": true, // Set to true, if you want to set the content of the product's website to websiteRawText. This leads to a much bigger dataset. }

Also, you can check the documentation here: https://apify.com/danpoletaev/product-hunt-scraper#input

Important note: to avoid making breaking changes. By default we scrape all products and save website content to the dataset.

I am closing the issue. Let me know if you'll face any problems. 🙏