Facebook Marketplace Scraper avatar
Facebook Marketplace Scraper

Pricing

$10.00/month + usage

Go to Store
Facebook Marketplace Scraper

Facebook Marketplace Scraper

Developed by

Muhamed Didovic

Muhamed Didovic

Maintained by Community

Unlock valuable insights from Facebook Marketplace effortlessly – perfect for market research, price tracking, and competitor analysis, all while staying anonymous.

0.0 (0)

Pricing

$10.00/month + usage

2

Total users

52

Monthly users

10

Runs succeeded

>99%

Issues response

1.1 days

Last modified

a day ago

FU

How to Limit Amount of Pages Scraped?

Closed

futurafree opened this issue
a month ago

Currently, this is working perfectly, besides it scraping too many pages per URL. I currently have 8 URLs, so i only need it to scrape the first page of each since I run the actor every 3 minutes to check for new listings at the top (my URLs are sorted by new). So, I only need to scrape a total of 8 pages, one page for each URL. Right now, it's scraping 20 or 30 pages at a time which is taking too many resources. Just wondering if there's any way to limit the amount of pages each URL is scraped, thanks!

FU

futurafree

a month ago

Also, I'm realizing now that MaxItems is not the amount of listings you want to scrape. If you could make it possible to speciy the amount of listings you want to scrape per URL (like 10 listings per URL and stop there), that would be perfect instead of specifying the amount of pages to scroll. Also, I see that the Monitoring Mode skips the listings and tries to find new ones. Rather than it skipping the listings, lets say you want to find the 10 newest listings at the top of the page, and all 10 are found to be duplicates, rather than skipping it just ends the run there, returning nothing since no new listings have appeared at the top of the page. This would help optimize it greatly because as of now it just keeps scrolling and scrolling forever until another listing is found thats not in the DB.

memo23 avatar

Hey buddy, thanks for the feedback and for using the actor. The maxItems option is not maxPages; it is actually for items or ads in this case. If you set it to only 10, it will scrape 10 items and stop when it reaches that threshold. I guess you set it to 10 but received 20, for example, so why is that? Facebook is sending data in batches from their backend, so if you specify 10 as maxItems and I receive 20, I usually include all of them since I have them. I want the clients to get even more. I hope this clear the confusion...