When using multiple apollo accounts, generate unique search results with unique filters to avoid duplicates. Use "Net new" search urls to avoid duplicates within an apollo account

Here are some points to know when using the apollo scraping tool

• Use more delay (5-60 seconds is recommended)
• Do not scrape more than 1k records per day
• Use same proxy country for every run, and use the country from where you normally login to your apollo account
• Do not scrape simultaneously with same apollo account
• Prefer cookies

Hello Tech Support,

I am encountering a recurring issue with our scraping tool when trying to extract lists of over 1000 contacts. Here’s a detailed breakdown:

Consistent Data Extraction Across Days: When using a single agent (let's call it Agent 1) to scrape data, it successfully pulls the first 1000 contacts (equivalent to 10 pages) on Day 1. However, on subsequent days, even if I alter the "starting page" parameter, Agent 1 continues to extract the same 1000 contacts. This suggests that changing the "starting page" does not refresh the results as intended.

Ineffective Starting Page Feature: The tool does not seem to recognize changes in the starting page. This is problematic because I aim to use the same URL with the same agent to scrape an entire list over multiple days, but the agent pulls the same initial set of contacts on different days.

Filter Adjustment Limitation: Adjusting the filters to generate new results is not a feasible solution, as the tool appears only to scrape the first 1000 contacts and ignores the specified page number beyond this limit.

Could you provide guidance or a workaround on using the scraper to efficiently extract sets of 1000+ contacts from the same URL over consecutive days? Is there a way to ensure that the "starting page" feature functions as expected, or are there alternative methods we should consider for extracting larger datasets?

Thank you for your assistance.

Hello Tech Support,

I am encountering a couple of issues with Apify and the Apollo scraper that are impacting our data extraction processes.

Sorting Filter Issue in Apify: Despite setting Apify to sort and extract records starting with the letter 'Z' (as displayed in Apollo), the tool ignores this configuration and begins the extraction with results starting from 'A'. This occurs even though the settings are identical and cookies are correctly implemented. The sorting filter does not seem to function as intended, consistently retrieving results starting with 'A' regardless of the specified sorting order.

Data Refresh Issue in Apollo Scraper: We're also facing a challenge concerning the daily data refresh with the Apollo scraper. On Day 1, Agent 1 successfully extracts 1000 new leads from URL1, starting from page 1. However, on Day 2, despite being configured to continue from the same starting page, the scraper repeats the extraction of the previous day’s contacts instead of pulling in new ones. This suggests that the data isn't refreshing as expected.

Could you please assist in troubleshooting these issues? We need guidance on ensuring that both Apify respect the sorting order set and that the Apollo scraper correctly refreshes to pull new contacts daily as intended.

Thank you for your help.

I have a question regarding the Apollo scraper tool’s functionality. I'm experiencing an issue where, despite changing the starting page and using the same URL and account on different days, the tool continues to extract the same set of records (resulting in duplicated data).

Could you please confirm if the Apollo scraper is supposed to respect the starting page parameter I set, or if there might be an issue causing it to ignore this setting and pull the same data repeatedly?

Thank you for your assistance with this matter.