[
  {"url": "https://www.leboncoin.fr/ventes_immobilieres/2198189945.htm"},
  {"url": "https://www.leboncoin.fr/ventes_immobilieres/2201767813.htm"},
  {"url": "https://www.leboncoin.fr/ventes_immobilieres/2205212373.htm"},
  {"url": "https://www.leboncoin.fr/ventes_immobilieres/2197876906.htm"},
  {"url": "https://www.leboncoin.fr/ventes_immobilieres/2197875868.htm"},
  ...
]

But the results timed out after 1 hour. You can see the runs here if you have access :

2022-10-10 17:34 - https://console.apify.com/actors/1gq6JJBYQFbM7kbke/runs/itbXMsyZ1xxLazbIc#log
2022-10-10 17:34 - https://console.apify.com/actors/1gq6JJBYQFbM7kbke/runs/kILUxgEEGj30qu12o#log

I can lower the number of urls if this is the issue. But perhaps you will have better insights to identify the origin of the timeouts ?

Best resgards,

Victor McDowell (mcdowell)

Hi Basile, It appears that some of the ads have been disabled. I will issue an update that ignores ads that have been disabled instead of continually retrying.

Victor McDowell (mcdowell)

Hello Basile, I issued the update that skips disabled ads. Please confirm that the scraper works as expected before I close the issue.

Best regards,

BasileDataimo

Hello Victor,

Sorry for the delay. This is better, my last run last 17 minutes instead of 1 hour timeout : https://console.apify.com/actors/1gq6JJBYQFbM7kbke/runs/Qc0rucuXXh3enWALm#log

But I only got 13 results over 50 urls asked. Looking at the logs, I understand that you detected some of the ads have been disabled, and some of the ads are in unknown state (timeout). Am I correct ?

# Ad disabled example
2022-10-24T17:43:29.839Z ERROR BasicCrawler: [This ad is disabled] https://www.leboncoin.fr/ventes_immobilieres/2226162047.htm [WebSocket is not open] Cette annonce est désactivée
# Ad timeout example
2022-10-24T17:56:00.552Z ERROR BasicCrawler: Request failed and reached maximum retries. requestHandler timed out after 60 seconds (tCx1fKWrrmlNWEg). {"id":"tCx1fKWrrmlNWEg","url":"https://www.leboncoin.fr/ventes_immobilieres/2226153374.htm","method":"GET","uniqueKey":"https://www.leboncoin.fr/ventes_immobilieres/2226153374.htm"}

If I am right, I need to known if the missing ads are disabled our timeout. Would it be possible for you to add those ads in the results list with a specific status ? For example :

[
    {
        "list_id": 2226162047,
        "status": "disabled",
        "url": "https://www.leboncoin.fr/ventes_immobilieres/2226162047.htm",
    },
    {
        "list_id": 2226153374,
        "status": "unknown",
        "url": "https://www.leboncoin.fr/ventes_immobilieres/2226153374.htm",
    },
]

Best regards,

Victor McDowell (mcdowell)

Hi Basile, You are correct on your assessment. I will work on an update that returns the ads with their status ASAP.

BasileDataimo

You're the best, thanks Victor !

Victor McDowell (mcdowell)

Thanks, Please confirm that the updated actor has fixed this issue. Best regards

BasileDataimo

Hello Victor,

Sorry I confirm the fix, thank you !

Add comment

Advanced Leboncoin scraper

saswave/advanced-leboncoin-scraper

Leboncoin scraper. Collect product detail from website leboncoin.fr Advanced Web crawler for ecommerce website le bon coin. Extract phonenumber from detail pages

SASWAVE

102

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

52.4k

4.5

Google Maps Scraper

compass/crawler-google-places

Extract data from thousands of Google Maps locations and businesses. Get Google Maps data including reviews, reviewer details, images, contact info, opening hours, location, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

105.7k

4.2

TikTok Scraper

clockworks/tiktok-scraper

Extract data from TikTok videos, hashtags, and users. Use URLs or search queries to scrape TikTok profiles, hashtags, posts, URLs, shares, followers, hearts, names, video, and music-related data. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

34k

4.5

🔥Apollo Scraper - Scrape upto 50k Leads

code_crafter/apollo-io-scraper

Scrape up to 50,000 leads per search URL.

Code Pioneer

31.3k

4.2

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

98k

4.2

Twitter (X) Follower Scraper | $0.1 / 1K | Email| No Rate Limit

kaitoeasyapi/premium-x-follower-scraper-following-data

$0.1 per 1000 twitter followers/following! The most affordable X data scraper. Get instant access to follower & following lists. Trusted by marketing pros for accurate social data. Lightning - fast extraction, 99.9% success rate. Start collecting valuable twitter(X) data today!

Kaito Easy API

840

4.3

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

22.6k

4.6

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.40 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

API Dojo

15.5k

3.2

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

36k

4.4

TikTok Data Extractor

clockworks/free-tiktok-scraper

Extract data about videos, users, and channels based on hashtags or scrape full user profiles including posts, total likes, name, nickname, numbers of comments, shares, followers, following, and more.

Clockworks

27.2k

4.8