I have some issues with the ad update. Some of the results seems incorrect. For instance, I got this response 20 minutes ago and 2 out of 3 ads are still accessible online :

[
    {
        "list_id": "2287773329",
        "status": "disabled",
        "url": "https://www.leboncoin.fr/ventes_immobilieres/2287773329.htm"
    },
    {
        "list_id": "2293967685",
        "status": "disabled",
        "url": "https://www.leboncoin.fr/ventes_immobilieres/2293967685.htm"
    },
    {
        "list_id": "2294382340",
        "status": "disabled",
        "url": "https://www.leboncoin.fr/ventes_immobilieres/2294382340.htm"
    }
]

What are you using to decide if the ad has been disabled ?

BasileDataimo

Hello Victor,

I checked some results yesterday, it seems that some ads are still detected as disabled but still online. Do you have any lead on why it is happening? Do you want some help to locate the concerned ads?

Also I still see some runs with this error :

2023-03-22T16:53:22.806Z   ReferenceError: log is not defined
2023-03-22T16:53:22.809Z       at BasicCrawler.failedRequestHandler (file:///usr/src/app/main.js:39:9)
2023-03-22T16:53:22.814Z       at /usr/src/app/node_modules/@crawlee/basic/internals/basic-crawler.js:736:78
2023-03-22T16:53:22.816Z       at BasicCrawler._tagUserHandlerError (/usr/src/app/node_modules/@crawlee/basic/internals/basic-crawler.js:723:26)
2023-03-22T16:53:22.820Z       at BasicCrawler._handleFailedRequestHandler (/usr/src/app/node_modules/@crawlee/basic/internals/basic-crawler.js:736:24)
2023-03-22T16:53:22.822Z       at BasicCrawler._requestFunctionErrorHandler (/usr/src/app/node_modules/@crawlee/basic/internals/basic-crawler.js:718:24)
2023-03-22T16:53:22.825Z       at runMicrotasks (<anonymous>)
2023-03-22T16:53:22.826Z       at processTicksAndRejections (node:internal/process/task_queues:96:5)
2023-03-22T16:53:22.827Z       at async wrap (/usr/src/app/node_modules/@apify/timeout/index.js:52:21)
2023-03-22T16:53:23.052Z node:internal/process/esm_loader:97
2023-03-22T16:53:23.053Z     internalBinding('errors').triggerUncaughtException(

Best regards.

Add comment

Advanced Leboncoin scraper

saswave/advanced-leboncoin-scraper

Leboncoin scraper. Collect product detail from website leboncoin.fr Advanced Web crawler for ecommerce website le bon coin. Extract phonenumber from detail pages

SASWAVE

102

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

52.4k

4.5

Google Maps Scraper

compass/crawler-google-places

Extract data from thousands of Google Maps locations and businesses. Get Google Maps data including reviews, reviewer details, images, contact info, opening hours, location, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

105.7k

4.2

TikTok Scraper

clockworks/tiktok-scraper

Extract data from TikTok videos, hashtags, and users. Use URLs or search queries to scrape TikTok profiles, hashtags, posts, URLs, shares, followers, hearts, names, video, and music-related data. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

34k

4.5

🔥Apollo Scraper - Scrape upto 50k Leads

code_crafter/apollo-io-scraper

Scrape up to 50,000 leads per search URL.

Code Pioneer

31.3k

4.2

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

98k

4.2

Twitter (X) Follower Scraper | $0.1 / 1K | Email| No Rate Limit

kaitoeasyapi/premium-x-follower-scraper-following-data

$0.1 per 1000 twitter followers/following! The most affordable X data scraper. Get instant access to follower & following lists. Trusted by marketing pros for accurate social data. Lightning - fast extraction, 99.9% success rate. Start collecting valuable twitter(X) data today!

Kaito Easy API

840

4.3

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

22.6k

4.6

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.40 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

API Dojo

15.5k

3.2

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

36k

4.4

TikTok Data Extractor

clockworks/free-tiktok-scraper

Extract data about videos, users, and channels based on hashtags or scrape full user profiles including posts, total likes, name, nickname, numbers of comments, shares, followers, following, and more.

Clockworks

27.2k

4.8