No credit card required

Content Checker

jakubbalada/content-checker

No credit card required

Monitor a website or web page for content changes. Automatically saves before and after screenshots and sends an email notification when content changes are detected.

Back to issues Create new issue

Can this scraper monitor that a new blog post has been published?

Closed

expansive_wire opened this issue

Hi I'm getting failures trying to run the actor for this company's blog page. I'd like to monitor this page and every time a new blog is posted be alerted (and then scrape the new blog post).

Can you help me understand?

2024-07-26T04:13:01.746Z ACTOR: Pulling Docker image of build l8oQqJT6pAaxvYUZq from repository. 2024-07-26T04:13:20.248Z ACTOR: Creating Docker container. 2024-07-26T04:13:21.060Z ACTOR: Starting Docker container. 2024-07-26T04:13:21.586Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1920x1080x24+32 -nolisten tcp 2024-07-26T04:13:21.589Z Executing main command 2024-07-26T04:13:22.483Z INFO System info {"apifyVersion":"3.1.15","apifyClientVersion":"2.8.4","crawleeVersion":"3.7.3","osType":"Linux","nodeVersion":"v18.19.0"} 2024-07-26T04:13:23.214Z INFO PuppeteerCrawler: Starting the crawler. 2024-07-26T04:13:26.736Z INFO Page loaded with title: Pure Storage Blogs | Digitally Transform With Data | Pure Storage on URL: https://blog.purestorage.com/ 2024-07-26T04:13:26.737Z INFO Sleeping 5s ... 2024-07-26T04:13:31.758Z INFO Saving screenshot... 2024-07-26T04:13:32.526Z WARN Failed to extract the content, either the content selector is wrong or page layout changed. Check the full screenshot. 2024-07-26T04:13:32.704Z INFO PuppeteerCrawler: All requests from the queue have been processed, the crawler will shut down. 2024-07-26T04:13:33.169Z INFO PuppeteerCrawler: Final request statistics: {"requestsFinished":1,"requestsFailed... [trimmed]

Pavlína Vencovská (paja)

Hi,

thanks for reaching out. We'll look into it and let you know what can be done.

Lukáš Křivka (lukaskrivka)

Hello,

The selector article that you chose is not the correct one as it doesn't exist on the page. You can choose e.g. .wp-block-query-is-layout-flow ul

Add comment

Developer

Jakub Balada

Actor Metrics

148 monthly users
46 bookmarks
56% runs succeeded
Created in May 2018
Modified 24 days ago

Categories

NSFW Image Detector

babak/nsfw-image-detector

This NSFW image detector is a fast and easy JPEG, PNG, BMP, and GIF nude checker, and content moderation tool. It marks indecent content from hundreds of image URLs in seconds. Let your users view 👙 porn, 🎌 hentai, and 😍 sexy content only when they want to!

V Hzrok

Website Spell Checker with AI

oscardz/website-spell-checker

The Website Spell Checker with AI scans your site for spelling and grammar errors, providing detailed reports with corrections. Export results in various formats or integrate into your workflow for automated checks, ensuring your content is always polished.

Oscar Rodriguez

Bulk Email Validator

dxbear/Email-validator

Verify email addresses instantly. Check for accuracy, spam, and disposable email traps to ensure your marketing lists are clean.

Dxbear

143

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

6.4k

120

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

76.2k

457

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

5.3k

Download HTML from URLs

mtrunkat/url-list-download-html

This actor takes a list of URLs and downloads HTML of each page.

Marek Trunkát

8.4k

Tiktok Shop Scraper

excavator/tiktok-shop-scraper

This is the Actor for crawling data from the TikTok shop product URLs. For example: https://shop.tiktok.com/view/product/XXXXXXXXXX These URLs are only available for TikTok Shop US. You can test it here: https://apify.com/excavator/tiktok-shop-product

Excavator

Youtube Video Downloader

epctex/youtube-video-downloader

Effortlessly download YouTube videos of your preferred quality with our user-friendly Video Downloader. Try it now!

epctex

773

🔥 LinkedIn Jobs Scraper

bebity/linkedin-jobs-scraper

ℹ️ Designed for both personal and professional use, simply enter your desired job title and location to receive a tailored list of job opportunities. Try it today!