Get started
Product
Back
Start here!
Ready-to-run tools for your AI agents and apps. Just pick one and go.
Browse 84,371 Actors
Apify platform
Apify Store
Actors for any job on the web
Actors
Build and run serverless programs
Integrations
Connect with apps and services
MCP
Give your AI access to Actors
Anti-blocking
Scrape without getting blocked
Proxy
Rotate scraper IP addresses
Open source
Crawlee
Web scraping and crawling library
Solutions
MCP server configuration
Configure your Apify MCP server with Actors and tools for seamless integration with MCP clients.
Start building
Apify for
Enterprise
Startups
Universities
Nonprofits
Use cases
Data for generative AI
Data for AI agents
Lead generation
Market research
View more →
Consulting
Professional services
Apify Partners
Developers
Documentation
Full reference for the Apify platform
Actor templates
Python, JavaScript, and TypeScript
Web scraping academy
Courses for beginners and experts
Monetize your code
Publish your Actors and get paid
Learn
API reference
CLI
SDK
Earn from your code
$1.6M paid out last month. Many developers earn over $3k.
Start earning now
Resources
Help and support
Advice and answers about Apify
Actor ideas
Get inspired to build Actors
Changelog
See what’s new on Apify
Customer stories
Find out how others use Apify
Company
About Apify
Contact us
Blog
Live events
Doing Good
Jobs
We're hiring!
Join our Discord
Talk to other builders
Pricing
Contact sales
Robots.txt Validator
Pay per usage
predictable_function/my-actor-3
List of website base URLs whose robots.txt files will be validated
Rating
5.0
(1)
Developer
riya rawat
Actor stats
0
Bookmarked
65
Total users
Monthly active users
9 months ago
Last modified
Categories
SEO tools
Share
apify/rag-web-browser
Web search and fetch tool for AI agents and RAG pipelines. It queries Google Search, scrapes the top N pages using a full web browser, and returns their content as clean Markdown for further processing by an LLM. Can also fetch individual URLs.
Apify
190K
4.7
(36)
predictable_function/my-actor-2
List of URLs whose HTTP redirect chains will be analyzed
71
compass/crawler-google-places
Extract data from thousands of Google Maps locations and businesses, including reviews, reviewer details, images, contact info, including full name, email, and job title, opening hours, prices & more. Export data, run via API, schedule and monitor runs, or integrate with other tools.
Compass
638K
(1,817)
predictable_function/website-uptime-response-monitor
Monitors website uptime and response time for given URLs.
66
(2)
katzino/actor-web-a11y-audit
This web accessibility checker crawls a site and reviews it for adherence to the Web Content Accessibility Guidelines (WCAG). Results can be accessed via Apify Console or downloaded in JSON, CSV, XML, or Excel formats.
Tomas Katz
84
glassventures/website-sitemap-extractor
Extract all URLs from any website's sitemap. Auto-discovers sitemaps from robots.txt, supports sitemap index files and .gz compression. Filter by URL pattern, date range.
Glass Ventures
19
getdataforme/my-Poshmark-actor
A Poshmark scraper is a tool that automatically extracts product data (prices, descriptions, photos, seller info) from Poshmark's website. It helps track prices, monitor competitors, and gather market insights for resellers and businesses selling on the platform.
GetDataForMe
37
getdataforme/my-youtube-email-actor
hearty_theme/my-actor-3
This actor transcribes a youtube video using an url provided by the user
Martin Paz
38
advantageous_subcontra/seo-website-audit-check-page-sizes
Google isn't indexing html files above 2MB. This actor allows you to quickly check if any page of your website is affected.
Fabian Maume
15
Description
Definition