# Find Sitemap From Url (`scrapers-hub/find-sitemap-from-url`) Actor ๐Ÿ”Ž Find Sitemap From Url tool instantly locates a websiteโ€™s sitemap from its URL, helping you discover indexable pages faster. โšก Perfect for SEO audits, crawling, indexing analysis & link research. ๐Ÿš€ Boost efficiency with accurate sitemap detection. - **URL**: https://apify.com/scrapers-hub/find-sitemap-from-url.md - **Developed by:** [Scrapers Hub](https://apify.com/scrapers-hub) (community) - **Categories:** Automation, Developer tools, Other - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $2.99 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ### ๐ŸŒ Website Metadata Extractor(sitemap, socialLinks, robotsTxt): The Professional SEO Intelligence Suite ๐Ÿš€ Welcome to the definitive manual for the Website Metadata Extractor(sitemap, socialLinks, robotsTxt). In an era where digital presence is defined by discoverability, the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) serves as your ultimate diagnostic radar. ๐Ÿ“ก This tool is engineered to peel back the technical layers of any domain, providing deep-seated insights into SEO health, social connectivity, and crawler compliance. ๐Ÿ—๏ธ๐Ÿง  The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) is built on a high-performance architecture, combining the agility of Crawlee with the precision of Cheerio. Whether you are an SEO consultant performing a technical audit ๐Ÿ‘”, a developer building a domain database ๐Ÿ’ป, or a marketer analyzing competitor strategies ๐Ÿ“ˆ, the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) delivers structured, actionable data in a matter of seconds. โšก #### ๐Ÿš€ Key Extraction Capabilities of Website Metadata Extractor(sitemap, socialLinks, robotsTxt) ๐Ÿ› ๏ธ The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) goes far beyond simple meta-tag scraping. It offers a 360-degree forensic analysis of a website's technical identity. ##### ๐Ÿง  Advanced SEO Intelligence The core of the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) is its ability to identify critical ranking factors. It extracts: . Primary Meta Tags: Page titles, meta descriptions, and keyword strings. ๐Ÿท๏ธ . Canonical Validation: Ensures the URL structure is optimized for search engines. ๐Ÿ”— . Viewport & Charset: Technical checks for mobile responsiveness and encoding. ๐Ÿ“ฑ ##### ๐Ÿค– Robots.txt & Crawler Compliance The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) parses the complex logic of robots.txt files. It categorizes rules by User-Agent (Googlebot, Bingbot, etc.), allowing you to see exactly which parts of a site are "No-Go" zones for AI crawlers. ๐Ÿšซ๐Ÿค– ##### ๐Ÿ—บ๏ธ Sitemap Architecture Discovery Every professional audit requires a map. The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) automatically locates and indexes sitemap XML files, giving you a full view of a domain's content depth. ๐Ÿ“‚โœจ ##### ๐Ÿงฉ Social Graph & Link Mapping The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) identifies Open Graph and Twitter Card data, alongside an automated hunt for socialLinks to platforms like LinkedIn, Instagram, and X. ๐Ÿ“ฑ๐Ÿค #### Output The Actor saves results to the default dataset with the following structure: When findAll = true ```json { "url": "example.com", "sitemaps": [ "https://example.com/sitemap.xml", "https://example.com/post-sitemap.xml" ], "count": 2 } ```` #### When findAll = false ```json { "url": "example.com", "sitemap": "https://example.com/sitemap.xml" } ``` #### ๐Ÿ“Š Technical Data Points: Inside the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) ๐Ÿงช When you run the Website Metadata Extractor(sitemap, socialLinks, robotsTxt), you receive a rich JSON payload. Below is a breakdown of what the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) captures. | Module ๐Ÿงฑ | Data Extracted ๐Ÿ“ | Strategic Use Case ๐Ÿ’Ž | | ------------------- | -------------------------------------- | ----------------------------------------------------------------------------------------------------------------------- | | **Header Audit** | `H1`, `H2`, `H3` hierarchy | Analyze on-page content structure and SEO clarity using Website Metadata Extractor (sitemap, socialLinks, robotsTxt) โœ๏ธ | | **Domain Logic** | `robots.txt`, `sitemap.xml` | Audit crawler accessibility, indexability, and technical SEO health ๐Ÿค– | | **Tech Stack** | `CMS`, `Frameworks`, `Analytics` | Fingerprint competitor technology choices and infrastructure ๐Ÿ•ต๏ธโ€โ™‚๏ธ | | **Social Presence** | `Social Links`, `Open Graph (OG) Tags` | Verify social preview branding and cross-platform consistency ๐Ÿ“ฑ | | **Content Metrics** | `Visible Word Count` | Benchmark content depth and competitiveness across pages ๐Ÿ“ | #### ๐ŸŽฏ Strategic Industry Use Cases for Website Metadata Extractor(sitemap, socialLinks, robotsTxt) ๐Ÿง  1. Competitive Technical Auditing ๐ŸŽ๏ธ Use the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) to see how your rivals structure their H1 tags and JSON-LD schemas. The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) reveals the "SEO playbook" of industry leaders. ๐Ÿ“–๐Ÿ† 2. Lead Generation & Outreach ๐Ÿค By extracting socialLinks and CMS data, the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) helps sales teams identify high-value prospects who might need a website upgrade or specialized SEO services. ๐Ÿ“ž๐Ÿ’ผ 3. Crawler & Indexing Troubleshooting ๐Ÿ› ๏ธ If a site isn't ranking, use the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) to check the robotsTxt for accidental "Disallow" rules. The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) identifies exactly where search engines are being blocked. ๐Ÿšซ๐Ÿ” 4. AI Training & Data Sourcing ๐Ÿค– The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) provides clean, structured data perfect for training Machine Learning models on web architectures and content hierarchies. ๐Ÿงช๐Ÿ“š #### ๐Ÿ’ก Advanced Methodology: How Website Metadata Extractor(sitemap, socialLinks, robotsTxt) Stays Resilient ๐Ÿ›ก๏ธ Websites are more protected than ever, but the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) uses elite stealth tactics: Dynamic Header Spoofing: The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) mimics real browser signatures to bypass simple scrapers blocks. ๐Ÿงฅ Residential Proxy Support: For large-scale runs, the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) integrates with global IPs to prevent rate-limiting. ๐ŸŒ Smart Parsing Logic: The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) ignores non-visible text (scripts/styles) to give an accurate wordCount. ๐Ÿ”ข #### ๐ŸŒ Global Connectivity: The socialLinks & sitemap Edge ๐ŸŒ In a connected world, a domain doesn't exist in a vacuum. The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) maps the "Digital Ecosystem": The sitemap Module: The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) hunts for hidden XML paths that reveal sub-domains and content silos. ๐Ÿ—บ๏ธ The socialLinks Module: The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) extracts every social handle (Facebook, IG, TikTok) to help you understand a brand's total footprint. ๐Ÿ“ฑ The robotsTxt Module: The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) analyzes cross-domain permissions to see how a site interacts with partners. ๐Ÿค–๐Ÿค #### โ“ Frequently Asked Questions about Website Metadata Extractor(sitemap, socialLinks, robotsTxt) ๐Ÿ™‹โ€โ™‚๏ธ Does Website Metadata Extractor(sitemap, socialLinks, robotsTxt) work on SPAs? โš›๏ธ Yes! The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) is configured to handle modern JavaScript frameworks, capturing the server-side rendered (SSR) metadata that crawlers prioritize. ๐Ÿš€ Can I run the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) on thousands of URLs? ๐Ÿ”ข Absolutely. The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) is designed for bulk processing. Simply provide an array of URLs, and the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) will handle the queue. ๐Ÿญ How fresh is the data from Website Metadata Extractor(sitemap, socialLinks, robotsTxt)? โฑ๏ธ Every execution of the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) triggers a live request. There is no stale caching; you see exactly what is on the live web at that millisecond. โšก Why are socialLinks important in Website Metadata Extractor(sitemap, socialLinks, robotsTxt)? ๐Ÿ“ฑ Extracting socialLinks allows for cross-platform matching. You can connect a domain analyzed by the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) to its real-world community on social media. ๐Ÿค #### ๐Ÿงช Deep Dive: Understanding the robotsTxt Logic ๐Ÿงฌ The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) handles the complexity of the "Robots Exclusion Protocol." User-Agent Categorization: The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) splits rules into specific bots (e.g., AdsBot-Google). ๐Ÿค– Rule Aggregation: The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) identifies which paths are universally disallowed (\*). ๐Ÿšซ Crawl-Delay Parsing: If specified, the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) reports how long bots should wait between requests. โณ #### ๐Ÿ—๏ธ Future-Proofing with Website Metadata Extractor(sitemap, socialLinks, robotsTxt) ๐Ÿ”ฎ As we move forward, the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) is evolving. Upcoming updates for the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) include: AI Sentiment Analysis: Automatically categorize the "tone" of content found by Website Metadata Extractor(sitemap, socialLinks, robotsTxt). ๐Ÿ˜Š๐ŸŽญ Image Alt-Text Audit: The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) will soon identify missing accessibility tags across an entire domain. ๐Ÿ–ผ๏ธโš–๏ธ Broken Link Detection: A secondary scan mode for the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) to find 404 errors within the sitemap. ๐Ÿ”—โŒ #### ๐Ÿ‘” Conclusion: Professionalism in Data Extraction ๐Ÿ† The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) is not just a scraper; it is a gateway to high-resolution technical intelligence. ๐Ÿ’ฐ By integrating the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) into your workflow, you move from "guessing" to "knowing." ๐Ÿง ๐Ÿ“ˆ Don't let valuable domain insights slip through your fingers. Harness the power of the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) today and transform how you audit the web. Whether you need a simple title or a complex robotsTxt breakdown, the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) is your most reliable partner. ๐Ÿ‘”๐Ÿ“Š๐ŸŒ๐Ÿš€โœจ #### ๐Ÿ”ฌ Forensic Hreflang & Internationalization Auditing ๐ŸŒ One of the most critical features of the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) is its ability to map international URL structures. The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) parses link rel="alternate" tags to identify how a site targets different languages and regions. ๐Ÿ—บ๏ธ๐ŸŒ ##### ๐Ÿงฌ The Multi-Market Blueprint When you execute the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) on global giants like Shopify or Wix, the tool extracts: Locale Targeting: See exactly which ISO language and country codes (e.g., es-MX, zh-Hant-TW) the site is targeting using Website Metadata Extractor(sitemap, socialLinks, robotsTxt). ๐Ÿฎ Canonical Sync: The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) verifies if the localized versions point back to the correct global master page. ๐Ÿ”— Market Expansion Gaps: By comparing the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) output of two competitors, you can identify regions where your rival has localized their content but you haven't. ๐Ÿ“Š๐ŸŽฏ #### ๐Ÿ“Š Deep Metadata Performance Matrix โš–๏ธ This table highlights how the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) empowers different professional roles. | Professional Role ๐Ÿ‘” | Primary Module Used ๐Ÿ› ๏ธ | Strategic Value of Website Metadata Extractor (sitemap, socialLinks, robotsTxt) ๐Ÿ’Ž | | ------------------------ | -------------------------------- | -------------------------------------------------------------------------------------- | | **SEO Strategist** | `metaTags`, `sitemap` | Identify missing keywords, broken metadata, and unindexed pages to improve rankings ๐Ÿ“ˆ | | **Technical Auditor** | `robotsTxt`, `jsonLd` | Ensure search engine bots are not blocked from critical content or schema ๐Ÿšซ | | **Social Media Manager** | `socialLinks`, `Open Graph (OG)` | Audit brand consistency and preview accuracy across all public social handles ๐Ÿ“ฑ | | **Security Analyst** | Technology Fingerprinting | Detect outdated CMS, plugins, or frameworks that may expose vulnerabilities ๐Ÿ›ก๏ธ | | **Content Creator** | `wordCount`, `Headers (H1โ€“H3)` | Reverse-engineer content depth and structure of top-ranking competitors โœ๏ธ | | **Growth Hacker** | Domain Intelligence | Build targeted lead lists based on tech-stack usage and platform adoption ๐Ÿ’ธ | #### ๐Ÿ—๏ธ Architectural Fingerprinting: The Tech-Stack Module ๐Ÿ’ป The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) acts as a digital X-ray machine. ๐Ÿฆด By analyzing scripts and meta generators, the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) can tell you: CMS Detection: Is the site built on Shopify, WordPress, or Wix? The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) knows. ๐Ÿข Framework Analysis: The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) detects if a site is using modern frontend libraries like React, Vue.js, or Next.js. โš›๏ธ Analytics Footprinting: Identify if a competitor is using Hotjar, Google Analytics 4, or Facebook Pixel via the Website Metadata Extractor(sitemap, socialLinks, robotsTxt). ๐Ÿ•ต๏ธโ€โ™‚๏ธ๐Ÿ“ˆ ##### ๐Ÿ›ก๏ธ Pro-Level Stealth: Bypassing Advanced Firewall Logic ๐Ÿงฅ Standard scrapers get blocked; the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) stays invisible. ๐Ÿฐ๐Ÿ›ก๏ธ ##### ๐Ÿงค TLS/SSL Fingerprint Mimicry The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) uses advanced libraries to spoof the "Handshake" of a modern Chrome browser. To the websiteโ€™s server, the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) request looks like a real person visiting from a Windows or macOS laptop. ๐Ÿงฅ๐Ÿ“ฑ ##### โณ Behavioral Jittering The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) introduces randomized millisecond delays between the robotsTxt fetch and the sitemap crawl. This "human-like" delay prevents triggering "Rate Limit" protections on security-heavy sites. ๐Ÿšถโ€โ™‚๏ธ๐Ÿ›ก๏ธ #### ๐Ÿ“ˆ Leveraging JSON-LD for Competitive Content Strategy ๐Ÿงฑ Structured data (JSON-LD) is the language of modern SEO. The Website Metadata Extractor(sitemap, socialLinks, robotsTxt) extracts these blocks in their raw format: FAQPage Schema: Extract the exact questions and answers your competitors are using to win "Featured Snippets" with Website Metadata Extractor(sitemap, socialLinks, robotsTxt). ๐Ÿ’ฌโœจ Organization Schema: Get verified corporate addresses and contact points via Website Metadata Extractor(sitemap, socialLinks, robotsTxt). ๐Ÿข๐Ÿ“ Product Schema: If scraping e-commerce, the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) can pull pricing and availability schemas (where public). ๐Ÿ›๏ธ๐Ÿ’ฐ ##### ๐Ÿข Enterprise Scaling & Automation Pipelines ๐Ÿญ For big data projects, the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) is built to be a cog in a much larger machine. ๐Ÿ“ˆโšก #### ๐Ÿ“ก Automated Event Triggers You can set up a "Watchdog" system using the Website Metadata Extractor(sitemap, socialLinks, robotsTxt): Trigger: Set the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) to run every Sunday night. Action: Compare the current sitemap count with last week. If the count dropped by 20%, send an emergency Slack alert. ๐Ÿšจ๐Ÿ“ก Result: Catch de-indexing issues before they impact your revenue! ๐Ÿ“‰โœ… #### ๐Ÿ“ฅ Ready to Start Your First Audit? ๐Ÿš€ Join thousands of elite SEOs and developers who rely on the Website Metadata Extractor(sitemap, socialLinks, robotsTxt). ๐Ÿ’ผ Click "Run," enter your target domain, and let the Website Metadata Extractor(sitemap, socialLinks, robotsTxt) reveal the hidden architecture of the internet. ๐ŸŒŠ๐Ÿ”ฅ Happy Scraping with Website Metadata Extractor(sitemap, socialLinks, robotsTxt)! ๐Ÿ•ต๏ธโ€โ™‚๏ธ๐Ÿš€๐Ÿ”ฅโœจ # Actor input Schema ## `url` (type: `string`): The base URL of the website to find sitemaps for. ## `findAll` (type: `boolean`): If true, the actor will recursively extract sitemaps from sitemap indexes. ## `skipVerification` (type: `boolean`): If true, SSL verification will be skipped for requests. ## `timeout` (type: `integer`): Timeout for each HTTP request in seconds. ## `verboseLog` (type: `boolean`): If true, emits more detailed logs. ## `maxConcurrency` (type: `integer`): Maximum number of concurrent HTTP requests. ## Actor input object example ```json { "url": "https://insly.com", "findAll": true, "skipVerification": false, "timeout": 5, "verboseLog": false, "maxConcurrency": 10 } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "url": "https://insly.com" }; // Run the Actor and wait for it to finish const run = await client.actor("scrapers-hub/find-sitemap-from-url").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "url": "https://insly.com" } # Run the Actor and wait for it to finish run = client.actor("scrapers-hub/find-sitemap-from-url").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "url": "https://insly.com" }' | apify call scrapers-hub/find-sitemap-from-url --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=scrapers-hub/find-sitemap-from-url", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Find Sitemap From Url", "description": "๐Ÿ”Ž Find Sitemap From Url tool instantly locates a websiteโ€™s sitemap from its URL, helping you discover indexable pages faster. โšก Perfect for SEO audits, crawling, indexing analysis & link research. ๐Ÿš€ Boost efficiency with accurate sitemap detection.", "version": "0.1", "x-build-id": "3jdpPeEuGkbdUFPeh" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/scrapers-hub~find-sitemap-from-url/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-scrapers-hub-find-sitemap-from-url", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/scrapers-hub~find-sitemap-from-url/runs": { "post": { "operationId": "runs-sync-scrapers-hub-find-sitemap-from-url", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/scrapers-hub~find-sitemap-from-url/run-sync": { "post": { "operationId": "run-sync-scrapers-hub-find-sitemap-from-url", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "url" ], "properties": { "url": { "title": "Website URL", "type": "string", "description": "The base URL of the website to find sitemaps for." }, "findAll": { "title": "Find all sitemaps", "type": "boolean", "description": "If true, the actor will recursively extract sitemaps from sitemap indexes.", "default": true }, "skipVerification": { "title": "Skip verification", "type": "boolean", "description": "If true, SSL verification will be skipped for requests.", "default": false }, "timeout": { "title": "Request timeout", "minimum": 1, "type": "integer", "description": "Timeout for each HTTP request in seconds.", "default": 5 }, "verboseLog": { "title": "Verbose logging", "type": "boolean", "description": "If true, emits more detailed logs.", "default": false }, "maxConcurrency": { "title": "Max concurrency", "minimum": 1, "maximum": 50, "type": "integer", "description": "Maximum number of concurrent HTTP requests.", "default": 10 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```