Site Files Exporter

Pricing

from $0.01 / 1,000 results

Site Files Exporter

Site Files Exporter deep-crawls provided start URLs, filters out unwanted links, downloads matching documents to organized folders, and logs outcomes and metadata so you can quickly collect site files at scale.

Pricing

from $0.01 / 1,000 results

Rating

0.0

(0)

Developer

Youssef Benhammouda

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

12 days ago

Last modified

Categories

Automation

Developer tools

Other

You can access the Site Files Exporter programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

{
  "openapi": "3.0.1",
  "info": {
    "version": "0.0",
    "x-build-id": "uEsjIcL7FnpN8YVxd"
  },
  "servers": [
    {
      "url": "https://api.apify.com/v2"
    }
  ],
  "paths": {
    "/acts/youssefb~site-files-exporter/run-sync-get-dataset-items": {
      "post": {
        "operationId": "run-sync-get-dataset-items-youssefb-site-files-exporter",
        "x-openai-isConsequential": false,
        "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
        "tags": [
          "Run Actor"
        ],
        "requestBody": {
          "required": true,
          "content": {
            "application/json": {
              "schema": {
                "$ref": "#/components/schemas/inputSchema"
              }
            }
          }
        },
        "parameters": [
          {
            "name": "token",
            "in": "query",
            "required": true,
            "schema": {
              "type": "string"
            },
            "description": "Enter your Apify token here"
          }
        ],
        "responses": {
          "200": {
            "description": "OK"
          }
        }
      }
    },
    "/acts/youssefb~site-files-exporter/runs": {
      "post": {
        "operationId": "runs-sync-youssefb-site-files-exporter",
        "x-openai-isConsequential": false,
        "summary": "Executes an Actor and returns information about the initiated run in response.",
        "tags": [
          "Run Actor"
        ],
        "requestBody": {
          "required": true,
          "content": {
            "application/json": {
              "schema": {
                "$ref": "#/components/schemas/inputSchema"
              }
            }
          }
        },
        "parameters": [
          {
            "name": "token",
            "in": "query",
            "required": true,
            "schema": {
              "type": "string"
            },
            "description": "Enter your Apify token here"
          }
        ],
        "responses": {
          "200": {
            "description": "OK",
            "content": {
              "application/json": {
                "schema": {
                  "$ref": "#/components/schemas/runsResponseSchema"
                }
              }
            }
          }
        }
      }
    },
    "/acts/youssefb~site-files-exporter/run-sync": {
      "post": {
        "operationId": "run-sync-youssefb-site-files-exporter",
        "x-openai-isConsequential": false,
        "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
        "tags": [
          "Run Actor"
        ],
        "requestBody": {
          "required": true,
          "content": {
            "application/json": {
              "schema": {
                "$ref": "#/components/schemas/inputSchema"
              }
            }
          }
        },
        "parameters": [
          {
            "name": "token",
            "in": "query",
            "required": true,
            "schema": {
              "type": "string"
            },
            "description": "Enter your Apify token here"
          }
        ],
        "responses": {
          "200": {
            "description": "OK"
          }
        }
      }
    }
  },
  "components": {
    "schemas": {
      "inputSchema": {
        "type": "object",
        "required": [
          "start_urls"
        ],
        "properties": {
          "start_urls": {
            "title": "Start URLs",
            "type": "array",
            "description": "URLs to start with",
            "items": {
              "type": "object",
              "required": [
                "url"
              ],
              "properties": {
                "url": {
                  "type": "string",
                  "title": "URL of a web page",
                  "format": "uri"
                }
              }
            }
          },
          "download_regex": {
            "title": "Download Regex",
            "type": "string",
            "description": "Regex to decide which links count as downloadable files (case-insensitive)",
            "default": ""
          },
          "download_timeout_ms": {
            "title": "Download Timeout (ms)",
            "minimum": 1000,
            "type": "integer",
            "description": "Timeout for individual file downloads in milliseconds",
            "default": 60000
          },
          "file_extensions": {
            "title": "File Extensions",
            "type": "array",
            "description": "File extensions to download when regex is not matched",
            "items": {
              "type": "string"
            },
            "default": [
              "pdf",
              "zip",
              "doc",
              "docx"
            ]
          },
          "max_files": {
            "title": "Max Files",
            "minimum": 0,
            "type": "integer",
            "description": "Maximum number of files to download (0 = unlimited)",
            "default": 5
          },
          "min_delay_ms": {
            "title": "Min Delay (ms)",
            "minimum": 0,
            "type": "integer",
            "description": "Minimum delay between file downloads in milliseconds",
            "default": 0
          },
          "max_delay_ms": {
            "title": "Max Delay (ms)",
            "minimum": 0,
            "type": "integer",
            "description": "Maximum delay between file downloads in milliseconds",
            "default": 500
          },
          "ignore_base_patterns": {
            "title": "Base Ignore Patterns",
            "type": "array",
            "description": "Regex patterns skipped for every link (login/logout/mailto/tel/javascript by default)",
            "items": {
              "type": "string"
            },
            "default": [
              "login",
              "logout",
              "signout",
              "javascript:",
              "mailto:",
              "tel:",
              "data:",
              "blob:",
              "/wp-json(?:/|$)",
              "/wp-admin/admin-ajax\\.php",
              "/wp-admin/admin-post\\.php",
              "\\.xmlrpc",
              "/feed/?$",
              "/rss/?$",
              "\\.(?:css|js|png|jpe?g|gif|svg|ico|webp|bmp|tiff?|woff2?|woff|ttf|eot|otf|map|json|xml)(?:$|\\?)"
            ]
          },
          "ignore_patterns": {
            "title": "Ignore Patterns",
            "type": "array",
            "description": "Additional regex patterns to skip alongside the base ignore list",
            "items": {
              "type": "string"
            },
            "default": []
          },
          "cookies": {
            "title": "Cookies",
            "type": "array",
            "description": "Cookies to add to the browser context (Playwright add_cookies format)",
            "items": {
              "type": "object"
            },
            "default": []
          },
          "headless": {
            "title": "Headless",
            "type": "boolean",
            "description": "Run browser in headless mode",
            "default": false
          }
        }
      },
      "runsResponseSchema": {
        "type": "object",
        "properties": {
          "data": {
            "type": "object",
            "properties": {
              "id": {
                "type": "string"
              },
              "actId": {
                "type": "string"
              },
              "userId": {
                "type": "string"
              },
              "startedAt": {
                "type": "string",
                "format": "date-time",
                "example": "2025-01-08T00:00:00.000Z"
              },
              "finishedAt": {
                "type": "string",
                "format": "date-time",
                "example": "2025-01-08T00:00:00.000Z"
              },
              "status": {
                "type": "string",
                "example": "READY"
              },
              "meta": {
                "type": "object",
                "properties": {
                  "origin": {
                    "type": "string",
                    "example": "API"
                  },
                  "userAgent": {
                    "type": "string"
                  }
                }
              },
              "stats": {
                "type": "object",
                "properties": {
                  "inputBodyLen": {
                    "type": "integer",
                    "example": 2000
                  },
                  "rebootCount": {
                    "type": "integer",
                    "example": 0
                  },
                  "restartCount": {
                    "type": "integer",
                    "example": 0
                  },
                  "resurrectCount": {
                    "type": "integer",
                    "example": 0
                  },
                  "computeUnits": {
                    "type": "integer",
                    "example": 0
                  }
                }
              },
              "options": {
                "type": "object",
                "properties": {
                  "build": {
                    "type": "string",
                    "example": "latest"
                  },
                  "timeoutSecs": {
                    "type": "integer",
                    "example": 300
                  },
                  "memoryMbytes": {
                    "type": "integer",
                    "example": 1024
                  },
                  "diskMbytes": {
                    "type": "integer",
                    "example": 2048
                  }
                }
              },
              "buildId": {
                "type": "string"
              },
              "defaultKeyValueStoreId": {
                "type": "string"
              },
              "defaultDatasetId": {
                "type": "string"
              },
              "defaultRequestQueueId": {
                "type": "string"
              },
              "buildNumber": {
                "type": "string",
                "example": "1.0.0"
              },
              "containerUrl": {
                "type": "string"
              },
              "usage": {
                "type": "object",
                "properties": {
                  "ACTOR_COMPUTE_UNITS": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATASET_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATASET_WRITES": {
                    "type": "integer",
                    "example": 0
                  },
                  "KEY_VALUE_STORE_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "KEY_VALUE_STORE_WRITES": {
                    "type": "integer",
                    "example": 1
                  },
                  "KEY_VALUE_STORE_LISTS": {
                    "type": "integer",
                    "example": 0
                  },
                  "REQUEST_QUEUE_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "REQUEST_QUEUE_WRITES": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATA_TRANSFER_INTERNAL_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "PROXY_SERPS": {
                    "type": "integer",
                    "example": 0
                  }
                }
              },
              "usageTotalUsd": {
                "type": "number",
                "example": 0.00005
              },
              "usageUsd": {
                "type": "object",
                "properties": {
                  "ACTOR_COMPUTE_UNITS": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATASET_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATASET_WRITES": {
                    "type": "integer",
                    "example": 0
                  },
                  "KEY_VALUE_STORE_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "KEY_VALUE_STORE_WRITES": {
                    "type": "number",
                    "example": 0.00005
                  },
                  "KEY_VALUE_STORE_LISTS": {
                    "type": "integer",
                    "example": 0
                  },
                  "REQUEST_QUEUE_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "REQUEST_QUEUE_WRITES": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATA_TRANSFER_INTERNAL_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "PROXY_SERPS": {
                    "type": "integer",
                    "example": 0
                  }
                }
              }
            }
          }
        }
      }
    }
  }
}

Site Files Exporter OpenAPI definition

OpenAPI is a standard for designing and describing RESTful APIs, allowing developers to define API structure, endpoints, and data formats in a machine-readable way. It simplifies API development, integration, and documentation.

OpenAPI is effective when used with AI agents and GPTs by standardizing how these systems interact with various APIs, for reliable integrations and efficient communication.

By defining machine-readable API specifications, OpenAPI allows AI models like GPTs to understand and use varied data sources, improving accuracy. This accelerates development, reduces errors, and provides context-aware responses, making OpenAPI a core component for AI applications.

You can download the OpenAPI definitions for Site Files Exporter from the options below:

OpenAPI.json

If you’d like to learn more about how OpenAPI powers GPTs, read our blog post.

You can also check out our other API clients:

Site Files Exporter API in Python

Site Files Exporter API in JavaScript

Site Files Exporter API through CLI

Site Files Exporter API

What Site

maged120/what-site

simple site lookup for title and description of any site

Maged

5.0

Shopify Products Exporter

technicaldost/shopify-products-exporter

Technical Dost Solutions

Multi site hotel scraper

accomplished_yapok/my-actor

Kween Ash

Apk Scraper

thenetaji/apk-downloader

📱 Find and extract direct download links for APK files from websites. Also discovers other downloadable content like videos, images, and audio files. Perfect for gathering Android apps and media files from various sources.

The Netaji

5.0

Website Recovery Actor

fiery_dream/website-recovery-actor

Recover and reverse-engineer website files from a live or deployed site. This actor downloads the complete website including HTML, CSS, JavaScript, images, fonts, and all other assets, then rewrites URLs so everything works locally.

Cody Churchwell

Google Sheet Exporter

jupri/google-sheet-exporter

💫 Export Dataset to GoogleSheet

cat

644

3.8

Unlimited Torrent Downloader

epctex/torrent-downloader

Seamlessly download and seed unlimited files from any Torrent website with no restrictions. Access Magnet, HTTP, and HTTPS files without any blocks and effortlessly seed the files for optimal performance.

epctex

337

4.6

Site Health Scanner

constant_quadruped/site-health-scanner

Crawl a website to detect broken and problematic links, identify redirects and blocked URLs, capture screenshots, and return structured site health data for audits, automation, and monitoring.

Quadruped

Site Lens – Website Homepage Analyzer & Design Inspector

koushikbiswas/site-lens---website-homepage-analyzer-design-inspector

Site Lens analyzes any website and extracts navigation pages, contact details, social profiles, fonts, colors, text content, and full-page screenshots. Get a clean, structured overview of a site’s design, structure, and touchpoints in seconds.