Standby Python project
Template with basic structure for an Actor using Standby mode that allows you to easily add your own functionality.
src/main.py
src/__main__.py
1"""This module defines the main entry point for the Apify Actor.
2
3Feel free to modify this file to suit your specific needs.
4
5To build Apify Actors, utilize the Apify SDK toolkit, read more at the official documentation:
6https://docs.apify.com/sdk/python
7"""
8
9from http.server import HTTPServer, SimpleHTTPRequestHandler
10
11from apify import Actor
12
13
14class GetHandler(SimpleHTTPRequestHandler):
15 """A simple GET HTTP handler that will respond with a message."""
16
17 def do_GET(self) -> None:
18 self.send_response(200)
19 self.end_headers()
20 self.wfile.write(b'Hello from Actor Standby!')
21
22
23async def main() -> None:
24 """Main entry point for the Apify Actor.
25
26 This coroutine is executed using `asyncio.run()`, so it must remain an asynchronous function for proper execution.
27 Asynchronous execution is required for communication with Apify platform, and it also enhances performance in
28 the field of web scraping significantly.
29 """
30 async with Actor:
31 # A simple HTTP server listening on Actor standby port.
32 with HTTPServer(('', Actor.config.standby_port), GetHandler) as http_server:
33 http_server.serve_forever()
Python standby template
Start a new web scraping project quickly and easily in Python with our Standby project template. It provides a basic structure for the Actor with Apify SDK and allows you to easily add your own functionality.
Included features
Resources
This example Scrapy spider scrapes page titles from URLs defined in input parameter. It shows how to use Apify SDK for Python and Scrapy pipelines to save results.
Scrape single page with provided URL with HTTPX and extract data from page's HTML with Beautiful Soup.
Example of a web scraper that uses Python HTTPX to scrape HTML from URLs provided on input, parses it using BeautifulSoup and saves results to storage.
Crawler example that uses headless Chrome driven by Playwright to scrape a website. Headless browsers render JavaScript and can help when getting blocked.
Scraper example built with Selenium and headless Chrome browser to scrape a website and save the results to storage. A popular alternative to Playwright.
Empty template with basic structure for the Actor with Apify SDK that allows you to easily add your own functionality.