Standby Python project
Template with basic structure for an Actor using Standby mode that allows you to easily add your own functionality.
src/main.py
src/__main__.py
1"""
2This module defines the `main()` coroutine for the Apify Actor, executed from the `__main__.py` file.
3
4Feel free to modify this file to suit your specific needs.
5
6To build Apify Actors, utilize the Apify SDK toolkit, read more at the official documentation:
7https://docs.apify.com/sdk/python
8"""
9
10from http.server import HTTPServer, SimpleHTTPRequestHandler
11from apify import Actor
12
13class GetHandler(SimpleHTTPRequestHandler):
14 """A simple GET HTTP handler that will respond with a message."""
15 def do_GET(self):
16 self.send_response(200)
17 self.end_headers()
18 self.wfile.write(b'Hello from Actor Standby!')
19
20
21async def main() -> None:
22 """
23 The main coroutine is being executed using `asyncio.run()`, so do not attempt to make a normal function
24 out of it, it will not work. Asynchronous execution is required for communication with Apify platform,
25 and it also enhances performance in the field of web scraping significantly.
26 """
27 async with Actor:
28 # A simple HTTP server listening on Actor Standby port
29 with HTTPServer(('', Actor.config.standby_port), GetHandler) as http_server:
30 http_server.serve_forever()
Empty Python template
Start a new web scraping project quickly and easily in Python with our Standby project template. It provides a basic structure for the Actor with Apify SDK and allows you to easily add your own functionality.
Included features
Resources
This example Scrapy spider scrapes page titles from URLs defined in input parameter. It shows how to use Apify SDK for Python and Scrapy pipelines to save results.
Scrape single page with provided URL with HTTPX and extract data from page's HTML with Beautiful Soup.
Example of a web scraper that uses Python HTTPX to scrape HTML from URLs provided on input, parses it using BeautifulSoup and saves results to storage.
Crawler example that uses headless Chrome driven by Playwright to scrape a website. Headless browsers render JavaScript and can help when getting blocked.
Scraper example built with Selenium and headless Chrome browser to scrape a website and save the results to storage. A popular alternative to Playwright.
Empty template with basic structure for the Actor with Apify SDK that allows you to easily add your own functionality.