Python web scraping templates

Build scrapers quickly with templates for Requests, Beautiful Soup, Scrapy, Playwright, and Selenium

Python templates

Start with Python

Scrape single page with provided URL with Requests and extract data from page's HTML with Beautiful Soup.

Starter

BeautifulSoup + Requests

Example of a web scraper that uses Python Requests to scrape HTML from URLs provided on input, parses it using BeautifulSoup and saves results to storage.

Playwright + Chrome

Crawler example that uses headless Chrome driven by Playwright to scrape a website. Headless browsers render JavaScript and can help when getting blocked.

Selenium + Chrome

Scraper example built with Selenium and headless Chrome browser to scrape a website and save the results to storage. A popular alternative to Playwright.

Scrapy

This example Scrapy spider scrapes page titles from URLs defined in input parameter. It shows how to use Apify SDK for Python and Scrapy pipelines to save results.

Empty Python project

Empty template with basic structure for the Actor with Apify SDK that allows you to easily add your own functionality.

Apify Universal Scrapers

Universal Scrapers provide you with a solid boilerplate to build fully functioning scrapers directly on the Apify platform. Configure and run your web scrapers manually in a user interface or programmatically via an API.

Already have your own solution?

Sign up for a free Apify account and deploy your code to the platform in just a few minutes! If you need help deploying your code, check out our documentation.

Import your code Check Apify docs