My Actor 29

Pricing

Pay per usage

Try for free

Go to Apify Store

My Actor 29

Try for free

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Kateřina Hroníková

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

10 months ago

Last modified

.actor/Dockerfile

# First, specify the base Docker image.
# You can see the Docker images from Apify at https://hub.docker.com/r/apify/.
# You can also use any other image from Docker Hub.
FROM apify/actor-python:3.13

# Second, copy just requirements.txt into the Actor image,
# since it should be the only file that affects the dependency install in the next step,
# in order to speed up the build
COPY requirements.txt ./

# Install the packages specified in requirements.txt,
# Print the installed Python version, pip version
# and all installed packages with their versions for debugging
RUN echo "Python version:" \
 && python --version \
 && echo "Pip version:" \
 && pip --version \
 && echo "Installing dependencies:" \
 && pip install -r requirements.txt \
 && echo "All installed Python packages:" \
 && pip freeze

# Next, copy the remaining files and directories with the source code.
# Since we do this after installing the dependencies, quick build will be really fast
# for most source file changes.
COPY . ./

# Use compileall to ensure the runnability of the Actor Python code.
RUN python3 -m compileall -q .

# Specify how to launch the source code of your Actor.
# By default, the "python3 -m src" command is run
CMD ["python3", "-m", "src"]

.actor/actor.json

{
    "actorSpecification": 1,
    "name": "my-actor-29",
    "title": "Scrape single page in Python",
    "description": "Scrape data from single page with provided URL.",
    "version": "0.0",
    "buildTag": "latest",
    "meta": {
        "templateId": "python-start"
    },
    "input": "./input_schema.json",
    "dockerfile": "./Dockerfile"
}

.actor/input_schema.json

{
    "title": "Scrape data from a web page",
    "type": "object",
    "schemaVersion": 1,
    "properties": {
        "url": {
            "title": "URL of the page",
            "type": "string",
            "description": "The URL of website you want to get the data from.",
            "editor": "textfield",
            "prefill": "https://www.python.org/events/",
            "default": "https://www.python.org/events/"
        }
    },
    "required": ["url"]
}

src/init.py

src/main.py

1import asyncio
2
3from .main import main
4
5# Execute the Actor entry point.
6asyncio.run(main())

src/main.py

1"""This module defines the main entry point for the Apify Actor.
2
3Feel free to modify this file to suit your specific needs.
4
5To build Apify Actors, utilize the Apify SDK toolkit, read more at the official documentation:
6https://docs.apify.com/sdk/python
7"""
8
9# Beautiful Soup - A library for pulling data out of HTML and XML files. Read more at:
10# https://www.crummy.com/software/BeautifulSoup/bs4/doc
11# Apify SDK - A toolkit for building Apify Actors. Read more at:
12# https://docs.apify.com/sdk/python
13from apify import Actor
14from bs4 import BeautifulSoup
15
16# HTTPX - A library for making asynchronous HTTP requests in Python. Read more at:
17# https://www.python-httpx.org/
18from httpx import AsyncClient
19
20
21async def main() -> None:
22    """Main entry point for the Apify Actor.
23
24    This coroutine is executed using `asyncio.run()`, so it must remain an asynchronous function for proper execution.
25    Asynchronous execution is required for communication with Apify platform, and it also enhances performance in
26    the field of web scraping significantly.
27    """
28    async with Actor:
29        # Retrieve the input object for the Actor. The structure of input is defined in input_schema.json.
30        actor_input = await Actor.get_input() or {'url': 'https://www.python.org/events/'}
31        url = actor_input.get('url')
32
33        # Create an asynchronous HTTPX client for making HTTP requests.
34        async with AsyncClient() as client:
35            # Fetch the HTML content of the page, following redirects if necessary.
36            Actor.log.info(f'Sending a request to {url}')
37            response = await client.get(url, follow_redirects=True)
38
39        # Defines a function to extract event details from the HTML response.
40        def extract_event_data(html):
41            # Parses the HTML using BeautifulSoup.
42            soup = BeautifulSoup(html, 'html.parser')
43            # Initializes an empty events list and sets a baseUrl for constructing full URLs.
44            events = []
45            baseUrl = 'https://www.python.org'
46            
47            # Finds all <li> elements inside .list-recent-events.menu
48            for event in soup.select('.list-recent-events.menu li'):
49                # Extract the event title <a> element.
50                title_tag = event.select_one('.event-title a')
51                # Extract the event date inside a <time> tag.
52                date_tag = event.select_one('time')
53                # Extract the event location.
54                location_tag = event.select_one('.event-location')
55                
56                # Extracts text values and ensures they have default values ('N/A' if missing).
57                title = title_tag.get_text(strip=True) if title_tag else 'N/A'
58                url = title_tag['href'] if title_tag and 'href' in title_tag.attrs else 'N/A'
59                date = date_tag.get_text(separator=' ', strip=True) if date_tag else 'N/A'
60                location = location_tag.get_text(strip=True) if location_tag else 'N/A'
61                # Constructs the full event URL by appending the relative href to baseUrl.
62                fullUrl = f"{baseUrl}{url}" if url else 'N/A'
63                
64                # Adds the extracted data into the events list.
65                events.append({
66                    'title': title,
67                    'url': fullUrl,
68                    'date': date,
69                    'location': location
70                })
71            
72            return events
73 
74        # Calls the extract_event_data() function with the page’s HTML content.
75        events = extract_event_data(response.content)
76
77        # Saves the extracted event data to Apify’s dataset storage (like a database for structured data).
78        await Actor.push_data(events)

src/py.typed

.dockerignore

.git
.mise.toml
.nvim.lua
storage

# The rest is copied from https://github.com/github/gitignore/blob/main/Python.gitignore

# Byte-compiled / optimized / DLL files
__pycache__/
*.py[cod]
*$py.class

# C extensions
*.so

# Distribution / packaging
.Python
build/
develop-eggs/
dist/
downloads/
eggs/
.eggs/
lib/
lib64/
parts/
sdist/
var/
wheels/
share/python-wheels/
*.egg-info/
.installed.cfg
*.egg
MANIFEST

# PyInstaller
#  Usually these files are written by a python script from a template
#  before PyInstaller builds the exe, so as to inject date/other infos into it.
*.manifest
*.spec

# Installer logs
pip-log.txt
pip-delete-this-directory.txt

# Unit test / coverage reports
htmlcov/
.tox/
.nox/
.coverage
.coverage.*
.cache
nosetests.xml
coverage.xml
*.cover
*.py,cover
.hypothesis/
.pytest_cache/
cover/

# Translations
*.mo
*.pot

# Django stuff:
*.log
local_settings.py
db.sqlite3
db.sqlite3-journal

# Flask stuff:
instance/
.webassets-cache

# Scrapy stuff:
.scrapy

# Sphinx documentation
docs/_build/

# PyBuilder
.pybuilder/
target/

# Jupyter Notebook
.ipynb_checkpoints

# IPython
profile_default/
ipython_config.py

# pyenv
#   For a library or package, you might want to ignore these files since the code is
#   intended to run in multiple environments; otherwise, check them in:
.python-version

# pdm
#   Similar to Pipfile.lock, it is generally recommended to include pdm.lock in version control.
#pdm.lock
#   pdm stores project-wide configurations in .pdm.toml, but it is recommended to not include it
#   in version control.
#   https://pdm.fming.dev/latest/usage/project/#working-with-version-control
.pdm.toml
.pdm-python
.pdm-build/

# PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm
__pypackages__/

# Celery stuff
celerybeat-schedule
celerybeat.pid

# SageMath parsed files
*.sage.py

# Environments
.env
.venv
env/
venv/
ENV/
env.bak/
venv.bak/

# Spyder project settings
.spyderproject
.spyproject

# Rope project settings
.ropeproject

# mkdocs documentation
/site

# mypy
.mypy_cache/
.dmypy.json
dmypy.json

# Pyre type checker
.pyre/

# pytype static type analyzer
.pytype/

# Cython debug symbols
cython_debug/

# PyCharm
#  JetBrains specific template is maintained in a separate JetBrains.gitignore that can
#  be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
#  and can be added to the global gitignore or merged into this file.  For a more nuclear
#  option (not recommended) you can uncomment the following to ignore the entire idea folder.
.idea/

.gitignore

.mise.toml
.nvim.lua
storage

# The rest is copied from https://github.com/github/gitignore/blob/main/Python.gitignore

# Byte-compiled / optimized / DLL files
__pycache__/
*.py[cod]
*$py.class

# C extensions
*.so

# Distribution / packaging
.Python
build/
develop-eggs/
dist/
downloads/
eggs/
.eggs/
lib/
lib64/
parts/
sdist/
var/
wheels/
share/python-wheels/
*.egg-info/
.installed.cfg
*.egg
MANIFEST

# PyInstaller
#  Usually these files are written by a python script from a template
#  before PyInstaller builds the exe, so as to inject date/other infos into it.
*.manifest
*.spec

# Installer logs
pip-log.txt
pip-delete-this-directory.txt

# Unit test / coverage reports
htmlcov/
.tox/
.nox/
.coverage
.coverage.*
.cache
nosetests.xml
coverage.xml
*.cover
*.py,cover
.hypothesis/
.pytest_cache/
cover/

# Translations
*.mo
*.pot

# Django stuff:
*.log
local_settings.py
db.sqlite3
db.sqlite3-journal

# Flask stuff:
instance/
.webassets-cache

# Scrapy stuff:
.scrapy

# Sphinx documentation
docs/_build/

# PyBuilder
.pybuilder/
target/

# Jupyter Notebook
.ipynb_checkpoints

# IPython
profile_default/
ipython_config.py

# pyenv
#   For a library or package, you might want to ignore these files since the code is
#   intended to run in multiple environments; otherwise, check them in:
.python-version

# pdm
#   Similar to Pipfile.lock, it is generally recommended to include pdm.lock in version control.
#pdm.lock
#   pdm stores project-wide configurations in .pdm.toml, but it is recommended to not include it
#   in version control.
#   https://pdm.fming.dev/latest/usage/project/#working-with-version-control
.pdm.toml
.pdm-python
.pdm-build/

# PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm
__pypackages__/

# Celery stuff
celerybeat-schedule
celerybeat.pid

# SageMath parsed files
*.sage.py

# Environments
.env
.venv
env/
venv/
ENV/
env.bak/
venv.bak/

# Spyder project settings
.spyderproject
.spyproject

# Rope project settings
.ropeproject

# mkdocs documentation
/site

# mypy
.mypy_cache/
.dmypy.json
dmypy.json

# Pyre type checker
.pyre/

# pytype static type analyzer
.pytype/

# Cython debug symbols
cython_debug/

# PyCharm
#  JetBrains specific template is maintained in a separate JetBrains.gitignore that can
#  be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
#  and can be added to the global gitignore or merged into this file.  For a more nuclear
#  option (not recommended) you can uncomment the following to ignore the entire idea folder.
.idea/

requirements.txt

1# Feel free to add your Python dependencies below. For formatting guidelines, see:
2# https://pip.pypa.io/en/latest/reference/requirements-file-format/
3
4apify < 3.0
5beautifulsoup4[lxml]
6httpx
7types-beautifulsoup4

My Actor

bedazzled_insanity/my-actor

k v

My Actor

oh_shit_here_we_go_again/my-actor

bandi

My Actor

bigtreemin/my-actor

Min Zhou

My Actor

lurid_quadrille/my-actor

Hari Hari

My Actor

serper/my-actor

Serper

My Actor

open_ai/my-actor

OpenAi

My Actor

prospeo/my-actor

Prospeo

My Actor

radiant_notation/my-actor

Saif Reda

My Actor

storeleads/my-actor

Storeleads

My Actor

flow_matic/my-actor

Flow Matic

# First, specify the base Docker image. # You can see the Docker images from Apify at https://hub.docker.com/r/apify/. # You can also use any other image from Docker Hub. FROM apify/actor-python:3.13 # Second, copy just requirements.txt into the Actor image, # since it should be the only file that affects the dependency install in the next step, # in order to speed up the build COPY requirements.txt ./ # Install the packages specified in requirements.txt, # Print the installed Python version, pip version # and all installed packages with their versions for debugging RUN echo "Python version:" \ && python --version \ && echo "Pip version:" \ && pip --version \ && echo "Installing dependencies:" \ && pip install -r requirements.txt \ && echo "All installed Python packages:" \ && pip freeze # Next, copy the remaining files and directories with the source code. # Since we do this after installing the dependencies, quick build will be really fast # for most source file changes. COPY . ./ # Use compileall to ensure the runnability of the Actor Python code. RUN python3 -m compileall -q . # Specify how to launch the source code of your Actor. # By default, the "python3 -m src" command is run CMD ["python3", "-m", "src"]

{ "actorSpecification": 1, "name": "my-actor-29", "title": "Scrape single page in Python", "description": "Scrape data from single page with provided URL.", "version": "0.0", "buildTag": "latest", "meta": { "templateId": "python-start" }, "input": "./input_schema.json", "dockerfile": "./Dockerfile" }

{ "title": "Scrape data from a web page", "type": "object", "schemaVersion": 1, "properties": { "url": { "title": "URL of the page", "type": "string", "description": "The URL of website you want to get the data from.", "editor": "textfield", "prefill": "https://www.python.org/events/", "default": "https://www.python.org/events/" } }, "required": ["url"] }

1"""This module defines the main entry point for the Apify Actor. 2 3Feel free to modify this file to suit your specific needs. 4 5To build Apify Actors, utilize the Apify SDK toolkit, read more at the official documentation: 6https://docs.apify.com/sdk/python 7""" 8 9# Beautiful Soup - A library for pulling data out of HTML and XML files. Read more at: 10# https://www.crummy.com/software/BeautifulSoup/bs4/doc 11# Apify SDK - A toolkit for building Apify Actors. Read more at: 12# https://docs.apify.com/sdk/python 13from apify import Actor 14from bs4 import BeautifulSoup 15 16# HTTPX - A library for making asynchronous HTTP requests in Python. Read more at: 17# https://www.python-httpx.org/ 18from httpx import AsyncClient 19 20 21async def main() -> None: 22 """Main entry point for the Apify Actor. 23 24 This coroutine is executed using `asyncio.run()`, so it must remain an asynchronous function for proper execution. 25 Asynchronous execution is required for communication with Apify platform, and it also enhances performance in 26 the field of web scraping significantly. 27 """ 28 async with Actor: 29 # Retrieve the input object for the Actor. The structure of input is defined in input_schema.json. 30 actor_input = await Actor.get_input() or {'url': 'https://www.python.org/events/'} 31 url = actor_input.get('url') 32 33 # Create an asynchronous HTTPX client for making HTTP requests. 34 async with AsyncClient() as client: 35 # Fetch the HTML content of the page, following redirects if necessary. 36 Actor.log.info(f'Sending a request to {url}') 37 response = await client.get(url, follow_redirects=True) 38 39 # Defines a function to extract event details from the HTML response. 40 def extract_event_data(html): 41 # Parses the HTML using BeautifulSoup. 42 soup = BeautifulSoup(html, 'html.parser') 43 # Initializes an empty events list and sets a baseUrl for constructing full URLs. 44 events = [] 45 baseUrl = 'https://www.python.org' 46 47 # Finds all <li> elements inside .list-recent-events.menu 48 for event in soup.select('.list-recent-events.menu li'): 49 # Extract the event title <a> element. 50 title_tag = event.select_one('.event-title a') 51 # Extract the event date inside a <time> tag. 52 date_tag = event.select_one('time') 53 # Extract the event location. 54 location_tag = event.select_one('.event-location') 55 56 # Extracts text values and ensures they have default values ('N/A' if missing). 57 title = title_tag.get_text(strip=True) if title_tag else 'N/A' 58 url = title_tag['href'] if title_tag and 'href' in title_tag.attrs else 'N/A' 59 date = date_tag.get_text(separator=' ', strip=True) if date_tag else 'N/A' 60 location = location_tag.get_text(strip=True) if location_tag else 'N/A' 61 # Constructs the full event URL by appending the relative href to baseUrl. 62 fullUrl = f"{baseUrl}{url}" if url else 'N/A' 63 64 # Adds the extracted data into the events list. 65 events.append({ 66 'title': title, 67 'url': fullUrl, 68 'date': date, 69 'location': location 70 }) 71 72 return events 73 74 # Calls the extract_event_data() function with the page’s HTML content. 75 events = extract_event_data(response.content) 76 77 # Saves the extracted event data to Apify’s dataset storage (like a database for structured data). 78 await Actor.push_data(events)

.git .mise.toml .nvim.lua storage # The rest is copied from https://github.com/github/gitignore/blob/main/Python.gitignore # Byte-compiled / optimized / DLL files __pycache__/ *.py[cod] *$py.class # C extensions *.so # Distribution / packaging .Python build/ develop-eggs/ dist/ downloads/ eggs/ .eggs/ lib/ lib64/ parts/ sdist/ var/ wheels/ share/python-wheels/ *.egg-info/ .installed.cfg *.egg MANIFEST # PyInstaller # Usually these files are written by a python script from a template # before PyInstaller builds the exe, so as to inject date/other infos into it. *.manifest *.spec # Installer logs pip-log.txt pip-delete-this-directory.txt # Unit test / coverage reports htmlcov/ .tox/ .nox/ .coverage .coverage.* .cache nosetests.xml coverage.xml *.cover *.py,cover .hypothesis/ .pytest_cache/ cover/ # Translations *.mo *.pot # Django stuff: *.log local_settings.py db.sqlite3 db.sqlite3-journal # Flask stuff: instance/ .webassets-cache # Scrapy stuff: .scrapy # Sphinx documentation docs/_build/ # PyBuilder .pybuilder/ target/ # Jupyter Notebook .ipynb_checkpoints # IPython profile_default/ ipython_config.py # pyenv # For a library or package, you might want to ignore these files since the code is # intended to run in multiple environments; otherwise, check them in: .python-version # pdm # Similar to Pipfile.lock, it is generally recommended to include pdm.lock in version control. #pdm.lock # pdm stores project-wide configurations in .pdm.toml, but it is recommended to not include it # in version control. # https://pdm.fming.dev/latest/usage/project/#working-with-version-control .pdm.toml .pdm-python .pdm-build/ # PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm __pypackages__/ # Celery stuff celerybeat-schedule celerybeat.pid # SageMath parsed files *.sage.py # Environments .env .venv env/ venv/ ENV/ env.bak/ venv.bak/ # Spyder project settings .spyderproject .spyproject # Rope project settings .ropeproject # mkdocs documentation /site # mypy .mypy_cache/ .dmypy.json dmypy.json # Pyre type checker .pyre/ # pytype static type analyzer .pytype/ # Cython debug symbols cython_debug/ # PyCharm # JetBrains specific template is maintained in a separate JetBrains.gitignore that can # be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore # and can be added to the global gitignore or merged into this file. For a more nuclear # option (not recommended) you can uncomment the following to ignore the entire idea folder. .idea/

.mise.toml .nvim.lua storage # The rest is copied from https://github.com/github/gitignore/blob/main/Python.gitignore # Byte-compiled / optimized / DLL files __pycache__/ *.py[cod] *$py.class # C extensions *.so # Distribution / packaging .Python build/ develop-eggs/ dist/ downloads/ eggs/ .eggs/ lib/ lib64/ parts/ sdist/ var/ wheels/ share/python-wheels/ *.egg-info/ .installed.cfg *.egg MANIFEST # PyInstaller # Usually these files are written by a python script from a template # before PyInstaller builds the exe, so as to inject date/other infos into it. *.manifest *.spec # Installer logs pip-log.txt pip-delete-this-directory.txt # Unit test / coverage reports htmlcov/ .tox/ .nox/ .coverage .coverage.* .cache nosetests.xml coverage.xml *.cover *.py,cover .hypothesis/ .pytest_cache/ cover/ # Translations *.mo *.pot # Django stuff: *.log local_settings.py db.sqlite3 db.sqlite3-journal # Flask stuff: instance/ .webassets-cache # Scrapy stuff: .scrapy # Sphinx documentation docs/_build/ # PyBuilder .pybuilder/ target/ # Jupyter Notebook .ipynb_checkpoints # IPython profile_default/ ipython_config.py # pyenv # For a library or package, you might want to ignore these files since the code is # intended to run in multiple environments; otherwise, check them in: .python-version # pdm # Similar to Pipfile.lock, it is generally recommended to include pdm.lock in version control. #pdm.lock # pdm stores project-wide configurations in .pdm.toml, but it is recommended to not include it # in version control. # https://pdm.fming.dev/latest/usage/project/#working-with-version-control .pdm.toml .pdm-python .pdm-build/ # PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm __pypackages__/ # Celery stuff celerybeat-schedule celerybeat.pid # SageMath parsed files *.sage.py # Environments .env .venv env/ venv/ ENV/ env.bak/ venv.bak/ # Spyder project settings .spyderproject .spyproject # Rope project settings .ropeproject # mkdocs documentation /site # mypy .mypy_cache/ .dmypy.json dmypy.json # Pyre type checker .pyre/ # pytype static type analyzer .pytype/ # Cython debug symbols cython_debug/ # PyCharm # JetBrains specific template is maintained in a separate JetBrains.gitignore that can # be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore # and can be added to the global gitignore or merged into this file. For a more nuclear # option (not recommended) you can uncomment the following to ignore the entire idea folder. .idea/

1# Feel free to add your Python dependencies below. For formatting guidelines, see: 2# https://pip.pypa.io/en/latest/reference/requirements-file-format/ 3 4apify < 3.0 5beautifulsoup4[lxml] 6httpx 7types-beautifulsoup4

My Actor 29

My Actor 29

.actor/Dockerfile

.actor/actor.json

.actor/input_schema.json

src/__init__.py

src/__main__.py

src/main.py

src/py.typed

.dockerignore

.gitignore

requirements.txt

You might also like

My Actor

My Actor

My Actor

My Actor

My Actor

My Actor

My Actor

My Actor

My Actor

My Actor

.actor/Dockerfile

.actor/actor.json

.actor/input_schema.json

src/__init__.py

src/__main__.py

src/main.py

src/py.typed

.dockerignore

.gitignore

requirements.txt

src/init.py

src/main.py

src/init.py

src/main.py