Markdown Header Text Splitter
Pricing
$20.00/month + usage
Go to Store
Markdown Header Text Splitter
Split Markdown into structured chunks using header hierarchy. Built with LangChain, it preserves metadata for RAG, documentation, and analysis. Configure headers, strip content, and integrate with vector databases. Ideal for AI workflows.
0.0 (0)
Pricing
$20.00/month + usage
0
Monthly users
2
Runs succeeded
>99%
Last modified
15 days ago
.dockerignore
1.git
2.mise.toml
3.nvim.lua
4storage
5
6# The rest is copied from https://github.com/github/gitignore/blob/main/Python.gitignore
7
8# Byte-compiled / optimized / DLL files
9__pycache__/
10*.py[cod]
11*$py.class
12
13# C extensions
14*.so
15
16# Distribution / packaging
17.Python
18build/
19develop-eggs/
20dist/
21downloads/
22eggs/
23.eggs/
24lib/
25lib64/
26parts/
27sdist/
28var/
29wheels/
30share/python-wheels/
31*.egg-info/
32.installed.cfg
33*.egg
34MANIFEST
35
36# PyInstaller
37# Usually these files are written by a python script from a template
38# before PyInstaller builds the exe, so as to inject date/other infos into it.
39*.manifest
40*.spec
41
42# Installer logs
43pip-log.txt
44pip-delete-this-directory.txt
45
46# Unit test / coverage reports
47htmlcov/
48.tox/
49.nox/
50.coverage
51.coverage.*
52.cache
53nosetests.xml
54coverage.xml
55*.cover
56*.py,cover
57.hypothesis/
58.pytest_cache/
59cover/
60
61# Translations
62*.mo
63*.pot
64
65# Django stuff:
66*.log
67local_settings.py
68db.sqlite3
69db.sqlite3-journal
70
71# Flask stuff:
72instance/
73.webassets-cache
74
75# Scrapy stuff:
76.scrapy
77
78# Sphinx documentation
79docs/_build/
80
81# PyBuilder
82.pybuilder/
83target/
84
85# Jupyter Notebook
86.ipynb_checkpoints
87
88# IPython
89profile_default/
90ipython_config.py
91
92# pyenv
93# For a library or package, you might want to ignore these files since the code is
94# intended to run in multiple environments; otherwise, check them in:
95.python-version
96
97# pdm
98# Similar to Pipfile.lock, it is generally recommended to include pdm.lock in version control.
99#pdm.lock
100# pdm stores project-wide configurations in .pdm.toml, but it is recommended to not include it
101# in version control.
102# https://pdm.fming.dev/latest/usage/project/#working-with-version-control
103.pdm.toml
104.pdm-python
105.pdm-build/
106
107# PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm
108__pypackages__/
109
110# Celery stuff
111celerybeat-schedule
112celerybeat.pid
113
114# SageMath parsed files
115*.sage.py
116
117# Environments
118.env
119.venv
120env/
121venv/
122ENV/
123env.bak/
124venv.bak/
125
126# Spyder project settings
127.spyderproject
128.spyproject
129
130# Rope project settings
131.ropeproject
132
133# mkdocs documentation
134/site
135
136# mypy
137.mypy_cache/
138.dmypy.json
139dmypy.json
140
141# Pyre type checker
142.pyre/
143
144# pytype static type analyzer
145.pytype/
146
147# Cython debug symbols
148cython_debug/
149
150# PyCharm
151# JetBrains specific template is maintained in a separate JetBrains.gitignore that can
152# be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
153# and can be added to the global gitignore or merged into this file. For a more nuclear
154# option (not recommended) you can uncomment the following to ignore the entire idea folder.
155.idea/.gitignore
1.mise.toml
2.nvim.lua
3storage
4
5# The rest is copied from https://github.com/github/gitignore/blob/main/Python.gitignore
6
7# Byte-compiled / optimized / DLL files
8__pycache__/
9*.py[cod]
10*$py.class
11
12# C extensions
13*.so
14
15# Distribution / packaging
16.Python
17build/
18develop-eggs/
19dist/
20downloads/
21eggs/
22.eggs/
23lib/
24lib64/
25parts/
26sdist/
27var/
28wheels/
29share/python-wheels/
30*.egg-info/
31.installed.cfg
32*.egg
33MANIFEST
34
35# PyInstaller
36# Usually these files are written by a python script from a template
37# before PyInstaller builds the exe, so as to inject date/other infos into it.
38*.manifest
39*.spec
40
41# Installer logs
42pip-log.txt
43pip-delete-this-directory.txt
44
45# Unit test / coverage reports
46htmlcov/
47.tox/
48.nox/
49.coverage
50.coverage.*
51.cache
52nosetests.xml
53coverage.xml
54*.cover
55*.py,cover
56.hypothesis/
57.pytest_cache/
58cover/
59
60# Translations
61*.mo
62*.pot
63
64# Django stuff:
65*.log
66local_settings.py
67db.sqlite3
68db.sqlite3-journal
69
70# Flask stuff:
71instance/
72.webassets-cache
73
74# Scrapy stuff:
75.scrapy
76
77# Sphinx documentation
78docs/_build/
79
80# PyBuilder
81.pybuilder/
82target/
83
84# Jupyter Notebook
85.ipynb_checkpoints
86
87# IPython
88profile_default/
89ipython_config.py
90
91# pyenv
92# For a library or package, you might want to ignore these files since the code is
93# intended to run in multiple environments; otherwise, check them in:
94.python-version
95
96# pdm
97# Similar to Pipfile.lock, it is generally recommended to include pdm.lock in version control.
98#pdm.lock
99# pdm stores project-wide configurations in .pdm.toml, but it is recommended to not include it
100# in version control.
101# https://pdm.fming.dev/latest/usage/project/#working-with-version-control
102.pdm.toml
103.pdm-python
104.pdm-build/
105
106# PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm
107__pypackages__/
108
109# Celery stuff
110celerybeat-schedule
111celerybeat.pid
112
113# SageMath parsed files
114*.sage.py
115
116# Environments
117.env
118.venv
119env/
120venv/
121ENV/
122env.bak/
123venv.bak/
124
125# Spyder project settings
126.spyderproject
127.spyproject
128
129# Rope project settings
130.ropeproject
131
132# mkdocs documentation
133/site
134
135# mypy
136.mypy_cache/
137.dmypy.json
138dmypy.json
139
140# Pyre type checker
141.pyre/
142
143# pytype static type analyzer
144.pytype/
145
146# Cython debug symbols
147cython_debug/
148
149# PyCharm
150# JetBrains specific template is maintained in a separate JetBrains.gitignore that can
151# be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
152# and can be added to the global gitignore or merged into this file. For a more nuclear
153# option (not recommended) you can uncomment the following to ignore the entire idea folder.
154.idea/
155
156# Added by Apify CLI
157node_modulesrequirements.txt
1annotated-types==0.7.0
2anyio==4.8.0
3apify==2.4.0
4apify_client==1.9.2
5apify_shared==1.3.1
6Brotli==1.1.0
7browserforge==1.2.3
8cachetools==5.5.2
9certifi==2025.1.31
10cffi==1.17.1
11charset-normalizer==3.4.1
12click==8.1.8
13colorama==0.4.6
14crawlee==0.6.3
15cryptography==44.0.2
16docutils==0.21.2
17eval_type_backport==0.2.2
18filelock==3.17.0
19greenlet==3.1.1
20h11==0.14.0
21h2==4.2.0
22hpack==4.1.0
23httpcore==1.0.7
24httpx==0.28.1
25hyperframe==6.1.0
26idna==3.10
27jsonpatch==1.33
28jsonpointer==3.0.0
29langchain==0.3.20
30langchain-core==0.3.43
31langchain-text-splitters==0.3.6
32langsmith==0.3.13
33lazy-object-proxy==1.10.0
34markdown-it-py==3.0.0
35mdurl==0.1.2
36more-itertools==10.6.0
37multidict==6.1.0
38orjson==3.10.15
39packaging==24.2
40propcache==0.3.0
41psutil==7.0.0
42pycparser==2.22
43pydantic==2.10.6
44pydantic-settings==2.6.1
45pydantic_core==2.27.2
46pyee==12.1.1
47Pygments==2.19.1
48python-dotenv==1.0.1
49PyYAML==6.0.2
50requests==2.32.3
51requests-file==2.1.0
52requests-toolbelt==1.0.0
53rich==13.9.4
54setuptools==76.0.0
55sniffio==1.3.1
56sortedcollections==2.1.0
57sortedcontainers==2.4.0
58SQLAlchemy==2.0.38
59tenacity==9.0.0
60tldextract==5.1.3
61typing_extensions==4.12.2
62urllib3==2.3.0
63websockets==15.0.1
64wheel==0.45.1
65yarl==1.18.3
66zstandard==0.23.0.actor/Dockerfile
1# First, specify the base Docker image.
2# You can see the Docker images from Apify at https://hub.docker.com/r/apify/.
3# You can also use any other image from Docker Hub.
4FROM apify/actor-python:3.13
5
6# Second, copy just requirements.txt into the Actor image,
7# since it should be the only file that affects the dependency install in the next step,
8# in order to speed up the build
9COPY requirements.txt ./
10
11# Install the packages specified in requirements.txt,
12# Print the installed Python version, pip version
13# and all installed packages with their versions for debugging
14RUN echo "Python version:" \
15 && python --version \
16 && echo "Pip version:" \
17 && pip --version \
18 && echo "Installing dependencies:" \
19 && pip install -r requirements.txt \
20 && echo "All installed Python packages:" \
21 && pip freeze
22
23# Next, copy the remaining files and directories with the source code.
24# Since we do this after installing the dependencies, quick build will be really fast
25# for most source file changes.
26COPY . ./
27
28# Use compileall to ensure the runnability of the Actor Python code.
29RUN python3 -m compileall -q .
30
31# Create and run as a non-root user.
32RUN useradd --create-home apify && \
33 chown -R apify:apify ./ && \
34 chown -R apify:apify /usr/local/lib/python*
35USER apify
36
37
38# Specify how to launch the source code of your Actor.
39# By default, the "python3 -m ." command is run
40CMD ["python3", "-m", "src"].actor/INPUT_SCHEMA.json
1{
2 "title": "Markdown Splitter",
3 "description": "Splits Markdown text into chunks based on headers",
4 "type": "object",
5 "schemaVersion": 1,
6 "properties": {
7 "markdown_text": {
8 "title": "Markdown Text",
9 "type": "string",
10 "description": "The Markdown content to process",
11 "editor": "textarea",
12 "default": "# Header 1\nHello, World!\n## Header 2\nGoodbye, World!"
13 },
14 "headers_to_split_on": {
15 "title": "Headers to Split On",
16 "type": "array",
17 "description": "Header levels (e.g., ['#', '##'])",
18 "editor": "stringList",
19 "default": ["#", "##", "###", "####", "#####", "######"]
20 },
21 "strip_headers": {
22 "title": "Strip Headers",
23 "type": "boolean",
24 "description": "Remove headers from chunk content",
25 "default": true
26 }
27 },
28 "required": ["markdown_text"]
29}.actor/actor.json
1{
2 "actorSpecification": 1,
3 "name": "markdown-splitter",
4 "title": "Markdown Header Text Splitter",
5 "description": "Splits Markdown documents into chunks based on header hierarchy",
6 "version": "1.0",
7 "buildTag": "latest",
8 "dockerfile": "./Dockerfile",
9 "storages": {
10 "dataset": {
11 "actorSpecification": 1,
12 "fields": {
13 "type": "object",
14 "properties": {
15 "chunks": {
16 "type": "array",
17 "items": {
18 "type": "object",
19 "properties": {
20 "content": { "type": "string" },
21 "metadata": { "type": "object" }
22 }
23 }
24 },
25 "error": { "type": "string" }
26 },
27 "required": ["chunks"]
28 }
29 }
30 }
31}src/__init__.py
src/__main__.py
1import asyncio
2
3from .main import main
4
5# Execute the Actor entry point.
6asyncio.run(main())src/main.py
1from apify import Actor
2from langchain.text_splitter import MarkdownHeaderTextSplitter
3from .models import MarkdownSplitterInput, MarkdownSplitterOutput
4
5
6async def main():
7 async with Actor:
8 try:
9 input_data = await Actor.get_input() or {}
10 params = MarkdownSplitterInput(**input_data)
11
12 # Convert headers to LangChain format
13 headers = []
14 for h in params.headers_to_split_on:
15 level = h.count("#")
16 headers.append((h, f"Header {level}"))
17
18 # Split Markdown
19 splitter = MarkdownHeaderTextSplitter(
20 headers_to_split_on=headers, strip_headers=params.strip_headers
21 )
22 documents = splitter.split_text(params.markdown_text)
23
24 # Format output
25 chunks = []
26 for doc in documents:
27 chunks.append({"content": doc.page_content, "metadata": doc.metadata})
28
29 await Actor.push_data(
30 MarkdownSplitterOutput(chunks=chunks).model_dump(exclude_none=True)
31 )
32
33 except Exception as e:
34 error_msg = f"Actor failed: {str(e)}"
35 Actor.log.error(error_msg)
36 await Actor.fail(exception=e, status_message=error_msg)src/models.py
1from pydantic import BaseModel, Field, field_validator
2from typing import List, Optional
3
4
5class MarkdownSplitterInput(BaseModel):
6 markdown_text: str = Field(..., description="Markdown content to split")
7 headers_to_split_on: List[str] = Field(
8 default=["#", "##", "###", "####", "#####", "######"],
9 description="Header levels to split on (e.g., ['#', '##'])",
10 )
11 strip_headers: bool = Field(True, description="Remove headers from chunks")
12
13 @field_validator("headers_to_split_on")
14 @classmethod
15 def validate_headers(cls, v: List[str]) -> List[str]:
16 for h in v:
17 stripped = h.strip()
18 if (
19 not stripped.startswith("#")
20 or not stripped.replace("#", "").strip() == ""
21 ):
22 raise ValueError(f"Invalid header format: {h}. Use '#', '##', etc.")
23 return v
24
25
26class MarkdownSplitterOutput(BaseModel):
27 chunks: List[dict] = Field(..., description="Processed chunks with metadata")
28 error: Optional[str] = Field(None, description="Error details")src/py.typed
1Pricing
Pricing model
RentalTo use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.
Free trial
2 hours
Price
$20.00
