AI Content Markdown Scraper avatar
AI Content Markdown Scraper
Try for free

Pay $1.00 for 1,000 results

View all Actors
AI Content Markdown Scraper

AI Content Markdown Scraper

quaking_pail/ai-content-markdown-scraper
Try for free

Pay $1.00 for 1,000 results

This Apify Actor, "Website Content Crawler with Markdown Extraction," is designed to perform a comprehensive crawl of specified websites, extract their text content, convert it into Markdown format, and store it in a structured dataset. The extracted content is suitable for feeding LLMs.

The code examples below show how to run the Actor and get its results. To run the code, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token, which you can find under Settings > Integrations in Apify Console. Learn more

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4client = ApifyClient("<YOUR_API_TOKEN>")
5
6# Prepare the Actor input
7run_input = { "start_urls": [{ "url": "https://danone.fr" }] }
8
9# Run the Actor and wait for it to finish
10run = client.actor("quaking_pail/ai-content-markdown-scraper").call(run_input=run_input)
11
12# Fetch and print Actor results from the run's dataset (if there are any)
13print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
14for item in client.dataset(run["defaultDatasetId"]).iterate_items():
15    print(item)
16
17# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start
Developer
Maintained by Community
Actor metrics
  • 12 monthly users
  • 1 star
  • 100.0% runs succeeded
  • Created in Jun 2024
  • Modified 15 days ago
Categories