DEV.to Posts Scraper

Scrape articles from DEV.to — the popular developer blogging platform — using the public REST API with no API key required. Collect articles by tag, search query, trending/top posts, or a specific author's profile.

Features

• By Tag — Fetch latest articles for any tag (e.g. python, javascript, webdev, rust)
• Search — Full-text search across all DEV.to articles
• Top / Trending — Most popular articles over the last 7, 30, or 365 days
• By Username — All published articles by a specific DEV.to author
• No API key needed — Uses DEV.to's public API endpoint
• Pagination — Automatically pages through results up to your specified limit

Use Cases

• Content research — Find trending developer articles on any technology
• Competitive analysis — Monitor what your competitors or top authors publish
• Newsletter curation — Aggregate the best weekly posts on a topic
• Data science — Build datasets of developer-written technical content
• SEO research — Discover high-performing content ideas in your niche

Input

Parameter	Type	Default	Description
mode	string	tag	Scraping mode: tag, search, top, user
tag	string	python	Tag to scrape (mode=tag)
searchQuery	string	—	Search terms (mode=search)
username	string	—	DEV.to username (mode=user)
topDays	integer	7	Days for trending articles: 7, 30, or 365 (mode=top)
maxPosts	integer	100	Maximum articles to collect (max 1000)

Output

Each article is saved as a JSON record:

{
  "id": 123456,
  "title": "Build a REST API with FastAPI",
  "slug": "build-a-rest-api-with-fastapi-abc1",
  "url": "https://dev.to/author/build-a-rest-api-with-fastapi-abc1",
  "author": "johndoe",
  "tags": ["python", "fastapi", "tutorial"],
  "published_at": "2026-09-01T10:00:00Z",
  "reading_time_minutes": 8,
  "reactions": 142,
  "comments": 23,
  "cover_image": "https://media.dev.to/cdn-cgi/image/...",
  "description": "Learn how to build a production-ready REST API..."
}

Pricing

This Actor uses Pay-Per-Event (PPE) pricing:

• $0.005 — One-time charge per run
• $0.002 — Per article scraped

Example: Collecting 100 articles = $0.005 + (100 × $0.002) = $0.205

Example Inputs

Trending Python articles (last 7 days):

{ "mode": "top", "topDays": 7, "maxPosts": 50 }

Search for AI/ML tutorials:

{ "mode": "search", "searchQuery": "machine learning tutorial", "maxPosts": 100 }

All articles tagged "webdev":

{ "mode": "tag", "tag": "webdev", "maxPosts": 200 }

Articles by a specific author:

{ "mode": "user", "username": "ben", "maxPosts": 50 }

Notes

• DEV.to API rate limit: ~30 requests per 30 seconds. This Actor respects the limit automatically.
• The public API returns up to 30 articles per page; the Actor paginates automatically.
• reactions reflects public (positive) reactions on each article.