DEV.to Posts Scraper — Tag, Search, Top & User (No API Key)
Pricing
from $2.00 / 1,000 post scrapeds
DEV.to Posts Scraper — Tag, Search, Top & User (No API Key)
Scrape DEV.to articles by tag, search query, top posts, or username. Uses DEV.to's public API — no API key required. Outputs title, author, tags, reactions, comments, reading time, and more. PPE $0.002/post.
What does DEV.to Posts Scraper do?
DEV.to Posts Scraper extracts articles from DEV.to — the largest developer blogging platform with millions of published technical articles — using the public REST API. No API key or login is required. Search by tag, full-text query, username, or pull the top trending developer articles across any time window (7, 30, or 365 days). Each result includes the full article metadata: title, author, tags, reactions, comment count, reading time, description, cover image URL, and permalink. This is the fastest tech blog content extractor for developer community data.
DEV.to's public API is deliberately open — this actor paginates through results automatically, respects rate limits, and delivers structured data ready for analysis, content curation, or machine learning pipelines.
Why use DEV.to Posts Scraper?
- Developer content research — Discover what topics are trending in the developer community right now. Filter by tag (
python,javascript,rust,ai) to track technology adoption curves from the people actually building with it. - Competitive content analysis — Monitor what your competitors or top authors in your niche are publishing. Track their engagement metrics over time to identify high-performing content patterns.
- Newsletter and content curation — Automate weekly digests of the best articles by tag or reaction count. Feed results directly into a content calendar or editorial workflow.
- Developer API for NLP and AI datasets — Build clean, high-quality datasets of technical writing for training or fine-tuning language models. DEV.to articles are well-structured, human-written, and domain-specific.
- SEO and content gap analysis — Identify which developer topics generate the most engagement but have the fewest published articles — uncovering content opportunities for your own blog or documentation.
How to use DEV.to Posts Scraper
- Open the Actor on Apify and click Try for free.
- Choose a
mode:tag(by technology tag),search(full-text),top(trending), oruser(by author). - Fill in the relevant parameter: a
tagname,searchQuery,username, ortopDays. - Set
maxPosts— the actor paginates automatically up to 1,000 articles. - Click Start — results appear in the dataset within seconds.
- Download as JSON, CSV, or XLSX. Or connect via the Apify API for automated pipelines.
Input
| Parameter | Type | Default | Description |
|---|---|---|---|
mode | string | tag | Scraping mode: tag, search, top, or user |
tag | string | python | DEV.to tag to scrape (mode=tag). Examples: javascript, rust, webdev, ai |
searchQuery | string | — | Full-text search terms (mode=search). Example: machine learning tutorial |
username | string | — | DEV.to username to scrape all published articles (mode=user) |
topDays | integer | 7 | Trending window in days: 7, 30, or 365 (mode=top) |
maxPosts | integer | 100 | Maximum developer articles to collect (1–1000) |
Output
Each article is one dataset item:
[{"id": 1987654,"title": "Build a Production-Ready REST API with FastAPI and PostgreSQL","slug": "build-a-production-ready-rest-api-with-fastapi-and-postgresql-abc1","url": "https://dev.to/johndoe/build-a-production-ready-rest-api-with-fastapi-and-postgresql-abc1","author": "johndoe","tags": ["python", "fastapi", "postgresql", "tutorial"],"published_at": "2026-09-01T10:00:00Z","reading_time_minutes": 12,"reactions": 487,"comments": 43,"cover_image": "https://media.dev.to/cdn-cgi/image/width=1000,height=420,fit=cover/https://dev-to-uploads.s3.amazonaws.com/uploads/articles/abc123.png","description": "A step-by-step guide to building a production-ready REST API using FastAPI, SQLAlchemy, and PostgreSQL with authentication, migrations, and Docker."},{"id": 1876543,"title": "Why I Switched from React to Svelte in 2026","author": "frontend_dev","tags": ["javascript", "svelte", "react", "webdev"],"published_at": "2026-08-28T14:30:00Z","reading_time_minutes": 7,"reactions": 312,"comments": 89,"url": "https://dev.to/frontend_dev/why-i-switched-from-react-to-svelte-in-2026-xyz9"}]
Data fields
| Field | Example | Description |
|---|---|---|
id | 1987654 | DEV.to article ID |
title | Build a REST API with FastAPI | Article title |
slug | build-a-rest-api-…-abc1 | URL slug |
url | https://dev.to/… | Full permalink to the article |
author | johndoe | DEV.to username of the author |
tags | ["python","fastapi"] | Article tags |
published_at | 2026-09-01T10:00:00Z | Publication timestamp (UTC) |
reading_time_minutes | 12 | Estimated reading time |
reactions | 487 | Total positive reactions |
comments | 43 | Comment count |
cover_image | https://media.dev.to/… | Cover image URL (if set) |
description | A step-by-step guide… | Article description / excerpt |
Cost estimation
Pay-Per-Event pricing
| Event | Price |
|---|---|
| Actor start (one-time per run) | $0.005 |
| Per article scraped | $0.002 |
| Run type | Articles | Estimated cost |
|---|---|---|
| Quick tag sample | 50 | $0.105 |
| Standard research run | 100 | $0.205 |
| Deep tag archive | 500 | $1.005 |
| Full author history | 200 | $0.405 |
FAQ
Do I need a DEV.to API key? No. This Dev.to posts scraper uses DEV.to's public REST API endpoint which requires no authentication for read access. Run it immediately with no account setup.
What is the rate limit and how does the actor handle it? DEV.to's public API allows approximately 30 requests per 30 seconds. The actor tracks this automatically and adds delays between requests to stay within limits — you will never get blocked mid-run.
Can I use this to build a dataset of developer articles for AI training? Yes. Developer articles on DEV.to are community-licensed (creative commons by default for most posts) and represent some of the highest-quality technical writing on the internet. This tech blog content extractor delivers clean, structured JSON records ideal for NLP datasets, fine-tuning corpora, or RAG knowledge bases — with reading time estimates and engagement signals pre-computed.
Disclaimer: This actor uses DEV.to's public API to access publicly available content. It is not affiliated with or endorsed by Forem Inc. or DEV.to. Ensure your use of collected data complies with DEV.to's Terms of Use and applicable data protection laws.
Related actors
- Bluesky Posts Scraper — Developer community discussion on Bluesky
- Google Patents Scraper — Patent intelligence and R&D tracking
Keywords: Dev.to posts scraper, developer articles API, tech blog content extractor, DEV.to scraper, developer community data, coding blog scraper, DEV.to tag scraper, technical content API, developer writing dataset, programming articles extractor