DEV.to Posts Scraper — Tag, Search, Top & User (No API Key) avatar

DEV.to Posts Scraper — Tag, Search, Top & User (No API Key)

Pricing

from $2.00 / 1,000 post scrapeds

Go to Apify Store
DEV.to Posts Scraper — Tag, Search, Top & User (No API Key)

DEV.to Posts Scraper — Tag, Search, Top & User (No API Key)

Scrape DEV.to articles by tag, search query, top posts, or username. Uses DEV.to's public API — no API key required. Outputs title, author, tags, reactions, comments, reading time, and more. PPE $0.002/post.

Pricing

from $2.00 / 1,000 post scrapeds

Rating

0.0

(0)

Developer

Hojun Lee

Hojun Lee

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

a day ago

Last modified

Categories

Share

What does DEV.to Posts Scraper do?

DEV.to Posts Scraper extracts articles from DEV.to — the largest developer blogging platform with millions of published technical articles — using the public REST API. No API key or login is required. Search by tag, full-text query, username, or pull the top trending developer articles across any time window (7, 30, or 365 days). Each result includes the full article metadata: title, author, tags, reactions, comment count, reading time, description, cover image URL, and permalink. This is the fastest tech blog content extractor for developer community data.

DEV.to's public API is deliberately open — this actor paginates through results automatically, respects rate limits, and delivers structured data ready for analysis, content curation, or machine learning pipelines.


Why use DEV.to Posts Scraper?

  1. Developer content research — Discover what topics are trending in the developer community right now. Filter by tag (python, javascript, rust, ai) to track technology adoption curves from the people actually building with it.
  2. Competitive content analysis — Monitor what your competitors or top authors in your niche are publishing. Track their engagement metrics over time to identify high-performing content patterns.
  3. Newsletter and content curation — Automate weekly digests of the best articles by tag or reaction count. Feed results directly into a content calendar or editorial workflow.
  4. Developer API for NLP and AI datasets — Build clean, high-quality datasets of technical writing for training or fine-tuning language models. DEV.to articles are well-structured, human-written, and domain-specific.
  5. SEO and content gap analysis — Identify which developer topics generate the most engagement but have the fewest published articles — uncovering content opportunities for your own blog or documentation.

How to use DEV.to Posts Scraper

  1. Open the Actor on Apify and click Try for free.
  2. Choose a mode: tag (by technology tag), search (full-text), top (trending), or user (by author).
  3. Fill in the relevant parameter: a tag name, searchQuery, username, or topDays.
  4. Set maxPosts — the actor paginates automatically up to 1,000 articles.
  5. Click Start — results appear in the dataset within seconds.
  6. Download as JSON, CSV, or XLSX. Or connect via the Apify API for automated pipelines.

Input

ParameterTypeDefaultDescription
modestringtagScraping mode: tag, search, top, or user
tagstringpythonDEV.to tag to scrape (mode=tag). Examples: javascript, rust, webdev, ai
searchQuerystring—Full-text search terms (mode=search). Example: machine learning tutorial
usernamestring—DEV.to username to scrape all published articles (mode=user)
topDaysinteger7Trending window in days: 7, 30, or 365 (mode=top)
maxPostsinteger100Maximum developer articles to collect (1–1000)

Output

Each article is one dataset item:

[
{
"id": 1987654,
"title": "Build a Production-Ready REST API with FastAPI and PostgreSQL",
"slug": "build-a-production-ready-rest-api-with-fastapi-and-postgresql-abc1",
"url": "https://dev.to/johndoe/build-a-production-ready-rest-api-with-fastapi-and-postgresql-abc1",
"author": "johndoe",
"tags": ["python", "fastapi", "postgresql", "tutorial"],
"published_at": "2026-09-01T10:00:00Z",
"reading_time_minutes": 12,
"reactions": 487,
"comments": 43,
"cover_image": "https://media.dev.to/cdn-cgi/image/width=1000,height=420,fit=cover/https://dev-to-uploads.s3.amazonaws.com/uploads/articles/abc123.png",
"description": "A step-by-step guide to building a production-ready REST API using FastAPI, SQLAlchemy, and PostgreSQL with authentication, migrations, and Docker."
},
{
"id": 1876543,
"title": "Why I Switched from React to Svelte in 2026",
"author": "frontend_dev",
"tags": ["javascript", "svelte", "react", "webdev"],
"published_at": "2026-08-28T14:30:00Z",
"reading_time_minutes": 7,
"reactions": 312,
"comments": 89,
"url": "https://dev.to/frontend_dev/why-i-switched-from-react-to-svelte-in-2026-xyz9"
}
]

Data fields

FieldExampleDescription
id1987654DEV.to article ID
titleBuild a REST API with FastAPIArticle title
slugbuild-a-rest-api-…-abc1URL slug
urlhttps://dev.to/…Full permalink to the article
authorjohndoeDEV.to username of the author
tags["python","fastapi"]Article tags
published_at2026-09-01T10:00:00ZPublication timestamp (UTC)
reading_time_minutes12Estimated reading time
reactions487Total positive reactions
comments43Comment count
cover_imagehttps://media.dev.to/…Cover image URL (if set)
descriptionA step-by-step guide…Article description / excerpt

Cost estimation

Pay-Per-Event pricing

EventPrice
Actor start (one-time per run)$0.005
Per article scraped$0.002
Run typeArticlesEstimated cost
Quick tag sample50$0.105
Standard research run100$0.205
Deep tag archive500$1.005
Full author history200$0.405

FAQ

Do I need a DEV.to API key? No. This Dev.to posts scraper uses DEV.to's public REST API endpoint which requires no authentication for read access. Run it immediately with no account setup.

What is the rate limit and how does the actor handle it? DEV.to's public API allows approximately 30 requests per 30 seconds. The actor tracks this automatically and adds delays between requests to stay within limits — you will never get blocked mid-run.

Can I use this to build a dataset of developer articles for AI training? Yes. Developer articles on DEV.to are community-licensed (creative commons by default for most posts) and represent some of the highest-quality technical writing on the internet. This tech blog content extractor delivers clean, structured JSON records ideal for NLP datasets, fine-tuning corpora, or RAG knowledge bases — with reading time estimates and engagement signals pre-computed.

Disclaimer: This actor uses DEV.to's public API to access publicly available content. It is not affiliated with or endorsed by Forem Inc. or DEV.to. Ensure your use of collected data complies with DEV.to's Terms of Use and applicable data protection laws.


Keywords: Dev.to posts scraper, developer articles API, tech blog content extractor, DEV.to scraper, developer community data, coding blog scraper, DEV.to tag scraper, technical content API, developer writing dataset, programming articles extractor