Dev.to Scraper

Articles from any DEV tag, top list, member or organization — with reactions, comments, authors and the full text in Markdown — as clean JSON.

DEV (dev.to) is one of the largest communities of software developers, with millions of articles on JavaScript, Python, web development, AI, DevOps, careers and every other corner of software. This Actor reads any tag feed, the week's, month's, year's or all-time top articles, the newest articles, or every article by a member or organization, and returns each one with its title, description, tags, publish and edit dates, reading time, reactions, comment count, cover image, author (with GitHub, X and website links), organization, and the full article body as Markdown, HTML and plain text. Turn on comments to add every comment and reply, in thread order. Paste a dev.to URL or a list of tags; there is no login, no API key, and no proxy to configure. Built for developer-content research, DevRel and community monitoring, technical SEO, and AI and search datasets.

⚡ Quick start

{
  "startUrls": [{ "url": "https://dev.to/t/javascript/top/week" }],
  "maxItems": 5
}

🧩 Input

Field	Type	Required	Default	Description
startUrls	array	no	—	dev.to pages: tag feeds (dev.to/t/<tag>, …/latest, or …/top/week, month, year or infinity), the home feed, dev.to/latest or dev.to/top/<period>, member or organization profiles (dev.to/<name>), and single article URLs. Add URLs, tags, or both.
tags	array	no	—	DEV tags, one per line (for example webdev or python). Each returns the same articles as its dev.to/t/<tag> page.
maxItems	integer	no	—	Maximum number of articles per start URL or tag. The input form starts at 5; leave it empty to get every article the listing has.
includeContent	boolean	no	true	Read each article's full body as Markdown, HTML and plain text. Adds one fast request per article; turn it off for quick listings with titles, stats and descriptions only.
includeComments	boolean	no	false	Add each article's comments and replies, flattened into one list in thread order with a depth for each. Adds one request per article.
proxyConfiguration	object	no	{ "useApifyProxy": false }	Proxy settings. DEV needs no proxy; use Apify Proxy (datacenter) only for very large runs.

Which order do I get? The same as the page you paste: a tag page gives DEV's relevant feed for the tag, …/latest the newest first, and …/top/week (or month, year, infinity) the most-reacted articles of that period. Profile pages list the member's or organization's articles, newest first.

📤 Output

Each article is one dataset row, with its author and, when it was published under one, its organization.

Fields

Field	Type	Description
id	number	DEV article ID.
title	string	Article title.
description	string	The article's summary, as shown in feeds and link previews.
slug	string	The article's name in its URL.
url	string	The article's page on dev.to.
canonicalUrl	string	The article's original home: its dev.to page, or the author's own blog when the article was cross-posted.
publishedAt	string	When the article was published (ISO 8601).
editedAt	string	When the article was last edited (ISO 8601), or null if never.
readingTimeMinutes	number	Estimated reading time in minutes.
language	string	Language of the article.
tags	array	Tag names, up to four.
positiveReactionsCount	number	Number of positive reactions (likes, unicorns, and the like).
publicReactionsCount	number	Number of public reactions, the count DEV shows on the article.
commentsCount	number	Number of comments.
coverImage	string	Cover image URL.
socialImage	string	Link-preview image URL.
author	object	The writer: name, username, url, twitter (X handle), github (GitHub handle), website and profileImage.
organization	object	The organization the article was published under: name, username, url and profileImage. null for personal articles.
bodyHtml	string	Article body as HTML. null when includeContent is off.
bodyMarkdown	string	Article body as the author wrote it, in Markdown. null when includeContent is off.
bodyText	string	Article body as plain text. null when includeContent is off.
comments	array	Comments and replies in thread order, each with id, url, parentId (the comment it replies to), depth (0 for a top-level comment), createdAt, author and bodyText. null when includeComments is off.

💡 Use cases

• Developer-content research — find the most-read articles on a technology, week by week, and see which topics, formats and tags earn reactions and comments.
• DevRel and community monitoring — follow your company's organization page, your product's tag, or your advocates' profiles, and catch every new article and comment.
• Technical SEO and content marketing — track cross-posted articles and their canonical URLs, and benchmark your posts against the top of each tag.
• AI and search datasets — collect clean, attributed technical articles in Markdown, with code blocks intact, and their discussion threads.

❓ FAQ

• Do I need a DEV account or an API key? No. The Actor reads only what DEV shows every visitor.
• Can I search DEV by keyword? Not directly: DEV does not offer its search for automated access. Use tags instead (dev.to/t/<keyword> or the tags input), which cover most topics, or scrape the profiles of the members and organizations you follow.
• Does it work with other Forem communities? No. Forem's other communities now share DEV's articles under their own addresses, so the Actor reads dev.to itself and takes dev.to URLs only.
• How far back can I go? As far as the listing goes. Profile pages hold every article the member or organization has published, and …/top/infinity gives a tag's most-reacted articles of all time. Leave maxItems empty to get them all.
• Can I scrape many tags or profiles at once? Yes. Add one URL or tag per line; maxItems applies to each one separately.
• Why is organization empty on most rows? Most articles are personal. organization is filled only when an article was published under a company or community page.
• Do I need a proxy? No. It runs without one by default and paces itself when DEV asks it to slow down.

🔗 More scrapers by Anyx

• Medium Scraper
• Substack Scraper
• Hacker News Scraper
• Stack Overflow Scraper

🤝 Anyx Solutions

We build custom scrapers and data-extraction pipelines.

• Email: tantosthor@gmail.com

🖼 Image credit

Image credit: dev.to