DEV.to Articles Scraper avatar

DEV.to Articles Scraper

Pricing

from $10.00 / 1,000 result items

Go to Apify Store
DEV.to Articles Scraper

DEV.to Articles Scraper

Pull articles from DEV.to (and other Forem communities). Returns title, URL, cover, description, full body markdown, tags, reading time, reactions, comments, author profile (name, twitter, github), publication, canonical URL, published date. Filter by tag, top, latest, username.

Pricing

from $10.00 / 1,000 result items

Rating

0.0

(0)

Developer

ParseForge

ParseForge

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

7 days ago

Last modified

Share

ParseForge Banner

✍️ Dev.to Articles and Posts Scraper

🚀 Pull Dev.to articles with body, tags, reactions, reading time, author, organization, language, and 32 fields per record.

🕒 Last updated: 2026-05-08 · 📊 32 fields per record · Dev.to articles · body markdown + html, tags, reactions, comments, reading time, author + org, language, type · latest, top, by tag, by user

The Dev.to Articles and Posts Scraper pulls articles from the Dev.to community blog. Output includes title, slug, URL + canonical URL, description, body markdown + body HTML, reading time minutes, tag list (canonical names + slugs), publish + edit + crosspost + last-comment dates, readable publish date, language, collection ID, type, positive + public reaction counts, comments count, full author profile (name, username, Twitter, GitHub, website, profile image), organization (name, username, slug), and the flare tag.

Four modes in one Actor: latest articles, top articles (top of the week), articles by tag, and articles by user. Set fetchBody to false to skip the body and keep records lighter for high-volume runs.

🎯 Target Audience💡 Primary Use Cases
Dev-content marketers, content aggregators, ML researchers, recruiters tracking dev voices, OSS communitiesTech-content aggregation, developer-marketing analytics, ML training on dev articles, recruiter outreach, community monitoring

📋 What the Dev.to Articles and Posts Scraper does

Five filtering workflows in a single run:

  • 📰 Latest feed. Most recent published articles.
  • 🏆 Top of the week. Top-7-day articles by reactions.
  • 🏷️ By tag. Pull every article tagged Python, JavaScript, Rust, etc.
  • 👤 By user. Pull every article from a specific Dev.to user.
  • 📜 Body markdown + HTML. Both formats per record (toggle with fetchBody).

💡 Why it matters: clean, server-side filtering and fresh data on every run.


🎬 Full Demo

🚧 Coming soon: a 3-minute walkthrough showing how to go from sign-up to a downloaded dataset.


⚙️ Input

InputTypeDefaultBehavior
maxItemsinteger10Records to return. Free plan caps at 10, paid plan up to 1,000,000.
modestring"latest"latest, top, tag, user.
tagstring""Tag slug (tag mode).
usernamestring""Dev.to username (user mode).
fetchBodybooleantrueWhen true, includes full body markdown + html. Set false for lighter records.

Example: latest articles.

{
"maxItems": 20,
"mode": "latest",
"fetchBody": true
}

Example: articles tagged Python.

{
"maxItems": 100,
"mode": "tag",
"tag": "python",
"fetchBody": false
}

📊 Output

Each record contains 32 fields. Download as CSV, Excel, JSON, or XML.

🧾 Schema

FieldTypeExample
🖼️ coverImagestring"https://media.dev.to/.../cover.png"
📛 titlestring"How to Build a CLI in Rust"
🆔 articleIdnumber2348901
🔗 urlstring"https://dev.to/example/how-to-build-a-cli-in-rust"
📜 descriptionstring"A step-by-step guide..."
📜 bodyMarkdownstring"## Introduction\n..."
⏱️ readingTimeMinutesnumber8
🏷️ tagsarray["rust","cli","tutorial"]
🏷️ tagsCanonicalarray["rust","cli","tutorial"]
📅 publishedAtstring"2026-04-30T15:32:00Z"
📅 createdAtstring"2026-04-30T15:32:00Z"
📅 lastCommentAtstring"2026-05-02T08:21:00Z"
🌍 languagestring"en"
📜 typeOfstring"article"
👍 positiveReactionsCountnumber142
💬 commentsCountnumber9
👤 authorUsernamestring"developer"
👤 authorTwitterstring"developer"
👤 authorGithubstring"developer"
🏢 organizationNamestring"Dev Org"
🏢 organizationUsernamestring"devorg"

📦 Sample records


✨ Why choose this Actor

Capability
📜Body markdown + HTML. Toggle fetchBody to balance richness vs run cost.
👤Full author + org profile. Twitter, GitHub, website, organization details inline.
🏷️Two tag formats. Plain tag list + canonical tag list.
📅Five date fields. Created, published, edited, crossposted, last comment.
🆓No auth. Dev.to public REST API.

📈 How it compares to alternatives

ApproachCostCoverageRefreshFiltersSetup
⭐ This Actor$5 free creditDev.toLive per run4 modes⚡ 2 min
Dev.to RSSFreeLimitedLiveLimited🐢 Code
Forem API directFreeSameLiveDIY🐢 Code
Manual scrapingFreeAllLiveDIY🐢 Days

🚀 How to use

  1. 📝 Sign up. Create a free account with $5 credit (takes 2 minutes).
  2. 🌐 Open the Actor. Find the Dev.to Articles and Posts Scraper on the Apify Store.
  3. 🎯 Set input. Pick filters and maxItems.
  4. 🚀 Run it. Click Start.
  5. 📥 Download. Grab results in the Dataset tab as CSV, Excel, JSON, or XML.

⏱️ Total time from signup to dataset: 3-5 minutes. No coding required.


💼 Business use cases

📰 Content + Marketing

  • Tech-content aggregation
  • Developer-marketing analytics
  • Newsletter source feeds
  • Trending-topic detection

🤖 ML + Research

  • Train dev-content embeddings
  • Tag-classification models
  • Author-profile graphs
  • Reading-time calibration

👥 Community + Recruiting

  • Find experts on a topic
  • Track community voices
  • Discover dev influencers
  • Outreach lead generation

🎓 Learning + Curation

  • Tutorial discovery
  • Best-of-week digests
  • Hobbyist learning
  • Community curation

🔌 Automating Dev.to Articles and Posts Scraper

Control the scraper programmatically:

  • 🟢 Node.js. Install the apify-client NPM package.
  • 🐍 Python. Use the apify-client PyPI package.
  • 📚 See the Apify API documentation for full details.

The Apify Schedules feature lets you trigger this Actor on any cron interval.


🌟 Beyond business use cases

Data like this powers more than commercial workflows.

🎓 Research and academia

  • Dev-content corpora
  • Community-dynamics studies
  • Reproducible blog snapshots
  • Cross-platform comparison

🎨 Personal and creative

  • Personal blog dashboards
  • Curated reading lists
  • Side projects with article data
  • Newsletter backbones

🤝 Non-profit and civic

  • Free dev-content directories
  • Educational tutorial collections
  • Civic-tech blog aggregation
  • Mentor-discovery resources

🧪 Experimentation

  • Train trend detectors
  • Prototype recommendation
  • Build summary-bots
  • Test classification pipelines

🤖 Ask an AI assistant about this scraper

Open a ready-to-send prompt in the AI of your choice:


❓ Frequently Asked Questions

🧩 How does it work?

Pick mode (latest, top, tag, user). The Actor pages the public Dev.to API and returns each article.

📊 How many fields per record?

32, including body markdown + HTML, tags, reactions, dates, author + organization profile.

📜 Can I skip the body?

Yes. Set fetchBody to false to drop body markdown + body HTML. Records become much lighter.

🏷️ How are tags returned?

Two formats: plain tags array + canonical tagsCanonical array. Slug-style strings.

👤 Can I scrape a specific user?

Yes. Use mode=user with the username field.

📅 What's the difference between createdAt and publishedAt?

Created is the original creation timestamp; published is when it went live (often the same).

🆓 Do I need an API key?

No. Dev.to has a public API.

🔁 Can I schedule runs?

Yes. Schedule hourly for trending content.

⚖️ Is this data free to use?

Articles are publicly available. Reuse depends on each author's licensing.

💳 Do I need a paid Apify plan?

No. The free plan covers preview runs (10 records).


🔌 Integrate with any app

Dev.to Articles and Posts Scraper connects to any cloud service via Apify integrations:

  • Make - Automate multi-step workflows
  • Zapier - Connect with 5,000+ apps
  • Slack - Get run notifications
  • Airbyte - Pipe data into your warehouse
  • GitHub - Trigger runs from commits
  • Google Drive - Export datasets to Sheets

💡 Pro Tip: browse the complete ParseForge collection for more reference-data scrapers.


🆘 Need Help? Open our contact form to request a new scraper, propose a custom data project, or report an issue.


⚠️ Disclaimer: this Actor is an independent tool and is not affiliated with, endorsed by, or sponsored by Dev.to, Forem, or any individual article author. All trademarks mentioned are the property of their respective owners. Only publicly available open data is collected.