Pricing

$1.00 / 1,000 result scrapeds

Dev.to & Forem Content Scraper

Scrape Dev.to / Forem articles, full markdown bodies, nested comments, tags, users and organizations via the official public API. Keyless — no login, no token, no proxy. Public data only.

Pricing

$1.00 / 1,000 result scrapeds

Rating

0.0

(0)

Developer

Manik Anand

Actor stats

Bookmarked

Total users

Monthly active users

4 days ago

Last modified

Categories

Developer tools

News

You can access the Dev.to & Forem Content Scraper programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

{
  "openapi": "3.0.1",
  "info": {
    "version": "1.0",
    "x-build-id": "zaL3aY05fJgqQuqTM"
  },
  "servers": [
    {
      "url": "https://api.apify.com/v2"
    }
  ],
  "paths": {
    "/acts/claudethegoat~devto-forem-content-scraper/run-sync-get-dataset-items": {
      "post": {
        "operationId": "run-sync-get-dataset-items-claudethegoat-devto-forem-content-scraper",
        "x-openai-isConsequential": false,
        "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
        "tags": [
          "Run Actor"
        ],
        "requestBody": {
          "required": true,
          "content": {
            "application/json": {
              "schema": {
                "$ref": "#/components/schemas/inputSchema"
              }
            }
          }
        },
        "parameters": [
          {
            "name": "token",
            "in": "query",
            "required": true,
            "schema": {
              "type": "string"
            },
            "description": "Enter your Apify token here"
          }
        ],
        "responses": {
          "200": {
            "description": "OK"
          }
        }
      }
    },
    "/acts/claudethegoat~devto-forem-content-scraper/runs": {
      "post": {
        "operationId": "runs-sync-claudethegoat-devto-forem-content-scraper",
        "x-openai-isConsequential": false,
        "summary": "Executes an Actor and returns information about the initiated run in response.",
        "tags": [
          "Run Actor"
        ],
        "requestBody": {
          "required": true,
          "content": {
            "application/json": {
              "schema": {
                "$ref": "#/components/schemas/inputSchema"
              }
            }
          }
        },
        "parameters": [
          {
            "name": "token",
            "in": "query",
            "required": true,
            "schema": {
              "type": "string"
            },
            "description": "Enter your Apify token here"
          }
        ],
        "responses": {
          "200": {
            "description": "OK",
            "content": {
              "application/json": {
                "schema": {
                  "$ref": "#/components/schemas/runsResponseSchema"
                }
              }
            }
          }
        }
      }
    },
    "/acts/claudethegoat~devto-forem-content-scraper/run-sync": {
      "post": {
        "operationId": "run-sync-claudethegoat-devto-forem-content-scraper",
        "x-openai-isConsequential": false,
        "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
        "tags": [
          "Run Actor"
        ],
        "requestBody": {
          "required": true,
          "content": {
            "application/json": {
              "schema": {
                "$ref": "#/components/schemas/inputSchema"
              }
            }
          }
        },
        "parameters": [
          {
            "name": "token",
            "in": "query",
            "required": true,
            "schema": {
              "type": "string"
            },
            "description": "Enter your Apify token here"
          }
        ],
        "responses": {
          "200": {
            "description": "OK"
          }
        }
      }
    }
  },
  "components": {
    "schemas": {
      "inputSchema": {
        "type": "object",
        "properties": {
          "mode": {
            "title": "Mode",
            "enum": [
              "articles",
              "article_detail",
              "comments",
              "tags",
              "users",
              "organizations"
            ],
            "type": "string",
            "description": "What to scrape. articles = list by tag/author/global feed. article_detail = full markdown body for specific article IDs. comments = full nested comment tree for article IDs. tags = the Dev.to tag catalog. users = public profile lookup. organizations = org profile (+ optional org articles).",
            "default": "articles"
          },
          "tags": {
            "title": "Tags (articles mode)",
            "type": "array",
            "description": "Dev.to tag names to pull articles for — each runs as a separate source (e.g. javascript, react, webdev, python, ai). Leave empty to scrape the global feed.",
            "items": {
              "type": "string"
            }
          },
          "usernames": {
            "title": "Usernames / org slugs",
            "type": "array",
            "description": "In articles mode: authors whose articles to pull. In users mode: profiles to look up. In organizations mode: org slugs (e.g. heroku). Accepts @handle or bare name.",
            "items": {
              "type": "string"
            }
          },
          "articleIds": {
            "title": "Article IDs (article_detail & comments modes)",
            "type": "array",
            "description": "Numeric Dev.to article IDs. Used by article_detail (full body) and comments (comment tree). Find IDs in the output of articles mode.",
            "items": {
              "type": "string"
            }
          },
          "sortBy": {
            "title": "Sort (articles mode)",
            "enum": [
              "popular",
              "latest"
            ],
            "type": "string",
            "description": "popular = Dev.to's default feed ordering. latest = strict newest-first (chronological). Ignored when 'Top: last N days' is set.",
            "default": "popular"
          },
          "topDays": {
            "title": "Top: last N days (articles mode)",
            "minimum": 0,
            "maximum": 365,
            "type": "integer",
            "description": "When > 0, return the most-reacted articles from the last N days (overrides Sort). 0 = disabled. Try 7 for the weekly top, 30 for monthly.",
            "default": 0
          },
          "maxResults": {
            "title": "Max results per source",
            "minimum": 1,
            "maximum": 10000,
            "type": "integer",
            "description": "Cap on articles per tag/author (articles mode), tags (tags mode), or articles per org. Higher values increase cost and run time.",
            "default": 100
          },
          "fetchFullContent": {
            "title": "Fetch full article body (articles mode)",
            "type": "boolean",
            "description": "When on, enrich each article with its full body_markdown + body_html (one extra request per article — slower, but gives complete post content). Off = fast list view only.",
            "default": false
          },
          "includeOrgArticles": {
            "title": "Include org articles (organizations mode)",
            "type": "boolean",
            "description": "When on, also pull each organization's published articles (up to Max results per source).",
            "default": false
          }
        }
      },
      "runsResponseSchema": {
        "type": "object",
        "properties": {
          "data": {
            "type": "object",
            "properties": {
              "id": {
                "type": "string"
              },
              "actId": {
                "type": "string"
              },
              "userId": {
                "type": "string"
              },
              "startedAt": {
                "type": "string",
                "format": "date-time",
                "example": "2025-01-08T00:00:00.000Z"
              },
              "finishedAt": {
                "type": "string",
                "format": "date-time",
                "example": "2025-01-08T00:00:00.000Z"
              },
              "status": {
                "type": "string",
                "example": "READY"
              },
              "meta": {
                "type": "object",
                "properties": {
                  "origin": {
                    "type": "string",
                    "example": "API"
                  },
                  "userAgent": {
                    "type": "string"
                  }
                }
              },
              "stats": {
                "type": "object",
                "properties": {
                  "inputBodyLen": {
                    "type": "integer",
                    "example": 2000
                  },
                  "rebootCount": {
                    "type": "integer",
                    "example": 0
                  },
                  "restartCount": {
                    "type": "integer",
                    "example": 0
                  },
                  "resurrectCount": {
                    "type": "integer",
                    "example": 0
                  },
                  "computeUnits": {
                    "type": "integer",
                    "example": 0
                  }
                }
              },
              "options": {
                "type": "object",
                "properties": {
                  "build": {
                    "type": "string",
                    "example": "latest"
                  },
                  "timeoutSecs": {
                    "type": "integer",
                    "example": 300
                  },
                  "memoryMbytes": {
                    "type": "integer",
                    "example": 1024
                  },
                  "diskMbytes": {
                    "type": "integer",
                    "example": 2048
                  }
                }
              },
              "buildId": {
                "type": "string"
              },
              "defaultKeyValueStoreId": {
                "type": "string"
              },
              "defaultDatasetId": {
                "type": "string"
              },
              "defaultRequestQueueId": {
                "type": "string"
              },
              "buildNumber": {
                "type": "string",
                "example": "1.0.0"
              },
              "containerUrl": {
                "type": "string"
              },
              "usage": {
                "type": "object",
                "properties": {
                  "ACTOR_COMPUTE_UNITS": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATASET_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATASET_WRITES": {
                    "type": "integer",
                    "example": 0
                  },
                  "KEY_VALUE_STORE_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "KEY_VALUE_STORE_WRITES": {
                    "type": "integer",
                    "example": 1
                  },
                  "KEY_VALUE_STORE_LISTS": {
                    "type": "integer",
                    "example": 0
                  },
                  "REQUEST_QUEUE_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "REQUEST_QUEUE_WRITES": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATA_TRANSFER_INTERNAL_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "PROXY_SERPS": {
                    "type": "integer",
                    "example": 0
                  }
                }
              },
              "usageTotalUsd": {
                "type": "number",
                "example": 0.00005
              },
              "usageUsd": {
                "type": "object",
                "properties": {
                  "ACTOR_COMPUTE_UNITS": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATASET_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATASET_WRITES": {
                    "type": "integer",
                    "example": 0
                  },
                  "KEY_VALUE_STORE_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "KEY_VALUE_STORE_WRITES": {
                    "type": "number",
                    "example": 0.00005
                  },
                  "KEY_VALUE_STORE_LISTS": {
                    "type": "integer",
                    "example": 0
                  },
                  "REQUEST_QUEUE_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "REQUEST_QUEUE_WRITES": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATA_TRANSFER_INTERNAL_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "PROXY_SERPS": {
                    "type": "integer",
                    "example": 0
                  }
                }
              }
            }
          }
        }
      }
    }
  }
}

Dev.to & Forem Content Scraper OpenAPI definition

OpenAPI is a standard for designing and describing RESTful APIs, allowing developers to define API structure, endpoints, and data formats in a machine-readable way. It simplifies API development, integration, and documentation.

OpenAPI is effective when used with AI agents and GPTs by standardizing how these systems interact with various APIs, for reliable integrations and efficient communication.

By defining machine-readable API specifications, OpenAPI allows AI models like GPTs to understand and use varied data sources, improving accuracy. This accelerates development, reduces errors, and provides context-aware responses, making OpenAPI a core component for AI applications.

You can download the OpenAPI definitions for Dev.to & Forem Content Scraper from the options below:

OpenAPI.json

If you’d like to learn more about how OpenAPI powers GPTs, read our blog post.

You can also check out our other API clients:

Dev.to & Forem Content Scraper API in Python

Dev.to & Forem Content Scraper API in JavaScript

Dev.to & Forem Content Scraper API through CLI

Dev.to & Forem Content Scraper API

Dev.to Scraper: Articles, Comments, Users & Tags

perconey/devto-scraper

Scrape dev.to (Forem) via the official public REST API. Articles by tag/user/latest/top, comments, user profiles, tags, podcasts, videos, listings. No browser, no proxies, no auth. Pay only per result item.

Perconey

DEV / Forem Intel: Articles, Dev Leads & Tags

obsidian937/devto-intel

Turn DEV (dev.to) into structured B2B data. Monitor articles by tag, author or top window, build developer and author lead lists with socials and location, or browse the tag catalog. Official public Forem API, no proxy, no auth. Delta mode for recurring monitoring.

Obsidian IT Consulting SRL

DEV.to Article Scraper

cloud9_ai/devto-scraper

Scrape DEV.to articles, tags, and user profiles via Forem public API. Extract article metadata, content, reactions, comments, and author information.

cloud9

Dev.to Scraper - Articles by Tag & Author

logiover/devto-articles-scraper

Scrape Dev.to articles by tag or author. A no-API-key Dev.to API alternative; export article data to CSV and JSON. Forem articles scraper, no login.

Logiover

DEV.to Article Scraper

dami_studio/devto-scraper

Scrape DEV.to articles via the public Forem API — by tag, author, or sort (top/latest/rising). Get clean structured data: title, author, tags, reactions, comments, reading time, cover image, and optional full body. No key, no login.

Dami's Studio

DEV.to Scraper

plantane/devto-scraper

Scrape articles, search results, and tags from DEV.to (dev.to). Supports latest, top, by tag, by username, search, and tag listing. Uses the official Forem API for fast, reliable data extraction.

Daniel

Dev.to Scraper

crawlerbros/devto-scraper

Scrape Dev.to, the popular blogging platform for developers (forem.com). Search by tag, by username, fetch by article ID, list latest / top / featured articles. Pulls title, body markdown, tags, reactions, comments, reading time, author, organization. HTTP-only via the public dev.to/api.

Crawler Bros

DEV.to Articles Scraper

parseforge/dev-to-articles-scraper

Pull articles from DEV.to (and other Forem communities). Returns title, URL, cover, description, full body markdown, tags, reading time, reactions, comments, author profile (name, twitter, github), publication, canonical URL, published date. Filter by tag, top, latest, username.