Dev.to Articles Scraper avatar

Dev.to Articles Scraper

Pricing

from $0.01 / 1,000 results

Go to Apify Store
Dev.to Articles Scraper

Dev.to Articles Scraper

Pull articles from DEV Community (dev.to) by tag, username or the latest feed and get clean JSON — title, url, tags, reactions, comments, reading time, author and cover image. Powered by the free official Forem API — no key or login required.

Pricing

from $0.01 / 1,000 results

Rating

0.0

(0)

Developer

Assia Fadli

Assia Fadli

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

7 days ago

Last modified

Categories

Share

Collect articles from DEV Community (dev.to) straight from its free, official Forem API. There is nothing to configure — no API key, no login, and no proxy — the feed is public and rock-solid.

Point it at a tag, a username, or just the latest feed, pick how many articles you want, and get back one tidy JSON row per article.

Features

  • Scrape by tag (e.g. javascript), by username/organization, or straight from the latest feed.
  • Combine a tag and a username to narrow the results further.
  • Paginates automatically until it reaches your item limit or the end of the feed.
  • Emits one flat, ready-to-use JSON record per article.
  • Skips gracefully over malformed items — they are recorded with an error field so a single bad item never stops the run.

Input

FieldTypeDefaultDescription
tagstringOptional. Only articles with this tag, e.g. javascript.
usernamestringOptional. Only articles by this dev.to user/organization.
maxItemsinteger50Maximum number of articles to fetch.

Example input

{
"tag": "javascript",
"maxItems": 10
}

Or scrape a specific author:

{
"username": "ben",
"maxItems": 25
}

Output

Each dataset record looks like this:

{
"id": 123456,
"title": "Understanding async/await in JavaScript",
"url": "https://dev.to/someone/understanding-async-await-in-javascript",
"description": "A friendly deep dive into promises and async functions.",
"tags": ["javascript", "webdev", "beginners"],
"positiveReactions": 342,
"commentsCount": 18,
"readingTimeMinutes": 6,
"publishedAt": "2023-05-01T09:30:00.000Z",
"author": "Jane Doe",
"authorUsername": "janedoe",
"coverImage": "https://dev.to/cover.png",
"readablePublishDate": "May 1"
}
FieldDescription
iddev.to article ID.
titleArticle title.
urlCanonical URL of the article on dev.to.
descriptionShort summary/excerpt.
tagsArray of tags (tag_list).
positiveReactionsNumber of positive reactions (positive_reactions_count).
commentsCountNumber of comments (comments_count).
readingTimeMinutesEstimated reading time in minutes.
publishedAtPublish time as an ISO 8601 timestamp.
authorAuthor (or organization) display name.
authorUsernameAuthor's dev.to username.
coverImageCover image URL (null when there is none).
readablePublishDateHuman-friendly publish date (e.g. May 1).

If an item can't be processed, the row is { "id": <id>, "error": "<message>" } instead.

Pricing

This actor uses the pay-per-event model: you are charged once per article returned (the article-scraped event). Malformed items produce an error row and are never charged.

Data source

The actor talks to the official DEV Community (Forem) API:

  • Base URL: https://dev.to/api
  • Articles: /articles?per_page=100&page=N (plus &tag= and/or &username= when provided)

The API is free and requires no authentication.

License

MIT © Assia Fadli