Commodity Intel

Fresh oil, gold, silver, and uranium headlines from permitted public sources, delivered as structured JSON.

Built for commodity dashboards, trading-signal agents, and newsletter writers who need a current read on commodity narratives without maintaining a scraper. Each record is a tagged headline — commodity, title, canonical URL, source, timestamp — ready to feed a model, a screener, or a morning briefing.

What you get

Field	Meaning
commodity	Tag from your source config: oil, gold, silver, uranium, or your own
title	The headline text as the source renders it
url	Canonical article link on the source's own domain
source	Source domain, e.g. oilprice.com
fetched_at	UTC timestamp of the run (ISO 8601)
extraction	Extraction method marker, currently selector_free_v1

Quick start

{
  "sources": [
    { "url": "https://oilprice.com/", "commodity": "oil" },
    { "url": "https://www.world-nuclear-news.org/", "commodity": "uranium" },
    { "url": "https://www.kitco.com/news/category/gold", "commodity": "gold" },
    { "url": "https://www.kitco.com/news/category/silver", "commodity": "silver" },
    { "url": "https://www.bullionvault.com/gold-news", "commodity": "gold" },
    { "url": "https://sprott.com/insights/?category=uranium", "commodity": "uranium" }
  ]
}

A run over these six curated sources returns up to 150 tagged headlines (25 per source) and typically completes in about a minute.

Output example

{
  "commodity": "oil",
  "title": "Hormuz Shutdown Forces Malaysia to Overhaul Crude Supply Chain",
  "url": "https://oilprice.com/Latest-Energy-News/World-News/Hormuz-Shutdown-Forces-Malaysia-to-Overhaul-Crude-Supply-Chain.html",
  "source": "oilprice.com",
  "fetched_at": "2026-06-10T14:02:11+00:00",
  "extraction": "selector_free_v1"
}

Why this one

• Selector-free extraction. Headlines are scored by link-text shape and URL structure, not site-specific CSS selectors, so a source redesign does not silently kill your feed.
• Zero-yield detection. A source that suddenly returns nothing is flagged zero_yield_check_layout in the HEALTH report instead of being quietly dropped.
• A commodity tag on every record. Route oil to one pipeline and uranium to another without re-classifying text downstream.
• Curated default sources. OilPrice, World Nuclear News, Kitco gold and silver, BullionVault, and Sprott — each checked against robots.txt on every run.
• Bring your own sources. Point it at any public commodity news listing page and tag it however you like.

Compliance and reliability

Topsail actors are built compliance-first and ship with self-healing plumbing:

• robots.txt is always respected — fail-closed. If a robots check cannot complete, the source is skipped, never scraped. There is no input to turn this off.
• This actor reads public, free-to-read news listing pages — OilPrice, World Nuclear News, Kitco gold and silver, BullionVault, and Sprott — the same headlines any visitor sees without an account.
• Transient failures retry once with backoff; persistent failures are reported, not hidden.
• Every run writes a per-source HEALTH report to the key-value store, so you can see exactly which sources delivered and which were blocked, empty, or erroring.
• No PII, no paywalled or login-gated content, no circumvention.

Pricing

Pay per result: $0.50 per 1,000 results. You pay only for headline records actually delivered to the dataset — sources that are robots-blocked, unreachable, or yield zero headlines add nothing to your bill. A default run caps at 150 results (about $0.08), so even an hourly schedule costs under $2 per day.

Honest limits

• Headlines only — title and link, not article bodies or summaries. Pair it with Topsail's Site to Markdown actor (linked below) when you need full text.
• The commodity tag comes from your source configuration, not text classification — a natural-gas story on OilPrice is tagged oil.
• Some sources append byline or date text to the linked headline; titles are delivered as the source renders them.
• Deduplication is per run. On a schedule, a headline repeats in consecutive runs until it leaves the source's listing page — dedupe downstream on url.
• Shape-based scoring is tuned for news listing pages: headlines under 28 characters are filtered out, and an occasional non-article link can slip through.
• Default sources are English-language.

FAQ

Is this a commodity news API? In practice, yes. Run it on a schedule and read the dataset over the Apify API, and you have a commodity news API covering oil, gold, silver, and uranium without writing a scraper.

Can I use it as an oil news feed only? Yes. Set sources to just the OilPrice entry — or any public oil news listing page — and every record comes back tagged oil.

How fresh is the gold news? As fresh as your schedule. Each run pulls what is on the sources' listing pages at that moment; hourly runs keep a dashboard within an hour of publication.

Can I add my own uranium or other sources? Yes. Add any public news listing page with a commodity tag of your choosing. It must pass the robots.txt check or it will be skipped.

Does it bypass paywalls or logins? No. It reads only public listing pages, respects robots.txt fail-closed, and collects no personal data.

More compliant data feeds from Topsail

• Site to Markdown — any site to clean LLM-ready markdown
• GTA 6 Countdown & Developments Tracker — countdown, confirmed facts, diffed developments, market odds
• Crypto News — BTC/ETH/DeFi headlines from major outlets
• AI Research Radar — new papers and lab announcements