BIG W Marketplace Scraper - Products & Reviews

Scrape third-party BIG W Marketplace seller listings from bigw.com.au into a clean, structured dataset. Search by keyword with brand, category, price, deal and rating filters, or paste product and search URLs directly. Optionally collect customer reviews with an aggregate rating summary for every product.

BIG W Marketplace is where third-party sellers list products alongside BIG W's own range on Australia's BIG W discount department store (Woolworths Group). This actor focuses on those marketplace-seller listings by default, and can also include BIG W's own listings when you want the full catalogue.

What you get

One flat record per product, including:

• Identity - name, title (full canonical title), brand, articleId, gtin, ean, mpn, barcodes
• Seller - sellerType (Marketplace Seller vs BIG W), sellerName (the third-party seller), productChannel, isMarketplace
• Price & specials - price, wasPrice (original / strike-through price), rrp, saving, savingsPercent, isOnSpecial, priceLabel (offer label such as "1/2 Price" or "35% OFF"), unitPrice (per 100g / 100ml / each), currency, clearance, onlineOnlyPromotion, promotions, paymentOptions (Afterpay / Zip / layby)
• Condition & availability - condition, listingStatus, inStock, maxQuantity, deliverable, collectable, limitedFreeShipping
• Category - category, categories, categoryPath (full breadcrumb)
• Variants - variants (size / code matrix), colours, sizes
• Media - imageUrl, images (full gallery)
• Description & specifications - description, specifications (name/value pairs)
• Rating - rating
• Fulfilment - delivery / collection options, logistic type
• Reviews (optional) - reviews[] with review text, star rating, author, date, pros/cons, photos and helpful votes, plus reviewStats (review count, average rating, star distribution)

Specials, offers & was-price

For discounted products the record carries the original / "was" price (wasPrice), the discount (saving and savingsPercent), the site's own offer label (priceLabel, e.g. "1/2 Price", "35% OFF", "Special") and an isOnSpecial flag. Where the site shows no offer, these fields are simply empty

• they are never fabricated. Grocery items also keep a per-unit price (unitPrice) for easy comparison. For example, a product reduced from $22.00 to $11.00 returns price: 11.0, wasPrice: 22.0, saving: 11.0, savingsPercent: 50, priceLabel: "1/2 Price".

Modes

Search by keyword + filters

Set Mode = search and add one or more Search keywords. Each keyword is searched separately. Refine with:

• Marketplace sellers only - keep only third-party seller listings (on by default); turn off to include BIG W's own range
• Specials / offers - show only products in one of BIG W's specials views: On special / reduced (half-price and percentage-off deals), Clearance, Flash deal, Lowest price in 7 / 14 days, or New arrivals. Combine with a keyword to find specials in a topic, or leave the keyword empty to browse all specials
• Brand - keep only a given brand
• Category id - restrict to a BIG W category (the trailing number in a category URL)
• Deal type (advanced) - filter by a raw deal label if you need one the selector above doesn't list
• Minimum / maximum price (AUD)
• Minimum rating (1-5)
• Include out-of-stock products - on by default
• Sort by - relevance, price low-to-high, price high-to-low, highest rated, or name A-Z

Leave the keyword empty to browse the whole marketplace.

Scrape pasted URLs

Set Mode = url and paste BIG W URLs:

• A product URL (containing /p/<id>, e.g. https://www.bigw.com.au/product/x/p/9900004603) returns that single product.
• A search URL (e.g. https://www.bigw.com.au/search?text=piano) returns multiple pages of results, walking forward from the page in the URL. Append a deal value (e.g. ...&deal=Special) to scope it to specials.

Reviews

Turn on Fetch customer reviews to attach each product's reviews and an aggregate rating summary. Use Max reviews per product to cap how many are collected per product (0 = all available). Products with no reviews simply return an empty reviews array. Reviews are widely available on BIG W products - for example, product 9900004603 carries 122 reviews with an average rating of 4.7, including review text, star rating, author and date.

Output limits

• Max products - overall cap across the run (0 = unlimited)
• Max pages per search - optional safety cap on result pages per keyword / URL. Set to 0 (the default) to walk the whole catalogue for a keyword or URL - the run still stops naturally once the storefront's own result total is reached or a page repeats with no new products, so there is no artificial page cap.
• Resume a large run: pass a prior run's ID (or dataset ID) as resumeFromRunId and the scraper seeds its de-duplication set from that run, appending only products it hasn't seen - handy for topping up a full-catalogue crawl without re-paying for duplicates.

Incremental & dedup mode (recurring monitoring)

resumeFromRunId continues one interrupted run. incrementalMode is for running the same search again and again (daily/scheduled) and getting only what changed, without pasting a run id every time - the actor remembers the previous run of the same search itself.

Turn on incrementalMode and every product is classified against the last run of the same search/filter setup:

• NEW - not seen before
• UPDATED - a real catalogue field changed (changedFields lists which)
• UNCHANGED - nothing changed since last time (suppressed - not returned or billed - unless emitUnchanged is on)
• REAPPEARED - was gone, is back
• EXPIRED - was tracked, no longer found (only synthesized when emitExpired is on AND the run fully scanned every keyword/URL with no maxItems/maxPages cap hit and no resumeFromRunId - a partial run never marks anything expired)

Every row also carries firstSeenAt / lastSeenAt. State is scoped automatically to your exact mode/keywords/URLs/filters (two different searches never share a baseline), or pin it yourself with stateKey to name a monitoring campaign explicitly. emitUnchanged and emitExpired are both off by default because they return - and bill - extra rows you already have.

What counts as a change: price, was-price, saving, specials/deal flags, stock, condition, listing status, fulfilment and the variant/colour/size matrix are all real catalogue data and trigger UPDATED. The aggregate rating and the reviews/reviewStats fields are driven by other customers rather than the product itself and change far more often than the catalogue data, so they are deliberately excluded from change detection (still fully returned when fetchReviews is on) - otherwise almost every recurring run would look like an update.

Send results into your apps (MCP connectors)

Optionally pipe results into the apps you already use via Model Context Protocol (MCP) connectors - Notion, Linear, Airtable or Apify. Authorize a connector under Apify → Settings → API & Integrations, then select it in the input. Notion gets a rich page-per-item export; other connectors get a best-effort write or digest. This never changes the dataset output.

Plan Requirement

Runs on any Apify plan. Using Apify Proxy is recommended for reliable results; on the free plan, coverage may be limited and some runs may return fewer results.

Example input

{
  "mode": "search",
  "queries": ["chocolate"],
  "specialsCategory": "special",
  "marketplaceOnly": false,
  "sortBy": "priceAsc",
  "fetchReviews": true,
  "maxReviewsPerProduct": 10,
  "maxItems": 50,
  "proxy": { "useApifyProxy": true }
}