# Roadbikedatabase Scraper (`nerdnd/roadbikedatabase-scraper`) Actor roadbikedatabase.com scraper that collects bycicle specs(name, prices, sizes, etc.) on the product pages. - **URL**: https://apify.com/nerdnd/roadbikedatabase-scraper.md - **Developed by:** [nerdnd](https://apify.com/nerdnd) (community) - **Categories:** Travel - **Stats:** 6 total users, 0 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing $20.00/month + usage To use this Actor, you pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period.You also pay for the Apify platform usage, which gets cheaper the higher Apify subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#rental-actors ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ### What does Roadbikedatabase Scraper do? Roadbikedatabase Scraper will enable you to collect bycicle specs(name, prices, sizes, etc.) on the product pages. Roadbikedatabase Scraper can scrape: - year - name - brand - price - family - category - sizes - frame - fork - motor - battery - hubs - wheels - wheel_size - spokes - tires - chain - crank - bottom_bracket - derailleur_front - derailleur_rear - shifters - brakeset - handlebar - saddle - seatpost - stem - grips - headset - manufacturer_url - loaded_url - image_url ### Why scrape [Roadbikedatabase](https://roadbikedatabase.com)? [Roadbikedatabase](https://roadbikedatabase.com) boasts a comprehensive catalog of road bikes from numerous brands and models. This extensive collection makes it a go-to resource for cyclists seeking to research and compare different bikes based on detailed specifications, performance metrics, and user feedback. 1. Extensive Collection of Road Bikes Road Bike Database boasts a comprehensive catalog of road bikes from numerous brands and models. This extensive collection makes it a go-to resource for cyclists seeking to research and compare different bikes based on detailed specifications, performance metrics, and user feedback. 2. Detailed Specifications and User Reviews The site offers in-depth specifications for each bike, including frame materials, geometry, component details, and weight. Additionally, Road Bike Database features user reviews and ratings, providing potential buyers with valuable insights into the real-world performance and reliability of various bikes. 3. Up-to-Date and Accurate Information Road Bike Database is consistently updated with the latest information and releases from leading road bike manufacturers. This ensures that users have access to the most current and accurate data, helping them stay informed about the newest trends and technological advancements in road biking. 4. User-Friendly Interface The website’s user-friendly design makes it easy to navigate and find relevant information. Advanced search and filter options allow users to quickly narrow down their choices based on specific criteria such as brand, model year, price range, and technical features. 5. Engaged Community Road Bike Database fosters a strong community of road biking enthusiasts. Users can share their experiences, ask questions, and provide feedback on different bikes. This community-driven aspect enriches the site by offering diverse perspectives and firsthand accounts. 6. Educational Resources In addition to bike listings, Road Bike Database offers a wealth of educational content, including buying guides, maintenance tips, and industry news. This helps both novice and experienced riders make informed decisions and stay knowledgeable about various aspects of road biking. 7. Trusted Platform for Buyers and Sellers For those looking to buy or sell road bikes, Road Bike Database serves as a trusted platform. Buyers can rely on the detailed information and reviews to make confident purchasing decisions, while sellers can reach a targeted audience of road biking enthusiasts. 8. Market Transparency By providing detailed information and user reviews, Road Bike Database enhances transparency in the road biking market. This helps consumers make well-informed choices and encourages manufacturers to continuously improve their products and services. In summary, Road Bike Database is an essential site for anyone interested in road biking. Its extensive collection of road bikes, detailed specifications, user reviews, and educational resources make it an indispensable tool for researching, comparing, and choosing the best road bikes on the market. ### How to scrape [Roadbikedatabase](https://roadbikedatabase.com) It's easy to scrape [target website name with link] with Roadbikedatabase Scraper. Just follow these few steps and you'll get your data in a few minutes. 1. Click on Try for free. 2. Enter start urls(it should be product detail pages) you want to scrape. 3. Click on Run. 4. When Roadbikedatabase Scraper has finished, preview or download your data from the Dataset tab. ### Results ```json [ { "image_url": "https://cdn.mtbdatabase.com/wp-content/uploads/2021/08/15032618/2022-Trek-Marlin-6.jpg.webp", "manufacturer_url": "https://www.trekbikes.com/us/en_US/bikes/mountain-bikes/cross-country-mountain-bikes/marlin/marlin-6/p/35066/", "id": "956eaa8a5acd2ea175ec23b6fdba9505080c4d0d", "family": "Marlin", "name": "Marlin 6", "category": "Cross Country", "sizes": "13.5\", 15.5\", 17.5\", 18.5\", 19.5\", 21.5\", 23\"", "year": "2022", "brand": "Trek", "loaded_url": "https://mtbdatabase.com/bikes/2022/trek/marlin/2022-trek-marlin-6/", "frame": "Alpha Silver Aluminum, internal routing, chainstay disc brake mount, rack and kickstand mount, 135x5mm QR", "fork": "SunTour XCT, Size: XS, SR Suntour XCT 30, coil spring, preload, hydraulic lockout, 42mm offset for 27.5'' wheel, 100mm QR, 80mm travel; Size: S, SR Suntour XCT 30, coil spring, preload, hydraulic lockout, 42mm offset for 27.5'' wheel, 100mm QR, 100mm travel; Size: M, ML, L, XL, XXL, SR Suntour XCT 30, coil spring, preload, hydraulic lockout, 46mm offset for 29'' wheel, 100mm QR, 100mm travelSR SuntourSR SuntourSR Suntour", "hubs": "Formula DC-22, alloy, 6-bolt, Shimano 8/9/10 freehub, 135x5mm QRFormulaShimano", "wheels": "Bontrager Connection, double-wall, 32-hole, 20mm width, schrader valveBontrager", "wheel_size": "\n29\" 27.5\" ", "spokes": "14g stainless steel", "tires": "Size: XS, S, Bontrager XR2 Comp, wire bead, 30 tpi, 27.5x2.20''; Size: M, ML, L, XL, XXL, Bontrager XR2 Comp, wire bead, 30 tpi, 29x2.20''BontragerBontrager", "chain": "KMC, KMC X10, 10 speedKMCKMC", "crank": "Prowheel C10Y-NW, 30T steel narrow-wide ring, 170mm lengthProwheel", "bottom_bracket": "VP BC73, 73mm, threaded cartridge", "derailleur_rear": "Shimano Deore, Shimano Deore M5120, long cageShimanoShimano", "shifters": "Shimano Deore, Shimano Deore M4100, 10 speedShimanoShimano", "brakeset": "Tektro, Size: XS, S, Tektro HD-M276 hydraulic disc, short reach lever; Size: M, ML, L, XL, XXL, Tektro HD-M275 hydraulic discTektroTektroTektro", "handlebar": "Size: XS, Bontrager alloy, 31.8mm, 5mm rise, 690mm width; Size: S, M, ML, L, XL, XXL, Bontrager alloy, 31.8mm, 5mm rise, 720mm widthBontragerBontrager", "saddle": "Bontrager Arvada, steel rails, 138mm widthBontrager", "seatpost": "Size: XS, S, M, Bontrager alloy, 31.6mm, 12mm offset, 330mm length; Size: ML, L, XL, XXL, Bontrager alloy, 31.6mm, 12mm offset, 400mm lengthBontragerBontrager", "stem": "Size: XS, Bontrager alloy, 31.8mm, Blendr compatible, 7 degree, 50mm length; Size: S, Bontrager alloy, 31.8mm, Blendr compatible, 7 degree, 60mm length; Size: M, Bontrager alloy, 31.8mm, Blendr compatible, 7 degree, 70mm length; Size: ML, L, Bontrager alloy, 31.8mm, Blendr compatible, 7 degree, 80mm length; Size: XL, XXL, Bontrager alloy, 31.8mm, Blendr compatible, 7 degree, 90mm lengthBontragerBontragerBontragerBontragerBontrager", "grips": "Bontrager XR Endurance Comp, lock-onBontrager", "headset": "Semi-integrated, 1-1/8''" }, { "image_url": "https://roadbikedatabase.com/wp-content/uploads/2023/10/2024-Trek-Madone-SLR-6-AXS-Gen-7.jpeg.webp", "manufacturer_url": "https://www.trekbikes.com/us/en_US/bikes/road-bikes/performance-road-bikes/madone/madone-slr/madone-slr-6-axs-gen-7/p/37417/", "id": "12f3ed8ad5040350d1107548f27db9812c761b8c", "family": "Madone", "name": "Madone SLR 6 AXS Gen 7", "price": "$8,399.00", "category": "aero", "sizes": "47cm, 50cm, 52cm, 54cm, 56cm, 58cm, 60cm, 62cm", "year": "2024", "brand": "Trek", "loaded_url": "https://roadbikedatabase.com/bikes/2024/trek/madone/2024-trek-madone-slr-6-axs-gen-7/", "frame": "800 Series OCLV Carbon, KVF (Kammtail Virtual Foil) tube shape, IsoFlow seat tube, invisible cable routing, 3S aero chain keeper, T47 BB, flat mount disc, 142x12mm thru axle", "fork": "Madone KVF full carbon, tapered carbon steerer, internal brake routing, flat mount disc, carbon dropouts, 12x100mm thru axle", "wheels": "Bontrager Aeolus Pro 51, OCLV Carbon, Tubeless ReadyBontrager", "tires": "Bontrager R3 Hard-Case Lite, aramid bead, 120 tpi, 700x25mmBontrager", "chain": "SRAM Rival, 12 speedSRAM", "crank": "Size: 47, SRAM Rival AXS w/ power meter, 48/35, DUB, 165mm length; Size: 50, 52, SRAM Rival AXS w/ power meter, 48/35, DUB, 170mm length; Size: 54, 56, 58, SRAM Rival AXS w/ power meter, 48/35, DUB, 172.5mm length; Size: 60, 62, SRAM Rival AXS w/ power meter, 48/35, DUB, 175mm lengthSRAMSRAMSRAMSRAM", "bottom_bracket": "SRAM DUB, T47 threaded, internal bearingSRAM", "derailleur_front": "SRAM Rival eTap AXS, braze-onSRAM", "derailleur_rear": "SRAM Rival eTap AXSSRAM", "shifters": "SRAM Rival eTap AXS, 12 speedSRAM", "brakeset": "SRAM Rival hydraulic disc, flat mountSRAM", "saddle": "Size: 47, 50, 52, Bontrager Aeolus P2 Elite, 155mm width; Size: 54, 56, 58, 60, 62, Bontrager Aeolus Elite, austenite rails, 145mm widthBontragerBontrager", "seatpost": "Size: 47, 50, 52, 54, Madone aero carbon internal seatmast cap, integrated light mount, 0mm offset, short length; Size: 56, 58, 60, 62, Madone aero carbon internal seatmast cap, integrated light mount, 0mm offset, tall length" } ] ```` ### Is it legal to scrape [Roadbikedatabase](https://roadbikedatabase.com)? Note that personal data is protected by GDPR in the European Union and by other regulations around the world. You should not scrape personal data unless you have a legitimate reason to do so. If you're unsure whether your reason is legitimate, consult your lawyers. We also recommend that you read our blog post: [is web scraping legal?](https://blog.apify.com/is-web-scraping-legal/) # Actor input Schema ## `startUrls` (type: `array`): Detail page URLs to start with ## `proxyConfiguration` (type: `object`): Specifies proxy servers that will be used by the scraper in order to hide its origin. ## Actor input object example ```json { "startUrls": [ "https://roadbikedatabase.com/bikes/2024/wilier/urta-max/2024-wilier-urta-max-slr-sram-eagle-xx-sl-1x12/", "https://roadbikedatabase.com/bikes/2024/trek/madone/2024-trek-madone-slr-6-axs-gen-7/" ], "proxyConfiguration": { "useApifyProxy": true } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ "https://roadbikedatabase.com/bikes/2024/wilier/urta-max/2024-wilier-urta-max-slr-sram-eagle-xx-sl-1x12/", "https://roadbikedatabase.com/bikes/2024/trek/madone/2024-trek-madone-slr-6-axs-gen-7/" ], "proxyConfiguration": { "useApifyProxy": true } }; // Run the Actor and wait for it to finish const run = await client.actor("nerdnd/roadbikedatabase-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [ "https://roadbikedatabase.com/bikes/2024/wilier/urta-max/2024-wilier-urta-max-slr-sram-eagle-xx-sl-1x12/", "https://roadbikedatabase.com/bikes/2024/trek/madone/2024-trek-madone-slr-6-axs-gen-7/", ], "proxyConfiguration": { "useApifyProxy": True }, } # Run the Actor and wait for it to finish run = client.actor("nerdnd/roadbikedatabase-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ "https://roadbikedatabase.com/bikes/2024/wilier/urta-max/2024-wilier-urta-max-slr-sram-eagle-xx-sl-1x12/", "https://roadbikedatabase.com/bikes/2024/trek/madone/2024-trek-madone-slr-6-axs-gen-7/" ], "proxyConfiguration": { "useApifyProxy": true } }' | apify call nerdnd/roadbikedatabase-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=nerdnd/roadbikedatabase-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Roadbikedatabase Scraper", "description": "roadbikedatabase.com scraper that collects bycicle specs(name, prices, sizes, etc.) on the product pages.", "version": "0.0", "x-build-id": "I8GlaBlJc9HKK0E0A" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/nerdnd~roadbikedatabase-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-nerdnd-roadbikedatabase-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/nerdnd~roadbikedatabase-scraper/runs": { "post": { "operationId": "runs-sync-nerdnd-roadbikedatabase-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/nerdnd~roadbikedatabase-scraper/run-sync": { "post": { "operationId": "run-sync-nerdnd-roadbikedatabase-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "startUrls" ], "properties": { "startUrls": { "title": "Start URLs", "uniqueItems": true, "type": "array", "description": "Detail page URLs to start with", "items": { "type": "string" } }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Specifies proxy servers that will be used by the scraper in order to hide its origin.", "default": { "useApifyProxy": true } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```