# Precious Metal Price Scraper (`victorious_ukulele/precious-metal-price-scraper`) Actor Scrape real-time prices for gold, silver, platinum & palladium from 20+ sources including Kitco, GoldPrice.org, Antam, Pegadaian, and Tokopedia. Compare precious metal rates in USD and IDR. Perfect for investors, traders, and gold businesses. Get price alerts on significant movements. - **URL**: https://apify.com/victorious_ukulele/precious-metal-price-scraper.md - **Developed by:** [Supernesia Creative Technology](https://apify.com/victorious_ukulele) (community) - **Categories:** Automation, Developer tools, Other - **Stats:** 11 total users, 0 monthly users, 0.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $0.01 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event ## What's an Apify Actor? An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md. ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run. For examples already wired to this Actor's own input schema, see the [API](#api) section below. Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`). # README ## Precious Metal Price Scraper A comprehensive web scraping actor for collecting precious metal prices from global and Indonesian sources with AI-powered trend analysis. ### Description This actor aggregates gold and metal prices from over 20 sources worldwide, including major global exchanges and Indonesian local markets. It provides real-time price data, historical trends, and AI-powered analysis for investment decision-making. The scraper covers multiple precious metals including gold, silver, platinum, and palladium, with automatic currency conversion and quality assessment. ### Features - **Multi-source Data Collection**: Aggregates prices from 20+ global and Indonesian sources - **AI Trend Analysis**: Provides intelligent trend analysis with momentum indicators and volatility scoring - **Data Normalization**: Converts all prices to standard units (oz, gram, kg) and currencies (USD, IDR) - **Quality Assessment**: Evaluates data quality with ratings (complete, partial, estimated, limited) - **Error Handling**: Robust error handling and logging for failed scraping attempts - **Structured Output**: Well-formatted JSON output compliant with defined schema - **Real-time Processing**: Near real-time price updates from multiple sources ### Data Sources #### Global Sources - GoldPrice.org - Kitco - TradingEconomics - Investing.com - GoldBroker - BullionVault - Metals Daily - LBMA (London Bullion Market Association) - Nasdaq #### Indonesian Local Sources - Logam Mulia (Antam) - Galeri24 - Pegadaian - Tokopedia - Indogold - Orori - Lakuemas - HargaEmas.org #### API Sources - GoldAPI.io - Metals-API.com ### Input The actor accepts JSON input with the following parameters: ````json { "metals": ["gold", "silver"], "sources": ["global", "local", "api"], "use_proxy": true } Input Parameters metals (array, optional): Types of metals to collect data for. Default: ["gold", "silver"] Options: "gold", "silver", "platinum", "palladium" sources (array, optional): Types of data sources to use. Default: ["global", "local"] Options: "global", "local", "api" use_proxy (boolean, optional): Whether to use proxy for scraping. Default: true Output The actor produces structured JSON data with the following format: json { "metalType": "gold", "source": "goldprice.org", "sourceUrl": "https://goldprice.org/", "priceBid": 1975.25, "priceAsk": 1976.75, "priceMid": 1976.0, "currency": "USD", "unit": "oz", "pricePerGram": 63.51, "pricePerKilo": 63510.0, "priceIDR": 30628000.0, "pricePerGramIDR": 984400.0, "pricePerKiloIDR": 984400000.0, "changePercent": 0.25, "changeValue": 4.92, "dayHigh": 1980.5, "dayLow": 1970.25, "yearHigh": 2080.0, "yearLow": 1810.5, "trend": "uptrend (moderate)", "trendReason": "Moderate upward movement with 0.25% increase", "volatilityScore": 0.35, "marketTime": "2023-11-29T17:45:00.000Z", "scrapedAt": "2023-11-29T17:45:30.000Z", "region": "Global", "market": "International", "exchange": "GoldPrice.org", "dataQuality": "complete", "status": "active" } Output Fields metalType: Type of metal (gold, silver, platinum, palladium) source: Name of the data source sourceUrl: Original source URL priceBid/priceAsk/priceMid: Bid/ask/mid prices currency/unit: Price currency and unit pricePerGram/pricePerKilo: Price per gram/kilo in original currency priceIDR/pricePerGramIDR/pricePerKiloIDR: Prices in Indonesian Rupiah changePercent/changeValue: Percentage and absolute price change dayHigh/dayLow/yearHigh/yearLow: Daily and yearly high/low prices trend/trendReason: AI trend analysis and reasoning volatilityScore: Volatility score (0-1 scale) marketTime/scrapedAt: Market and scraping timestamps region/market/exchange: Market and exchange information dataQuality: Data quality rating (complete, partial, estimated, limited) status: Data status (active, error) Installation Using Apify Console Create a new actor in Apify Console Select the "Python Crawlee with Playwright" template Replace the main.py code with this project's code Upload the dataset_schema.json file to define the output schema Local Development Install Apify CLI: bash Line Wrapping ## Using Homebrew brew install apify-cli ## Or using NPM npm -g install apify-cli Pull the actor from Apify Console: bash Line Wrapping Collapse 1 apify pull Run locally: bash Line Wrapping Collapse 1 apify run Usage Via Apify Console Navigate to the actor page in Apify Console Click on the "Input" tab Enter your desired input parameters Click "Run" to start the scraping process View results in the "Dataset" tab Via API bash Line Wrapping curl -X POST https://api.apify.com/v2/acts//runs?token= \ -d '{ "metals": ["gold", "silver"], "sources": ["global", "local"], "use_proxy": true }' Example Use Cases Investment Research: Collect comprehensive price data for precious metals investment analysis Market Monitoring: Monitor real-time price movements across multiple exchanges Price Comparison: Compare prices between global markets and Indonesian local markets Trend Analysis: Leverage AI-powered trend analysis for trading decisions Data Integration: Feed structured data into other financial systems or dashboards Data Views The actor provides multiple pre-configured dataset views: Live Prices: Real-time prices across all sources Best Prices: Find the lowest prices for each metal Global Markets: International spot prices (USD/oz) Indonesia Market: Local Indonesian prices (IDR/gram) Price Movers: Biggest price movements sorted by percentage change By Source: Compare prices from all sources Gold Only: Gold prices from all sources Trend Analysis: AI-powered trend analysis with volatility scores Detailed View: Complete data with all fields Errors: Failed scraping attempts Error Handling The actor includes comprehensive error handling: Failed scraping attempts are logged with detailed error messages Error responses are stored in the dataset with consistent structure Data validation ensures only properly formatted data is stored Retry mechanisms for temporary failures Rate Limiting To avoid overwhelming target websites: Requests are distributed across multiple proxy servers Delays are implemented between requests to the same domain Concurrent requests are limited to prevent server overload Contributing This project is maintained by Supernesia Creative Technology. For contributions or issues, please contact the development team. License This project is proprietary software of Supernesia Creative Technology. All rights reserved. Support For support and inquiries: Email: info@supernesia.id Website: https://supernesia.id # Actor input Schema ## `metals` (type: `array`): Select which precious metals to scrape prices for ## `sources` (type: `array`): Select which source categories to include ## `use_proxy` (type: `boolean`): Enable proxy for scraping requests ## Actor input object example ```json { "metals": [ "gold", "silver" ], "sources": [ "global", "local" ], "use_proxy": true } ```` # Actor output Schema ## `overview` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = {}; // Run the Actor and wait for it to finish const run = await client.actor("victorious_ukulele/precious-metal-price-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = {} # Run the Actor and wait for it to finish run = client.actor("victorious_ukulele/precious-metal-price-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}") for item in client.dataset(run.default_dataset_id).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{}' | apify call victorious_ukulele/precious-metal-price-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "type": "http", "url": "https://mcp.apify.com/?tools=fetch-actor-details,victorious_ukulele/precious-metal-price-scraper" } } } ``` The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer ` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations). ## OpenAPI specification Download the OpenAPI definition: https://api.apify.com/v2/actors/HnUReQt0fpbcQD8eF/builds/DAplBOfowf9LekFLH/openapi.json