Pricing

$19.99/month + usage

Try for free

Go to Apify Store

Noon Product Search Scraper

Try for free

Scrape products from noon.com by providing a search URL, with automatic pagination and comprehensive product information extraction.

Pricing

$19.99/month + usage

Rating

5.0

(1)

Developer

PowerAI

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

.actor/Dockerfile

# Specify the base Docker image. You can read more about
# the available images at https://docs.apify.com/sdk/js/docs/guides/docker-images
# You can also use any other image from Docker Hub.
FROM apify/actor-node-puppeteer-chrome

# Check preinstalled packages
RUN npm ls apify

# Copy just package.json and package-lock.json
# to speed up the build using Docker layer cache.
COPY package*.json ./

# Install NPM packages, skip optional and development dependencies to
# keep the image small. Avoid logging too much and print the dependency
# tree for debugging
RUN npm --quiet set progress=false \
    && npm install --omit=dev --omit=optional \
    && echo "Installed NPM packages:" \
    && (npm list --omit=dev --all || true) \
    && echo "Node.js version:" \
    && node --version \
    && echo "NPM version:" \
    && npm --version \
    && rm -r ~/.npm

# Next, copy the remaining files and directories with the source code.
# Since we do this after NPM install, quick build will be really fast
# for most source file changes.
COPY . ./


# Run the image.
CMD npm start --silent

.actor/actor.json

{
    "actorSpecification": 1,
    "name": "noon-products-search-scraper",
    "title": "Empty JavaScript project",
    "description": "Empty project in JavaScript.",
    "version": "0.0",
    "buildTag": "latest",
    "meta": {
        "templateId": "js-empty"
    },
    "input": "./input_schema.json",
    "dockerfile": "./Dockerfile"
}

.actor/input_schema.json

{
  "type": "object",
  "schemaVersion": 1,
  "title": "Noon Product Search Input",
  "properties": {
    "searchUrl": {
      "title": "Search URL",
      "type": "string",
      "description": "The complete noon search URL to scrape",
      "minLength": 1,
      "pattern": "^https://www\\.noon\\.com/",
      "editor": "textfield",
      "default": "https://www.noon.com/uae-en/search/?q=iphone+17+pro",
      "prefill": "https://www.noon.com/uae-en/search/?q=iphone+17+pro"
    },
    "maxItems": {
      "title": "Max Items",
      "type": "integer",
      "description": "Maximum number of products to fetch",
      "default": 50,
      "minimum": 1,
      "maximum": 10000,
      "editor": "number",
      "prefill": 50
    },
    "proxyConfiguration": {
      "title": "Proxy Configuration",
      "type": "object",
      "description": "Proxy settings for the actor",
      "default": {
        "useApifyProxy": false,
        "apifyProxyGroups": [
          "RESIDENTIAL"
        ]
      },
      "editor": "proxy",
      "prefill": {
        "useApifyProxy": false,
        "apifyProxyGroups": [
          "RESIDENTIAL"
        ]
      }
    }
  },
  "required": [
    "searchUrl"
  ]
}

src/main.js

1import { Actor } from 'apify';
2import { connect as connectRealBrowser } from 'puppeteer-real-browser';
3import * as cheerio from 'cheerio';
4
5// ============================================================================
6// 配置区域 - 可根据不同网站修改
7// ============================================================================
8const SCRAPER_CONFIG = {
9    // 无新数据时的最大等待次数
10    maxNoNewDataCount: 3,
11    // 无头浏览器
12    headless: false,
13    // 
14    turnstile: true,
15    // 过滤资源
16    filterResources: false,
17    // 最大数量
18    maxItems: 50,
19    // 请求url
20    requestUrl: 'https://www.noon.com/uae-en/search/?q=iphone+17+pro',
21    // TODO4: 用于去重的唯一标识符字段名
22    uniqueIdField: 'productId',
23    // TODO3: 等待的选择器（列表元素选择器）
24    waitSelector: '[data-qa="plp-product-box"]',
25    // TODO2: 自动翻页函数
26    autoScrollPage: async (page) => {
27        await page.evaluate(async () => {
28            const nextButton = document.querySelector('a[aria-label="Next page"]');
29            if (nextButton) {
30                nextButton.click();
31            }
32        });
33    }
34};
35
36// ============================================================================
37// 核心 Scraper 类 - 模板部分（一般不需要修改）
38// ============================================================================
39class BaseScraper {
40    /**
41     * 解析页面数据 - 需要自定义
42     * @param {CheerioAPI} $ - Cheerio 实例
43     * @returns {Array} - 解析后的数据数组
44     * 
45     * ⚠️ 自动生成的解析代码应该替换此方法的实现
46     */
47    parsePageItems($) {
48        // ==================== 开始：页面解析代码（可替换区域） ====================
49
50        const items = $(SCRAPER_CONFIG.waitSelector).map((i, el) => {
51            /**
52             * 数据列表的 DOM 结构：
53             * 见 数据列表DOM.html 文件
54             */
55            const $item = $(el);
56            const linkEl = $item.find('a[href*="/uae-en/"]').first();
57            const href = linkEl.attr('href') || '';
58            const productUrl = href ? `https://www.noon.com${href}` : '';
59            const productIdMatch = href.match(/N\d+V\/p\//);
60            const productId = productIdMatch ? productIdMatch[0].replace('/p/', '') : '';
61
62            const imageEl = $item.find('img').first();
63            const imageUrl = imageEl.attr('src') || imageEl.attr('data-src') || '';
64
65            const nameEl = $item.find('[data-qa="plp-product-box-name"]');
66            let productName = nameEl.text().trim();
67            if (!productName) {
68                const dataQa = imageEl.attr('data-qa') || '';
69                productName = dataQa.replace('productImagePLP_', '');
70            }
71
72            const priceEl = $item.find('div[class*="__sellingPrice"] > strong');
73            const price = priceEl.text().trim();
74
75            const discountEl = $item.find('div[class*="__discount"]');
76            const discount = discountEl.text().trim();
77
78            const deliveryEl = $item.find('[data-qa="product-noon-express"]');
79            const isExpress = deliveryEl.length > 0;
80
81            const deliveryDateEl = $item.find('.ProductDetailsSection-module-scss-module__estimatedDeliveryDateNewTextStyles');
82            const deliveryDate = deliveryDateEl.text().trim().replace(/\s+/g, ' ');
83
84            const deliveryTimeEl = $item.find('.FlyoutBadgeLarge-module-scss-module__estimationText');
85            const deliveryTime = deliveryTimeEl.text().trim().replace(/\s+/g, ' ');
86
87            return {
88                productId,
89                productName,
90                price,
91                imageUrl,
92                productUrl,
93                discount,
94                isExpress,
95                deliveryDate,
96                deliveryTime
97            };
98        }).get();
99
100        // ==================== 结束：页面解析代码（可替换区域） ====================
101
102        return items;
103    }
104
105    async run(input) {
106        const { searchUrl, maxItems = Infinity, proxyConfiguration } = input;
107        this.maxItems = maxItems;
108        this.searchUrl = searchUrl;
109        const proxyConfig = await Actor.createProxyConfiguration(proxyConfiguration);
110        const proxyUrl = proxyConfig ? await proxyConfig.newUrl() : undefined;
111        const proxyOptions = this.buildProxyOptions(proxyUrl);
112
113        const realBrowserOption = {
114            args: ["--start-maximized"],
115            turnstile: SCRAPER_CONFIG.turnstile,
116            headless: SCRAPER_CONFIG.headless,
117            // disableXvfb: true,
118            // ignoreAllFlags:true,
119            customConfig: {},
120            connectOption: {
121                defaultViewport: null
122            },
123            ...(proxyOptions ? { proxy: proxyOptions } : {}),
124            plugins: []
125        }
126
127        const { page, browser } = await connectRealBrowser(realBrowserOption);
128
129        try {
130            page.setDefaultNavigationTimeout(300 * 1000);
131            page.setDefaultTimeout(3600 * 1000);
132
133            // if (userAgent) {
134            //     await page.setUserAgent(userAgent);
135            // }
136
137            await this.handlePage(page, this.searchUrl);
138        } finally {
139            await browser?.close();
140        }
141    }
142
143    async handlePage(page, url) {
144        console.log(`Processing ${url}...`);
145        let count = 0;
146        let endOfResults = false;
147        let interceptedData = [];
148        let lastDataLength = 0;
149        let noNewDataCount = 0;
150
151        // await this.setupInterceptors(page, interceptedData);
152        await page.goto(url);
153
154        // 等待新内容加载
155        if (SCRAPER_CONFIG.waitSelector) {
156            await page.waitForSelector(SCRAPER_CONFIG.waitSelector, { timeout: 60000 }).catch(() => {
157                console.log(`data not found...`);
158            });
159        }
160
161        // 处理首页数据
162        const firstPageHtml = await page.content();
163        await this.processResponseData(firstPageHtml, interceptedData);
164
165        // 循环翻页获取数据
166        while (!endOfResults && interceptedData.length < this.maxItems) {
167            count++;
168            console.log(`data fetching...${count}`);
169            await this.randomDelay();
170
171            // 执行翻页操作
172            await SCRAPER_CONFIG.autoScrollPage(page);
173            await this.randomDelay(3000, 5000);
174
175            // 等待新内容加载
176            if (SCRAPER_CONFIG.waitSelector) {
177                await page.waitForSelector(SCRAPER_CONFIG.waitSelector, { timeout: 10000 }).catch(() => {
178                    console.log(`data not found...`);
179                });
180            }
181
182            // 处理新页面数据
183            const afterScrollHtml = await page.content();
184            await this.processResponseData(afterScrollHtml, interceptedData);
185
186            if (interceptedData.length === lastDataLength) {
187                noNewDataCount++;
188                if (noNewDataCount >= SCRAPER_CONFIG.maxNoNewDataCount) {
189                    endOfResults = true;
190                }
191            } else {
192                noNewDataCount = 0;
193                lastDataLength = interceptedData.length;
194            }
195        }
196
197        console.log(`Scraping completed. Total items: ${interceptedData.length}`);
198    }
199
200    // 设置请求拦截器（资源过滤）
201    async setupInterceptors(page, interceptedData) {
202        await page.setRequestInterception(true);
203        page.on('request', (request) => {
204            const resourceType = request.resourceType();
205            const blockedResourceTypes = [
206                'image',
207                'media',
208                'font',
209                'texttrack',
210                'stylesheet',
211                'ping'
212            ];
213
214            if (SCRAPER_CONFIG.filterResources && blockedResourceTypes.includes(resourceType)) {
215                request.abort();
216            } else {
217                request.continue();
218            }
219        });
220        page.on('response', async (response) => {
221            // 可选：拦截特定的 API 响应
222        });
223    }
224
225    // 处理响应数据（模板方法）
226    async processResponseData(htmlContent, interceptedData) {
227        let currentData = [];
228
229        if (!htmlContent) {
230            return;
231        }
232
233        const $ = cheerio.load(htmlContent);
234
235        // 调用自定义的解析方法
236        const items = this.parsePageItems($);
237
238        if (!items || items.length === 0) {
239            return;
240        }
241
242        // 去重处理
243        const uniqueField = SCRAPER_CONFIG.uniqueIdField;
244        const existingIds = new Set(interceptedData.map(item => item[uniqueField]));
245
246        let skippedCount = 0;
247        for (const listing of items) {
248            // 跳过已存在的项目
249            if (existingIds.has(listing[uniqueField])) {
250                skippedCount++;
251                continue;
252            }
253
254            const data = {
255                searchUrl: this.searchUrl,
256                ...listing,
257                scrapedAt: new Date().toISOString()
258            };
259
260            interceptedData.push(data);
261            currentData.push(data);
262            existingIds.add(listing[uniqueField]);
263
264            // 如果达到最大数量，停止处理
265            if (interceptedData.length >= this.maxItems) {
266                break;
267            }
268        }
269
270
271        // 保存数据
272        if (currentData.length > 0) {
273            console.log(`Saved ${currentData.length} items, total: ${interceptedData.length}`);
274            await Actor.pushData(currentData);
275        }
276    }
277
278    // 随机延迟
279    async randomDelay(min = 1000, max = 3000) {
280        const delay = Math.floor(Math.random() * (max - min + 1) + min);
281        await new Promise(resolve => setTimeout(resolve, delay));
282    }
283
284    // 可选：设置 cookies
285    async setCookies(page) {
286        // const cookies = [
287        //     {
288        //         name: 'cookie_name',
289        //         value: 'cookie_value',
290        //         domain: '.example.com',
291        //         path: '/',
292        //         expires: new Date('2025-12-31').getTime() / 1000,
293        //         secure: false
294        //     }
295        // ];
296        // await Promise.all(cookies.map(cookie => page.setCookie(cookie)));
297    }
298
299
300    buildProxyOptions(proxyUrl) {
301        if (!proxyUrl) {
302            return undefined;
303        }
304
305        try {
306            const parsed = new URL(proxyUrl);
307            if (!parsed.hostname || !parsed.port) {
308                return undefined;
309            }
310
311            return {
312                host: parsed.hostname,
313                port: Number(parsed.port),
314                username: parsed.username || undefined,
315                password: parsed.password || undefined,
316            };
317        } catch (error) {
318            console.warn(`Invalid proxy URL detected: ${proxyUrl}`, error);
319            return undefined;
320        }
321    }
322
323}
324
325
326// ============================================================================
327// Actor 入口
328// ============================================================================
329await Actor.init();
330
331Actor.main(async () => {
332    let input = await Actor.getInput();
333    if (!input) {
334        input = {
335            "searchUrl": SCRAPER_CONFIG.requestUrl,
336            "maxItems": SCRAPER_CONFIG.maxItems
337        };
338    }
339    const crawler = new BaseScraper();
340    await crawler.run(input);
341});

.dockerignore

# configurations
.idea

# crawlee and apify storage folders
apify_storage
crawlee_storage
storage

# installed files
node_modules

# git folder
.git

.editorconfig

root = true

[*]
indent_style = space
indent_size = 4
charset = utf-8
trim_trailing_whitespace = true
insert_final_newline = true
end_of_line = lf

.eslintrc

{
    "extends": "@apify",
    "root": true
}

.gitignore

# This file tells Git which files shouldn't be added to source control

.DS_Store
.idea
.zed
node_modules
storage

package.json

{
    "name": "js-scrape-single-page",
    "version": "0.0.1",
    "type": "module",
    "description": "This is an example of an Apify actor.",
    "engines": {
        "node": ">=18.0.0"
    },
    "dependencies": {
		"apify": "^3.4.4",
		"crawlee": "^3.11.5",
		"puppeteer": "^23.5.0",
		"puppeteer-core": "^23.5.0",
		"puppeteer-extra": "^3.3.6",
		"puppeteer-extra-plugin-stealth": "^2.11.2",
		"random-useragent": "^0.5.0",
        "rebrowser-puppeteer": "^23.10.3",
		"rebrowser-puppeteer-core": "^23.10.3",
        "puppeteer-real-browser": "^1.4.4",
        "ioredis": "^5.4.1",
        "marked": "^15.0.7",
		"node-fetch": "3",
        "uuid": "^11.1.0"
    },
    "scripts": {
        "start": "node ./src/main.js",
        "test": "echo \"Error: oops, the actor has no tests yet, sad!\" && exit 1"
    },
    "author": "It's not you it's me",
    "license": "ISC"
}

Noon Reviews Scraper 📊 - Cheap

scrapestorm/noon-reviews-scraper---cheap

Collect Noon.com product reviews by URL 🛍️ Access detailed review data including reviewer names, ratings, comments, images & more 📋 Perfect for analyzing customer feedback researching products & gathering data for projects or market study 📊 Ideal for shoppers marketers & e-commerce professionals

Storm_Scraper

5.0

(1)

Myntra Product Scraper 🛍️

easyapi/myntra-product-scraper

Extract detailed product information from Myntra.com search results. Get comprehensive data including prices, discounts, inventory, images, and more. Perfect for price monitoring, market research, and e-commerce analytics. 🛍️

EasyApi

166

2.6

(3)

Lidl Product Scraper 🛍️

easyapi/lidl-product-scraper

Scrape product data from Lidl's online store including prices, images, descriptions, ratings and stock information. Perfect for price monitoring, market research and competitive analysis.

EasyApi

5.0

(1)

Myntra Reviews Scraper 🛍️

easyapi/myntra-reviews-scraper

Scrape product reviews from Myntra.com - Extract detailed review data including ratings, comments, user info, and style attributes. Perfect for market research and customer sentiment analysis.

EasyApi

5.0

(1)

Uber Eats Store Search Scraper 🍽️

easyapi/uber-eats-store-search-scraper

Extract detailed restaurant data from Uber Eats search results. Get comprehensive information about stores including ratings, status, location, and images. Perfect for market research, competitor analysis, and food delivery insights. 🍽️🔍

EasyApi

Netmeds Product Scraper 🏥

easyapi/netmeds-product-scraper

Powerful scraper for Netmeds.com that extracts detailed product information including prices, manufacturers, brands, and inventory status. Perfect for healthcare market research, price monitoring, and catalog enrichment. Supports infinite scroll and provides comprehensive product data. 🏥

EasyApi

5.0

(1)

TradeIndia Product Scraper 🛍️

easyapi/tradeindia-product-scraper

Scrape product listings from TradeIndia.com - Extract detailed product information, company details, pricing, and business metrics. Perfect for market research, competitor analysis, and lead generation in the B2B space.

EasyApi

Lidl Reviews Scraper 🛍️

easyapi/lidl-reviews-scraper

Scrape product reviews from Lidl's online store. Extract detailed review data including ratings, review text, author info, and additional metrics. Perfect for market research and customer sentiment analysis.

EasyApi

5.0

(1)

Noon Advanced Scraper

buseta/noon-advanced-scraper

Scrape everything with Noon Advanced Scraper ! Whole category, search results, list of products, ratings, reviews, pricing info, and more... Last Update: 28 March, 2025

buseta

139

2.5

(3)

Monster | $0.99💰 | Search | Details | Scraper | Richest Output

memo23/monster-scraper

💰 $0.99 per 1,000 results. Collects Monster.com job data including IDs, titles, company metadata, salary ranges, employment types, posting dates, HTML descriptions, normalized locations, and apply URLs for recruitment analytics.