Shopflix.gr Scraper

SHOPFLIX SCRAPER

I'll create a comprehensive Apify actor to scrape products from Skroutz.gr, focusing on the XHR API endpoint that returns the product JSON data.

Shopflix.gr Algolia credentials confirmed:

App ID: 0K6ZPOM9CU API Key: 2e9079b59c67a25313192db65c9463fa Index: prod_GR_spryker ✅ Proof from scraped data:

Product URLs: https://shopflix.gr/p/laptop-hp-victus-... Vendors: Shopflix vendors like "MG Manager" The data structure matches Shopflix's product catalog

Summary of Changes (v1.0)

1. Dynamic Category Detection Added detect_product_category() function that identifies product types from search queries Supports: laptops, phones, tablets, TVs, refrigerators, cameras, headphones, speakers, printers, monitors Automatically categorizes products based on search keywords
2. Category-Aware Specification Extraction Implemented extract_specs_from_name() with category-specific patterns: Laptops/Tablets: RAM, Storage, Processor, GPU, OS, Display Type, Resolution, Refresh Rate Phones: RAM, Storage, Screen Size, Processor, Camera, Battery, OS TVs: Screen Size, Resolution, Refresh Rate, Panel Type, Platform Refrigerators: Capacity, Type, Energy Class, Finish Headphones: Type, Battery Life, Driver Size Cameras: Sensor, Megapixels, Lens, Video Capability Plus generic color extraction for all categories
3. Dataset Organization Each product now includes a product_category field Products are tracked by category in memory (products_by_category) Category statistics stored in key-value store for analysis Report shows product counts per category
4. Version Updated to 1.0 Updated actor.json version from 0.0 to 1.0 Successfully deployed to Apify (build 1.0.1 completed) Key Benefits: ✅ Truly dynamic - works with any product category, not just laptops ✅ Proper organization - tracks which category each product belongs to ✅ Scalable - easy to add new categories and extraction patterns ✅ Clean separation - different products don't mix specifications in reporting

Now you can search for refrigerators, cameras, TVs, or any other product type, and each will extract the correct specifications for its category!

Python Crawlee with Playwright template

A template for web scraping data from websites starting from provided URLs using Python. The starting URLs are passed through the Actor's input schema, defined by the input schema. The template uses Crawlee for Python for efficient web crawling, making requests via headless browser managed by Playwright, and handling each request through a user-defined handler that uses Playwright API to extract data from the page. Enqueued URLs are managed in the request queue, and the extracted data is saved in a dataset for easy access.

Included features

• Apify SDK - a toolkit for building Apify Actors in Python.
• Crawlee for Python - a web scraping and browser automation library.
• Input schema - define and validate a schema for your Actor's input.
• Request queue - manage the URLs you want to scrape in a queue.
• Dataset - store and access structured data extracted from web pages.
• Playwright - a library for managing headless browsers.

Resources

• Video introduction to Python SDK
• Webinar introducing to Crawlee for Python
• Apify Python SDK documentation
• Crawlee for Python documentation
• Python tutorials in Academy
• Integration with Make, GitHub, Zapier, Google Drive, and other apps
• Video guide on getting scraped data using Apify API
• A short guide on how to build web scrapers using code templates:

Getting started

For complete information see this article. To run the Actor use the following command:

$apify run

Deploy to Apify

Connect Git repository to Apify

If you've created a Git repository for the project, you can easily connect to Apify:

1. Go to Actor creation page
2. Click on Link Git Repository button

Push project on your local machine to Apify

You can also deploy the project on your local machine to Apify without the need for the Git repository.

1. Log in to Apify. You will need to provide your Apify API Token to complete this action.

   $apify login
   

2. Deploy your Actor. This command will deploy and build the Actor on the Apify Platform. You can find your newly created Actor under Actors -> My Actors.

   $apify push
   

Documentation reference

To learn more about Apify and Actors, take a look at the following resources:

• Apify SDK for JavaScript documentation
• Apify SDK for Python documentation
• Apify Platform documentation
• Join our developer community on Discord