HTML/Web Media Scraper

HTML/Web Media Elements Scraper

Overview

The Web Media Scraping Tool is a powerful utility designed to extract various media files, including images, videos, audio, and other related elements, from multiple websites. It provides a convenient way to gather media content and retrieve associated descriptions or alt="" content. The tool supports output formats such as JSON or CSV and offers proxy support for websites with bot blocking features.

This documentation provides a comprehensive guide to the Web Media Scraper, a powerful tool designed to automate the process of collecting media files (images, videos, audio) and their corresponding descriptions from various websites.

Features

• Automated Extraction: Saves time by automatically collecting media from multiple websites.

• Rich Media Support: Captures images, videos, audio, and other relevant media elements.

• Description Retrieval: Extracts associated descriptions like "alt" text for accessibility.

• Flexible Output Formats: Choose your preferred format for seamless integration - JSON or CSV.

• Optional Proxy Support: Overcome website bot-blocking measures if necessary.

Benefits

• Increased Efficiency: Effortlessly gather media and descriptions from numerous websites in one go.

• Time-Saving: Automate the data gathering process, freeing your time for analysis and creative work.

• Streamlined Workflows: Easily integrate extracted media and descriptions into your projects.

Common Use Cases

Content Curation and Aggregation:

• Use the scraper to aggregate images from multiple sources, facilitating content curation for blogs, social media posts, or marketing campaigns.

Market Research and Competitor Analysis:

• Analyze images used by competitors or within specific industries to gain insights into market trends, preferences, and branding strategies.

Brand Monitoring and Reputation Management:

• Monitor image usage across various platforms to safeguard brand integrity and address any unauthorized or detrimental use of brand assets.

Identifying Influencer Partnerships:

• Identify potential influencers or content creators by tracking the images they share, enabling strategic partnerships for brand promotion.

Product and Image Recognition:

• Train machine learning models using scraped images for tasks like product recognition, visual search, or image classification.

Research and Data Analysis:

• Collect images for research purposes, such as studying visual trends, analyzing user-generated content, or conducting sentiment analysis.

Content Personalization:

• Utilize scraped images to personalize user experiences on websites, apps, or marketing materials based on user preferences and behaviors.

Digital Rights Management:

• Monitor image usage to enforce copyright protection, identify instances of infringement, and ensure compliance with intellectual property laws.

E-commerce Optimization:

• Extract product images from e-commerce platforms to analyze pricing strategies, competitor offerings, and visual merchandising tactics.

Event Tracking and Reporting:

• Capture images related to specific events, campaigns, or product launches for comprehensive tracking and post-event analysis.

Input

The actor requires only the website URLs from which to retrieve images and information on which proxies to utilize. You can specify multiple websites to obtain multiple results in a single run.

1{
2   "startUrls": [
3       {
4        "url": "https://apify.com",
5       },
6   ]
7}

Output

The actor saves its outcomes in the default dataset linked with the actor's operation. Subsequently, it offers the flexibility to export the data into different formats, including JSON, XML, CSV, or Excel.

Each website within the dataset is represented as a distinct object following this structure (illustrated in JSON format below):

1[{
2  "URL": "https://crawlee.dev/docs/guides/configuration",
3  "total_media": 5,
4  "media_elements": [],
5  "images": [
6    {
7      "id": "s6OotqTrMLa",
8      "url": "https://crawlee.dev/docs/guides/configuration",
9      "src": "/img/crawlee-light.svg",
10      "alt": "",
11      "type": "image"
12    },
13   
14    {
15      "id": "ZESUvm5A47e",
16      "src": "/img/crawlee-dark.svg",
17      "alt": "",
18      "url": "https://crawlee.dev/docs/guides/configuration",
19      "type": "image"
20    }
21  ],
22  
23   "svg": [
24    {
25      "id": "JwdyTS8P6Kt",
26      "url": "https://crawlee.dev/docs/guides/configuration",
27      "type": "svg"
28    },
29    
30    {
31      "id": "0r4WQSDIyNV",
32      "url": "https://crawlee.dev/docs/guides/configuration",
33      "type": "svg",
34    }
35  ],
36  "videos": [],
37  "audios": [],
38  "embed": [],
39  "object": [],
40  "canvas": [],
41},

Important: If you require customization or wish to request additional features, please feel free to contact us via email . We aim to respond to all inquiries within one business day, ensuring prompt assistance and addressing your needs effectively.