Smart Url Extractor avatar
Smart Url Extractor

Pricing

Pay per usage

Go to Apify Store
Smart Url Extractor

Smart Url Extractor

Intelligent web scraping Actor that automatically detects content types (products, jobs, articles, profiles) and extracts structured data with 15+ fields. Perfect for e-commerce monitoring, job aggregation, and content curation.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Mamadou Diao Bah

Mamadou Diao Bah

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

2 days ago

Last modified

Share

Smart URL Data Extractor

Intelligent web scraping Actor that automatically detects content types and extracts structured data from any URL.

🚀 Features

  • Automatic Content Detection: Identifies if a URL contains products, job listings, articles, or profiles
  • Intelligent Data Extraction: Extracts 15+ relevant fields based on detected content type
  • Multiple Content Types Supported:
    • 🛍️ Products: price, brand, rating, images, availability, SKU
    • 💼 Jobs: title, company, location, salary, description, employment type
    • 📰 Articles: headline, author, publish date, content, tags, category
    • 👤 Profiles: name, bio, avatar, location, social links

📥 Input Configuration

{
"startUrls": [
{ "url": "https://example.com/product" }
],
"maxConcurrency": 5,
"outputFormat": "json"
}

Parameters:

  • startUrls (required): Array of URLs to scrape
  • maxConcurrency (optional): Max number of concurrent requests (default: 5)
  • outputFormat (optional): Output format - "json" or "csv" (default: "json")

📤 Output

The Actor returns structured JSON data with automatically detected fields based on content type.

Example Output (Product):

{
"type": "product",
"url": "https://example.com/product",
"title": "Product Name",
"price": "$99.99",
"brand": "Brand Name",
"rating": "4.5 stars",
"availability": "In Stock",
"detectedType": "product",
"extractedAt": "2025-11-23T19:13:16.454Z"
}

🛠️ Use Cases

  • E-commerce price monitoring
  • Job board aggregation
  • Content curation and analysis
  • Profile data collection
  • Competitive intelligence

📖 Documentation

For detailed documentation, visit Apify Docs

👨‍💻 Author

Created by Diao-Bah-timbi

📝 License

Open-source (Apache 2.0)