Changelog
All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog,
and this project adheres to Semantic Versioning.
[1.0.0] - 2025-12-23
Added
- Initial release of Competitor Website Change Tracker
- Playwright-based web scraping with full JavaScript rendering
- Smart content extraction with Mozilla Readability
- Intelligent diff engine with line-by-line comparison
- Noise removal via CSS selectors and regex patterns
- Screenshot capture for visual proof
- Snapshot management with automatic rotation
- Change detection with configurable thresholds
- Highlight detection for pricing, features, and promotions
- Webhook alerts for Slack, Discord, and custom endpoints
- Comprehensive input/output schemas
- Apify platform integration
- Dataset and Key-Value store support
- Scheduled run support
- Complete documentation and examples
Features
-
Smart Change Detection
- Line-by-line text diffing
- Configurable change percentage threshold
- Regex pattern ignoring for timestamps/dates
- CSS selector-based noise removal
-
Content Extraction
- Readability mode for article-like content
- Selector mode for precise targeting
- HTML2Text mode for simple conversion
- Markdown output support
-
Snapshot Management
- Automatic current/previous rotation
- Text and HTML snapshot storage
- Screenshot storage with PNG format
- Metadata tracking
-
Alert System
- Slack webhook integration with rich formatting
- Discord webhook integration with embeds
- Custom webhook support with JSON payload
- Conditional alerts (only when changed)
- Screenshot URL inclusion
-
Highlight Detection
- Price change detection
- Feature announcement detection
- Plan/tier change detection
- Promotion/discount detection
Documentation
- Comprehensive README with examples
- Detailed PRICING guide with cost calculator
- SETUP guide with step-by-step instructions
- Example input files for common use cases
- Input/output schema documentation
Examples
- Minimal configuration example
- Pricing monitoring example
- Multi-competitor tracking example
- Discord webhook example
[Unreleased]
Planned Features
- HTML structural diff comparison
- Screenshot pixel diff comparison
- AI-powered change summarization
- Email alert support
- SMS alert support
- Baseline snapshot management
- Retention policy for old snapshots
- Change history visualization
- API endpoint for programmatic access
- Bulk URL import from CSV
- Custom extraction rules
- Rate limiting and retry logic
- Proxy support for geo-restricted content
- Authentication support (cookies, headers)
- PDF snapshot generation
- Change report PDF export
Improvements
- Performance optimization for large-scale monitoring
- Better error handling and recovery
- Enhanced logging and debugging
- Memory usage optimization
- Parallel URL processing
- Incremental snapshot updates
Version History
v1.0.0 (2025-12-23)
- Initial public release
- Core functionality complete
- Production-ready
Migration Guides
From Manual Monitoring
- List all competitor URLs you currently track
- Create input.json with your URLs
- Configure selectors to target relevant content
- Set up webhook for alerts
- Schedule daily runs
- Review first results and adjust thresholds
From Custom Scripts
- Map your URL list to input schema
- Migrate selector logic to
selectors.content
- Convert ignore rules to
selectors.ignore
- Replace diff logic with
diff configuration
- Update webhook integration
- Test and deploy
Support
For questions, issues, or feature requests:
