CatchAll - Early Results

Retrieve all valid records from a completed CatchAll job with automatic pagination.

Check the current processing status and step progress of a CatchAll job.

CatchAll

newscatcher/catchall

Submit a CatchAll job, poll until completion, and retrieve all valid records. Results are saved to the Dataset and Key-Value Store.

Create a CatchAll job without polling or fetching results. Returns a job_id for use in modular workflows.

Expand an existing CatchAll job to process more records beyond the initial limit.

Pause or resume an existing CatchAll monitor.

Create a scheduled monitor for recurring CatchAll jobs with optional webhook delivery.

Update an existing CatchAll monitor's schedule or webhook configuration.

Get suggested validators, enrichments, and a date range for a query before submitting a job.

Job Scraper