Pricing

$0.25 / completed report

Try for free

Go to Apify Store

Test Retry & Comparable Outcome Evidence Report

Try for free

Review archived individual test attempts in exact revision/environment cohorts. Trace retry recovery, mixed terminal outcomes and unresolved duplicate/gapped/skipped chains. Mapped CSV or JSON; downloadable reports; no CI access.

Pricing

$0.25 / completed report

Rating

0.0

(0)

Developer

Gilad Ronen

Actor stats

Bookmarked

Total users

Monthly active users

19 days ago

Last modified

Categories

Developer tools

Automation

You can access the Test Retry & Comparable Outcome Evidence Report programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "auditId": "weekly-2026-10-03",
10    "windowStart": "2026-10-01T00:00:00Z",
11    "windowEnd": "2026-10-03T00:00:00Z",
12    "asOf": "2026-10-03T06:00:00Z",
13    "observationCoverage": "complete",
14    "observations": [
15        {
16            "recordId": "001",
17            "project": "web",
18            "testId": "checkout-total",
19            "revision": "commit-001",
20            "environment": "chromium-ci",
21            "logicalExecutionId": "execution-a",
22            "attemptIndex": 0,
23            "status": "fail",
24            "observedAt": "2026-10-02T10:00:00Z",
25            "chainCoverage": "complete",
26            "sourceReference": "archive/001",
27        },
28        {
29            "recordId": "002",
30            "project": "web",
31            "testId": "checkout-total",
32            "revision": "commit-001",
33            "environment": "chromium-ci",
34            "logicalExecutionId": "execution-a",
35            "attemptIndex": 1,
36            "status": "pass",
37            "observedAt": "2026-10-02T10:01:00Z",
38            "chainCoverage": "complete",
39            "sourceReference": "archive/002",
40        },
41        {
42            "recordId": "003",
43            "project": "web",
44            "testId": "checkout-total",
45            "revision": "commit-001",
46            "environment": "chromium-ci",
47            "logicalExecutionId": "execution-b",
48            "attemptIndex": 0,
49            "status": "error",
50            "observedAt": "2026-10-02T10:02:00Z",
51            "chainCoverage": "complete",
52            "sourceReference": "archive/003",
53        },
54        {
55            "recordId": "004",
56            "project": "web",
57            "testId": "checkout-total",
58            "revision": "commit-001",
59            "environment": "chromium-ci",
60            "logicalExecutionId": "execution-c",
61            "attemptIndex": 0,
62            "status": "pass",
63            "observedAt": "2026-10-02T10:03:00Z",
64            "chainCoverage": "complete",
65            "sourceReference": "archive/004",
66        },
67        {
68            "recordId": "005",
69            "project": "web",
70            "testId": "checkout-total",
71            "revision": "commit-001",
72            "environment": "chromium-ci",
73            "logicalExecutionId": "execution-d",
74            "attemptIndex": 0,
75            "status": "fail",
76            "observedAt": "2026-10-02T10:04:00Z",
77            "chainCoverage": "complete",
78            "sourceReference": "archive/005",
79        },
80        {
81            "recordId": "006",
82            "project": "web",
83            "testId": "checkout-total",
84            "revision": "commit-001",
85            "environment": "chromium-ci",
86            "logicalExecutionId": "execution-d",
87            "attemptIndex": 2,
88            "status": "pass",
89            "observedAt": "2026-10-02T10:06:00Z",
90            "chainCoverage": "complete",
91            "sourceReference": "archive/006",
92        },
93        {
94            "recordId": "007",
95            "project": "web",
96            "testId": "checkout-total",
97            "revision": "commit-001",
98            "environment": "chromium-ci",
99            "logicalExecutionId": "execution-e",
100            "attemptIndex": 0,
101            "status": "skipped",
102            "observedAt": "2026-10-02T10:07:00Z",
103            "chainCoverage": "complete",
104            "sourceReference": "archive/007",
105        },
106        {
107            "recordId": "008",
108            "project": "web",
109            "testId": "checkout-total",
110            "revision": "commit-002",
111            "environment": "chromium-ci",
112            "logicalExecutionId": "execution-f",
113            "attemptIndex": 0,
114            "status": "pass",
115            "observedAt": "2026-10-02T10:08:00Z",
116            "chainCoverage": "complete",
117            "sourceReference": "archive/008",
118        },
119        {
120            "recordId": "009",
121            "project": "web",
122            "testId": "checkout-total",
123            "revision": "commit-001",
124            "environment": "chromium-ci",
125            "logicalExecutionId": "execution-g",
126            "attemptIndex": 0,
127            "status": "pass",
128            "observedAt": "2026-09-30T10:09:00Z",
129            "chainCoverage": "complete",
130            "sourceReference": "archive/009",
131        },
132    ],
133    "observationsCsv": "",
134    "observationColumns": {
135        "recordId": "recordId",
136        "project": "project",
137        "testId": "testId",
138        "revision": "revision",
139        "environment": "environment",
140        "logicalExecutionId": "logicalExecutionId",
141        "attemptIndex": "attemptIndex",
142        "status": "status",
143        "observedAt": "observedAt",
144        "chainCoverage": "chainCoverage",
145        "sourceReference": "sourceReference",
146    },
147    "csvDelimiter": ",",
148}
149
150# Run the Actor and wait for it to finish
151run = client.actor("h_murdock/test-retry-cohort-evidence").call(run_input=run_input)
152
153# Fetch and print Actor results from the run's dataset (if there are any)
154print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
155for item in client.dataset(run.default_dataset_id).iterate_items():
156    print(item)
157
158# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Test Retry & Comparable Outcome Evidence Report API in Python

The Apify API client for Python is the official library that allows you to use Test Retry & Comparable Outcome Evidence Report API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Test Retry & Comparable Outcome Evidence Report API in JavaScript

Test Retry & Comparable Outcome Evidence Report API through CLI

Test Retry & Comparable Outcome Evidence Report OpenAPI definition

Test Retry & Comparable Outcome Evidence Report API

Cypress Test Runner

valek.josef/cypress-test-runner

Run your Cypress tests on the Apify Platform effectively and easily. Just set up your test environment using a user-friendly UI and let the platform do the rest.

Josef Válek

Playwright Test Runner

jindrich.bar/playwright-test

Run Playwright tests across numerous browser configurations with Apify. Create your tests in seconds and get comprehensive test reports faster than ever.

Jindřich Bär

Bulk Domain Availability Evidence Checker

snapperwapper/domain-availability-evidence

Check up to 500 domains using public RDAP and DNS evidence, with conservative registered, likely-available, or unknown classifications.

snapperwapper

actor-test

alice_bob/actor-test

APIFY Hunter

Apple App Store Review Delta API

ursog/apple-app-store-review-delta-api

andre donda de sa

test_actor

zubair_shahzad/test-actor

This is a test actor

Zubair Shahzad

Parcel Billable Weight Evidence Report

h_murdock/parcel-billable-weight-evidence

Compare declared and audited parcel dimensions, exact dimensional and actual billable weights, and supplied invoice weights under caller rounding/divisor policies. Trace changes and missing evidence in CSV, JSON and HTML; no carrier credentials or refund claims.

Gilad Ronen

Campaign Spend vs Daily Plan Evidence Report

h_murdock/campaign-spend-plan-evidence

Compare daily cross-platform media plans with supplied spend exports. Trace cumulative and daily variance, missing-day coverage, currency/cost-basis scopes and remaining declared plan arithmetic. Mapped CSV/JSON; downloadable evidence; no account access.

Gilad Ronen

Support First Response Business Hours Report

h_murdock/support-business-hours-evidence

Compute first-response business duration and target due dates from normalized ticket exports and expanded work intervals. Flag incomplete calendars or response observations; export traceable evidence without support-system access.

Gilad Ronen

Lead Routing Change Fixture Report

h_murdock/lead-routing-change-fixtures

Compare baseline and candidate ordered literal lead-routing models against finite fixtures. Report owner changes, expected-owner mismatches, missing-field uncertainty and fixture-specific shadow evidence. JSON or mapped CSV; no CRM credentials or writes.

Gilad Ronen