Freeze what is being tested
Record the core build, configuration, app binaries, device profile, and scoring rules before results are opened. A later code or configuration change starts a new candidate.
We are publishing the standard before any product score. Product numbers will appear only after the relevant core passes a locked, repeated, multi-app review.
The standard covers detection, restraint, repeatability, and the production path. Passing one app or one run is not enough.
Record the core build, configuration, app binaries, device profile, and scoring rules before results are opened. A later code or configuration change starts a new candidate.
Exercise the supported Android scope across multiple apps and UI frameworks, including workflows that require navigation, saved state, and test data.
Grade end-to-end outcomes against a locked answer key. Include clean builds and hard negatives so a high catch count cannot hide noisy findings.
Run the same candidate repeatedly, disclose incomplete runs, and measure whether it reaches the intended workflows as well as whether it records a finding.
Verify review completion, bounded cost and time, evidence retention, monitoring, and rollback using the same configuration intended for production.
Release the cohort, denominator, exclusions, per-app outcomes, and known gaps beside any summary number. Inconclusive runs remain in the record.
The public site should not make the verification decision before the test record does. These limits remain explicit until a result meets the standard.
We are working with a small number of Android teams whose real release workflows can strengthen the multi-app validation set. Participation is scoped before any review.