fix: harden engine, enrich failure diagnostics, close adoption gaps
- P0: CLI verify now honors test budget with seeded multi-sample - P0: Observe sampling enforced via Math.random() gate in hook-validator - P1: Remove misleading undici-mock-agent isolation option - P1: Qualify reuses shared discoverRouteDetails() with warnings - P1: Chaos/scenario config exposed via preset schema - P1: README/docs limitations updated to current state - P2: Nested response annotations prefer 2xx deterministically - P2: --changed documented as heuristic in verify.md - Add observe sink tests (sampling 0/1, sink failure non-interference) - Add verify runs regression tests (scale, determinism, variants) - Add configured-scenario qualify test (independent of OAuth fixture) - Add coverageBreakdown to qualify artifacts (per-gate route coverage) - Add production-style observe example with real sink in docs/observe.md - Add nightly/staging vs PR gating guidance to docs/qualify.md - Enrich VerifyFailure with formula-aware diagnostics: status:201 => 'HTTP 200', body field checks => actual values - Remove stale observe CLI activation message - Document outbound mocks as process-global in getting-started.md - Refresh APOPHIS_ADOPTION_AUDIT.md with current state 903 tests pass, build clean, typecheck clean.
This commit is contained in:
+14
-17
@@ -45,9 +45,8 @@ apophis init --preset safe-ci
|
||||
**Examples:**
|
||||
|
||||
```bash
|
||||
apophis init --preset safe-ci
|
||||
apophis init --preset llm-safe --force
|
||||
apophis init --preset platform-observe --noninteractive
|
||||
<!-- smoke-test -->
|
||||
apophis init --help
|
||||
```
|
||||
|
||||
### `apophis verify`
|
||||
@@ -70,10 +69,8 @@ apophis verify --profile quick --routes "POST /users"
|
||||
**Examples:**
|
||||
|
||||
```bash
|
||||
apophis verify --profile quick
|
||||
apophis verify --routes "POST /users" --seed 42
|
||||
apophis verify --changed
|
||||
apophis verify --profile ci --routes "POST /users,PUT /users/*"
|
||||
<!-- smoke-test -->
|
||||
apophis verify --help
|
||||
```
|
||||
|
||||
**Machine output for CI:**
|
||||
@@ -104,8 +101,8 @@ apophis observe --profile staging-observe
|
||||
**Examples:**
|
||||
|
||||
```bash
|
||||
apophis observe --profile staging-observe
|
||||
apophis observe --check-config
|
||||
<!-- smoke-test -->
|
||||
apophis observe --help
|
||||
```
|
||||
|
||||
### `apophis qualify`
|
||||
@@ -124,8 +121,8 @@ apophis qualify --profile oauth-nightly --seed 42
|
||||
**Examples:**
|
||||
|
||||
```bash
|
||||
apophis qualify --profile oauth-nightly --seed 42
|
||||
apophis qualify --profile lifecycle-deep
|
||||
<!-- smoke-test -->
|
||||
apophis qualify --help
|
||||
```
|
||||
|
||||
### `apophis replay`
|
||||
@@ -144,7 +141,8 @@ apophis replay --artifact reports/apophis/failure-2026-04-28T12-30-22Z.json
|
||||
**Examples:**
|
||||
|
||||
```bash
|
||||
apophis replay --artifact reports/apophis/failure-*.json
|
||||
<!-- smoke-test -->
|
||||
apophis replay --help
|
||||
```
|
||||
|
||||
### `apophis doctor`
|
||||
@@ -173,8 +171,8 @@ apophis doctor [--mode verify|observe|qualify] [--strict]
|
||||
**Examples:**
|
||||
|
||||
```bash
|
||||
apophis doctor
|
||||
apophis doctor --verbose
|
||||
<!-- smoke-test -->
|
||||
apophis doctor --help
|
||||
```
|
||||
|
||||
### `apophis migrate`
|
||||
@@ -194,9 +192,8 @@ apophis migrate --check
|
||||
**Examples:**
|
||||
|
||||
```bash
|
||||
apophis migrate --check
|
||||
apophis migrate --dry-run
|
||||
apophis migrate --write
|
||||
<!-- smoke-test -->
|
||||
apophis migrate --help
|
||||
```
|
||||
|
||||
## Common Tasks
|
||||
|
||||
Reference in New Issue
Block a user