docs(testops): mark G15b manifest registration executable

This commit is contained in:
pingqiu committed 2026-05-03 09:51:48 -07:00
1 parent ea2ca11f73
commit 83b953b613
2 files changed
+20 -12

No files matched your search

@@ -1,7 +1,7 @@
# V3 Phase 15 TestOps Plan
**Date**: 2026-05-03
**Status**: DRAFT v0.2; V3 `internal/testops` contract skeleton implemented
**Status**: DRAFT v0.3; V3 `internal/testops` contract skeleton implemented; first registered `go-test` scenario executable at `f51b79b`
**Scope**: end-to-end V3 test operations covering dev loop, gate close, regression, debug, hardware, K8s, chaos
**Code repo**: `seaweed_block` (V3 binaries / per-package go test)
**Docs repo**: `seaweedfs/sw-block/design/test/`
@@ -100,9 +100,15 @@ Implementation note:
- `Driver`
- `Registry`
- `ShellDriver`
- `GoTestDriver`
- registration decoding / driver construction
- This package is the code-level insertion point for V3 scenarios. A future
ported V2 testrunner should plug in by implementing `Driver`; it should not
replace the contract.
- Slice 1 landed at `seaweed_block@f51b79b`: `testops/registry/g15b-manifest.json`
loads into the registry, executes the G15b manifest/harness `go test`, and
writes standard `run-request.json`, `result.json`, and `test-stdout.log`
artifacts.
### 3.1 Layout
@@ -385,7 +391,7 @@ Each scenario has: a driver in `bridge/scenarios/`, a test instruction in
|---|---|---|---|---|
| `g15a-privileged` | `g15a-privileged.sh` | `v3-phase-15-g15a-privileged-qa-test-instruction.md` | `ac49adb` | L3 |
| `g15a-non-privileged` | `g15a-non-privileged.sh` | `v3-phase-15-g15a-qa-test-instruction.md` | `ac49adb` | L2 |
| `g15b-manifest` | `g15b-manifest.sh` | `v3-phase-15-g15b-manifest-qa-test-instruction.md` | `62325c9` | L1/L2 |
| `g15b-manifest` | `go-test` via `testops/registry/g15b-manifest.json` | `v3-phase-15-g15b-k8s-qa-test-instruction.md` | `f51b79b` | L1/L2 |
| `g15b-k8s-static` | `g15b-k8s-static.sh` | `v3-phase-15-g15b-k8s-qa-test-instruction.md` | `5375add` | L5 |
| `g9g-l2` | `g9g-l2.sh` | `v3-phase-15-g9g-qa-test-instruction.md` | `7ed9ab2` | L2 |
| `g8-failover-l2` | `g8-failover-l2.sh` | (forward-carry: derive from G8 mini-plan §12) | `b320336` | L2 |
@@ -439,7 +445,7 @@ Architect should override defaults before P1 starts.
Current sw recommendation:
- Ratify Q1/Q3/Q4 as default.
- Start P1 on top of `internal/testops`, not directly on raw shell scripts.
- Continue P1 on top of `internal/testops`, not directly on raw shell scripts; first executable registration is `g15b-manifest` at `f51b79b`.
- Treat V2 testrunner port as a future `Driver` implementation.
---
@@ -3,7 +3,7 @@
**Date**: 2026-05-03
**Status**: architect draft; complements `v3-phase-15-testops-plan.md`
**Scope**: how V3 gates/projects expose test scenarios so TestOps can discover, register, and run them independently
**Code anchor**: `seaweed_block/internal/testops` introduced at `c2b5d9a`
**Code anchor**: `seaweed_block/internal/testops` introduced at `c2b5d9a`; first registered `go-test` scenario landed at `f51b79b`
---
@@ -169,7 +169,7 @@ Initial driver types:
| Driver | Purpose | Current status |
|---|---|---|
| `shell` | Runs an existing script that reads normalized request and writes result. | Implemented as `internal/testops.ShellDriver`. |
| `go-test` | Runs `go test` package/focus commands and maps output to result. | Next recommended implementation. |
| `go-test` | Runs `go test` package/focus commands and maps output to result. | Implemented as `internal/testops.GoTestDriver` at `f51b79b`. |
| `k8s` | Applies manifests, waits for resources, collects logs. | Can start as shell wrapper; later native. |
| `privileged-host` | Runs sudo/host OS checks and captures pre/post state. | Can start as shell wrapper. |
| `yaml` | Runs future ported V2 testrunner parser/engine. | Future; conditional. |
@@ -220,7 +220,7 @@ The last rule is strict:
| Scenario | Driver | Layer | Known green | Status |
|---|---|---|---|---|
| `g15b-manifest` | `go-test` | L1/L2 | `62325c9` | ready to register |
| `g15b-manifest` | `go-test` | L1/L2 | `eb13105` | registered and executable at `f51b79b` |
| `g15b-k8s-static` | `shell` | L5 | `5375add` preflight only; K8s run pending | ready to register as pending-lab |
| `g15a-privileged` | `shell` | L3 | `ac49adb` | ready to register |
| `g15a-non-privileged` | `go-test` | L2 | `ac49adb` | ready to register |
@@ -230,24 +230,26 @@ The last rule is strict:
---
## §9 Recommended Next Slice
## §9 Slice 1 Result
Implement `testops/registry/g15b-manifest.json` and a minimal `go-test` driver.
`testops/registry/g15b-manifest.json` and a minimal `go-test` driver landed at `seaweed_block@f51b79b`.
Why this first:
Why this was first:
- It is non-privileged.
- It is fast.
- It proves the registration path without requiring K8s or m01.
- It gives QA an example registration file to copy.
Pass condition:
Pass condition, verified on `p15-g15b/k8s-static-pv@f51b79b`:
```powershell
go test ./internal/testops ./cmd/blockcsi -count=1
```
plus a small smoke that loads `g15b-manifest.json`, runs the registered scenario, and emits a valid `result.json` in a temp artifact dir.
The `internal/testops` suite includes the smoke that loads `g15b-manifest.json`, runs the registered scenario through `GoTestDriver`, and emits a valid `result.json` in a temp artifact dir.
Next slice: register `g15b-k8s-static` as a shell-driver scenario once the M02 rerun is green on the `eb13105+` manifest/harness fix.
---
@@ -255,6 +257,6 @@ plus a small smoke that loads `g15b-manifest.json`, runs the registered scenario
| Role | Status | Basis |
|---|---|---|
| sw | draft | captured V3 pluggable TestOps path after `internal/testops` skeleton |
| sw | draft | captured V3 pluggable TestOps path after `internal/testops` skeleton; Slice 1 executable registration landed at `f51b79b` |
| QA | pending | review registration shape and artifact expectations |
| architect | pending | ratify product/runtime non-plugin boundary |