[elezar]

Summary

Organize the conformance tests into file-transfer, lifecycle, policy-advisor, and smoke areas with individual story modules. This isolates the authoring layout change from both scenario ownership and runner extraction.

Stacked on #4120 (codex/4119-conformance-suite). Followed by #4537, #4538, and #4464.

Related Issue

Part of #4119 and #3954.

Changes

• Split the existing scenario files into story modules and area-local helpers with a Cargo integration-test entry point per area.
• Separate lifecycle persistence and stopped-sandbox deletion into independent tests, giving nine live conformance tests.
• Keep pure policy-draft assertions in a dedicated module and update their Cargo/nextest selection.
• Document story authoring and suite execution; retain the runner in its existing crate.

Testing

• mise run pre-commit passed for this signed-off commit.
• The tree matches the validated local story-module preview: runner tests, pure policy assertions, all-target compilation, and conformance Clippy passed.

Live gateway tests were not rerun during this split.

The combined stack at 7e72adc6c passed nix develop --command mise run --jobs 1 ci on 2026-10-14. This covers the configured repository lint, compile/type checks, and unit suites; live gateway/tmachine execution was not repeated during this split.

Checklist

• Follows Conventional Commits.
• Commits are signed off (DCO).
• Relevant suite and testing guidance updated.

[copy-pr-bot]

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

[github-actions]

🌿 Preview your docs: https://nvidia-preview-pr-4536.docs.buildwithfern.com/openshell

[github-actions]

This pull request has had no activity for 14 days and is now marked stale.

[elezar]

Area files are already split on main, including persistent_workspace and separate stopped-sandbox tests.

Closing as superseded. The conformance suite now lives at tests/suites/conformance on testkit (#4774), and #5137 migrates the features and drivers suites and deletes crates/openshell-conformance, so this stack's layout and runner changes no longer apply.

The one idea worth keeping, cleanup for resources testkit does not track (with a deliberate-panic test), is being discussed in #5137 (comment).

The contributor-guidance points from the old README are listed in #4120.