testing.md

Testing

简体中文

Run checks in increasing order of side effects.

1. Static package validation

npm install --no-package-lock --ignore-scripts
npm run validate
npm pack --dry-run

This validates the package manifest, JavaScript entry point, sync script, and packaged shell scripts.

2. Install the packed artifact

mkdir -p .release
npm pack --pack-destination .release
dsh plugin --profile test-scnet add ./.release/dsh-scnet-*.tgz
dsh --profile test-scnet --dump-config

Confirm that the composed configuration includes:

- id: scnet-skill-filesystem
- id: scnet

3. Read-only tool checks

Tool	Expected result
scnet_list_clusters	Returns the packaged cluster identifiers
scnet_show_cluster	Returns the selected profile contents
scnet_generate_job	Writes a profile-aware Slurm script in the current directory
scnet_status	Returns redacted local SCNet configuration
scnet_openapi_regions	Returns authorized regions without tokens
scnet_account_summary	Returns account status and balance
scnet_resource_summary	Returns queues and resource limits for a region
scnet_job_queues	Returns live regional Slurm queues
scnet_job_list	Lists active or historical jobs
scnet_limits	Returns user and scheduler resource limits
scnet_submit_job	Submits a job through OpenAPI or SSH; dry_run=true returns the pending request only
scnet_job_show	Returns one job's state, resources, and log paths
scnet_job_wait	Waits for a job to reach a terminal state with a bounded timeout
scnet_job_logs	Reads job logs by explicit path, or by job_id + work_dir
scnet_job_cancel	Cancels one job; dry_run=true returns the pending request only
scnet_file_list	Lists shared-storage files without modification
scnet_file_transfer	Uploads or downloads one file; defaults to no overwrite
scnet_notebook_regions	Lists Notebook-capable regions
scnet_notebook_resources	Returns Notebook resource groups
scnet_notebook_list	Lists redacted Notebook instances
scnet_notebook_show	Returns one redacted Notebook instance

Check both accelerator and CPU-only job generation. Review the output for the selected partition, memory, and GRES rules.

4. Local state changes

scnet_setup_ssh writes under ~/.ssh. Run it only with a real SCNet key, an explicit cluster, and a confirmed username. Review the resulting host entry and connection test.

5. Remote read-only checks

scnet_probe_cluster and scnet_refresh_cluster require a working SSH connection. Use dry_run=true where supported and review the proposed profile data before persisting it.

6. Scheduler-consuming checks

scnet_run_compute_probe and refresh operations with compute probing submit Slurm jobs. Confirm the target cluster, account policy, accelerator count, CPU count, and time limit before execution.

scnet_submit_job and scnet_job_cancel are mutating tools and consume or release real scheduler resources. Run them with dry_run=true first, confirm the resolved target region or cluster in the result, and never retry a timed-out submission blindly: query the job state instead.

Notebook lifecycle mutations are intentionally not exposed as deterministic DSH tools in this release. Test them only through the Skill CLI and start with --dry-run.

Cleanup

Remove the isolated test profile after verification:

dsh plugin --profile test-scnet remove dsh-scnet

Delete generated .slurm files and .release/ artifacts when they are no longer needed.