Skip to content

fix(evaluation): SIL AzureML validation submission has broken code path and script reference #377

@katriendg

Description

@katriendg

Component

evaluation/sil/scripts/submit-azureml-validation.sh

Issue Description

The SIL evaluation AzureML submission script has the same class of bugs fixed for RL training in #320 / PR #372:

  1. Entire repo uploaded as code snapshotLine 168 sets code_path="$REPO_ROOT", uploading the full repository instead of a narrow snapshot.

  2. Command references a non-existent script pathLine 271 uses command=bash training/scripts/validate.sh $cmd, but no file exists at that path. The actual validation script is at evaluation/sil/validate.sh.

Any attempt to run SIL validation via AzureML will fail with exit code 127 (No such file or directory), identical to the RL training failure described in #320.

Expected Behavior

  • The code snapshot should be scoped to only the directories needed for validation
  • The command should reference the correct script path relative to the snapshot root

Discovered During

PR #372 review — the RL training fix applied the same pattern corrections but the evaluation script was not updated.

Metadata

Metadata

Assignees

No one assigned

    Labels

    needs-triageNeeds initial review and categorization

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions