Initial script for HELM leaderboards conversion with few examples · evaleval/every_eval_ever@ff95568

Triggered via pull request November 27, 2025 00:32

damian1996

synchronize #9

helm

Status Failure

Total duration 19s

Artifacts –

validate-data.yml

on: pull_request

10 errors

ValidationError: data/helm_lite/openai/text-davinci-002/64ba0487-9e58-49f3-ac21-c125aba22aeb.json#L0

ValidationError: 'min_score' is a required property

ValidationError: data/helm_mmlu/anthropic/claude-3-sonnet-20240229/0edc4768-b3e3-48bb-ab93-4b68b8a84a94.json#L0

ValidationError: 'min_score' is a required property

ValidationError: data/helm_classic/Luminous-Supreme-(70B)/35b2fedf-79b6-49f6-8ba5-780e9094b080.json#L0

ValidationError: 'min_score' is a required property

ValidationError: data/helm_capabilities/openai/gpt-5-nano-2025-08-07/fca251dc-0571-4c54-8ee7-fc152c7c5107.json#L0

ValidationError: 'min_score' is a required property

ValidationError: data/helm_capabilities/meta/llama-4-scout-17b-16e-instruct/a601cc06-2edf-4ea8-a630-f138e53368cc.json#L0

ValidationError: 'min_score' is a required property

ValidationError: data/helm_classic/Cohere-xlarge-v20221108-(52.4B)/f008602b-54c0-4b8f-86c2-d858e988a1e9.json#L0

ValidationError: 'min_score' is a required property

ValidationError: data/helm_mmlu/openai/gpt-4o-2024-08-06/9f6e3eac-3dbc-48a3-9e95-2a29a8f11c57.json#L0

ValidationError: 'min_score' is a required property

ValidationError: data/helm_mmlu/amazon/nova-lite-v1:0/f5c4b653-7a41-462c-b643-97d98f6157a0.json#L0

ValidationError: 'min_score' is a required property

ValidationError: data/helm_mmlu/openai/gpt-3.5-turbo-0125/9e1f81ed-27da-466d-a1a3-e22419e9aceb.json#L0

ValidationError: 'min_score' is a required property

ValidationError: data/helm_classic/TNLG-v2-(530B)/555a8787-bab9-4de6-bd82-4c6572bf75e9.json#L0

ValidationError: 'min_score' is a required property