Initial script for HELM leaderboards conversion with few examples · evaleval/every_eval_ever@eca51be

Triggered via pull request November 27, 2025 00:49

damian1996

synchronize #9

helm

Status Failure

Total duration 17s

Artifacts –

validate-data.yml

on: pull_request

10 errors

ValidationError: data/helm_lite/openai/text-davinci-002/8e148c02-102c-45ec-99c6-6256dd5f630f.json#L0

ValidationError: 'max_score' is a required property

ValidationError: data/helm_mmlu/anthropic/claude-3-sonnet-20240229/aad9ad28-483c-4f08-bf4f-461d015daf98.json#L0

ValidationError: 'max_score' is a required property

ValidationError: data/helm_classic/Luminous-Supreme-(70B)/fc26a5c8-3721-48fb-bc64-c919fab37c4c.json#L0

ValidationError: 'max_score' is a required property

ValidationError: data/helm_capabilities/openai/gpt-5-nano-2025-08-07/df6e814a-5bda-476a-83b9-a51aabc6812b.json#L0

ValidationError: 'max_score' is a required property

ValidationError: data/helm_capabilities/meta/llama-4-scout-17b-16e-instruct/3a513001-0dd9-47b7-b916-baaa7e6aca30.json#L0

ValidationError: 'max_score' is a required property

ValidationError: data/helm_classic/Cohere-xlarge-v20221108-(52.4B)/403091e6-f005-474f-b715-ca55124e98dd.json#L0

ValidationError: 'max_score' is a required property

ValidationError: data/helm_mmlu/openai/gpt-4o-2024-08-06/c9238640-2468-46e3-ba88-23822f6a818a.json#L0

ValidationError: 'max_score' is a required property

ValidationError: data/helm_mmlu/amazon/nova-lite-v1:0/2ec60e3f-d6cc-4157-a626-b6c277bd7953.json#L0

ValidationError: 'max_score' is a required property

ValidationError: data/helm_mmlu/openai/gpt-3.5-turbo-0125/3f8c5a31-4560-458e-8ec2-b4ddcecac506.json#L0

ValidationError: 'max_score' is a required property

ValidationError: data/helm_classic/TNLG-v2-(530B)/752994e1-7859-4546-a3fe-b16442852696.json#L0

ValidationError: 'max_score' is a required property