Skip to content
Validate data

Merge pull request #14 from evaleval/schema_fixups #38

Sign in to view logs

Merge pull request #14 from evaleval/schema_fixups

Merge pull request #14 from evaleval/schema_fixups #38

Triggered via push December 11, 2025 21:10
@evijitevijit
pushed 4d807d0
main
Status Failure
Total duration 18s
Artifacts –

validate-data.yml

on: push
Validate data
13s
Validate data
Fit to window
Zoom out
Zoom in

Annotations

10 errors
ValidationError: data/hfopenllm_v2/jaspionjader/bh-16/c98928d3-0d7f-429c-927c-bf8fa432101a.json#L0
ValidationError: Additional properties are not allowed ('evaluation_source' was unexpected)
ValidationError: data/helm_mmlu/amazon/nova-lite-v1:0/8ae81b4a-58de-4c83-80fa-114bf0792ff0.json#L0
ValidationError: Additional properties are not allowed ('evaluation_source' was unexpected)
ValidationError: data/hfopenllm_v2/teknium/OpenHermes-13B/55d876b7-159e-4c76-848b-1480b4c2f4a2.json#L0
ValidationError: Additional properties are not allowed ('evaluation_source' was unexpected)
ValidationError: data/hfopenllm_v2/google/ehristoforu/Gemma2-9b-it-train6/e289e629-17dd-440e-8839-d5dcbe535fd6.json#L0
ValidationError: Additional properties are not allowed ('evaluation_source' was unexpected)
ValidationError: data/helm_mmlu/openai/gpt-3.5-turbo-0125/5c7de74d-26be-4462-8f29-fe0aa5f27068.json#L0
ValidationError: Additional properties are not allowed ('evaluation_source' was unexpected)
ValidationError: data/hfopenllm_v2/Quazim0t0/Oasis-14B-ties/a3ef4bc2-c560-4a62-8227-2bd30120b537.json#L0
ValidationError: Additional properties are not allowed ('evaluation_source' was unexpected)
ValidationError: data/hfopenllm_v2/prithivMLmods/Tadpole-Opus-14B-Exp/0faf87d0-2b35-4256-acd9-4fe57f574d06.json#L0
ValidationError: Additional properties are not allowed ('evaluation_source' was unexpected)
ValidationError: data/hfopenllm_v2/BlackBeenie/Llama-3.1-8B-OpenO1-SFT-v0.1/b298e0fc-f4fb-4464-beb8-45f8b5f35653.json#L0
ValidationError: Additional properties are not allowed ('evaluation_source' was unexpected)
ValidationError: data/helm_classic/TNLG-v2-(530B)/6f4f4316-6b6b-4f89-8d06-8014cb99fcc1.json#L0
ValidationError: Additional properties are not allowed ('evaluation_source' was unexpected)
ValidationError: data/hfopenllm_v2/meta/grimjim/DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B/f7439085-a0c9-4d5b-bd4f-bf1841d5ce02.json#L0
ValidationError: Additional properties are not allowed ('evaluation_source' was unexpected)