Search results

[Enhancement] Improve judge prompt for edge cases

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#10 In BennettSchwartz/ERR-EVAL;

· BennettSchwartz opened on Dec 25, 2025

[Research] Propose new evaluation track (Track F)

datasetDataset improvementsDataset improvements

researchResearch or experimentResearch or experiment

Status: Open.

#9 In BennettSchwartz/ERR-EVAL;

· BennettSchwartz opened on Dec 25, 2025

[Research] Analyze correlation between ERR-EVAL and other benchmarks

help wantedExtra attention is neededExtra attention is needed

researchResearch or experimentResearch or experiment

Status: Open.

#8 In BennettSchwartz/ERR-EVAL;

· BennettSchwartz opened on Dec 25, 2025

[Dataset] Expand canonical dataset to 50+ items per track

datasetDataset improvementsDataset improvements

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#7 In BennettSchwartz/ERR-EVAL;

· BennettSchwartz opened on Dec 25, 2025

[Feature] Export results as CSV/JSON

enhancementNew feature or requestNew feature or request

frontendFrontend UI changesFrontend UI changes

Status: Open.

#5 In BennettSchwartz/ERR-EVAL;

· BennettSchwartz opened on Dec 25, 2025

[Feature] Add percentile rankings to leaderboard

enhancementNew feature or requestNew feature or request

frontendFrontend UI changesFrontend UI changes

Status: Open.

#4 In BennettSchwartz/ERR-EVAL;

· BennettSchwartz opened on Dec 25, 2025

[Docs] Add model-specific insights to README

documentationImprovements or additions to documentationImprovements or additions to documentation

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#3 In BennettSchwartz/ERR-EVAL;

· BennettSchwartz opened on Dec 25, 2025

[Good First Issue] Add more models to models.yaml

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#1 In BennettSchwartz/ERR-EVAL;

· BennettSchwartz opened on Dec 25, 2025