Skip to content

Actions: huggingface/lighteval

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
2,500+ workflow runs
2,500+ workflow runs

Filter by Workflow

⌥ + click/return to exclude

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
Fix KeyError: 'default' for bigbench tasks with nonexistent split .github/workflows/pr_style_bot.yaml #269: Issue comment #1262 (comment) by nuthalapativarun
Failure
Failure
Document unconditioned_query requirement for PMI normalization .github/workflows/pr_style_bot.yaml #268: Issue comment #1261 (comment) by nuthalapativarun
Failure
Failure
Fix non-deterministic cache hash for MetricGrouping tasks .github/workflows/pr_style_bot.yaml #267: Issue comment #1260 (comment) by nuthalapativarun
Failure
Failure
Sync LightevalTaskConfig docstring with current fields .github/workflows/pr_style_bot.yaml #266: Issue comment #1259 (comment) by nuthalapativarun
Failure
Failure
Fix broken default_tasks.py link in quicktour docs .github/workflows/pr_style_bot.yaml #265: Issue comment #1258 (comment) by nuthalapativarun
Failure
Failure
add missing docstrings to three public functions in utils/imports.py Build PR Documentation #2034: Pull request #1282 opened by RavSinghChandan
Action required RavSinghChandan:docs/add-missing-docstrings-imports
RavSinghChandan:docs/add-missing-docstrings-imports
Action required
add missing docstrings to three public functions in utils/imports.py Slow end to end tests #1531: Pull request #1282 opened by RavSinghChandan
Action required RavSinghChandan:docs/add-missing-docstrings-imports
RavSinghChandan:docs/add-missing-docstrings-imports
Action required
add missing docstrings to three public functions in utils/imports.py Tests #3931: Pull request #1282 opened by RavSinghChandan
Action required RavSinghChandan:docs/add-missing-docstrings-imports
RavSinghChandan:docs/add-missing-docstrings-imports
Action required
add missing docstrings to three public functions in utils/imports.py Quality #3932: Pull request #1282 opened by RavSinghChandan
Action required RavSinghChandan:docs/add-missing-docstrings-imports
RavSinghChandan:docs/add-missing-docstrings-imports
Action required
Dataset idea: Helium benchmarks .github/workflows/pr_style_bot.yaml #264: Issue comment #1281 (comment) by connerlambden
Failure
Failure
Dataset idea: Helium benchmarks .github/workflows/pr_style_bot.yaml #263: Issue comment #1281 (comment) by connerlambden
Failure
Failure
feat: add sample count column to results table Slow end to end tests #1530: Pull request #1280 opened by SnehaDeshmukh28
Action required SnehaDeshmukh28:feat/show-sample-count-in-results-table
SnehaDeshmukh28:feat/show-sample-count-in-results-table
Action required
feat: add sample count column to results table Build PR Documentation #2033: Pull request #1280 opened by SnehaDeshmukh28
Action required SnehaDeshmukh28:feat/show-sample-count-in-results-table
SnehaDeshmukh28:feat/show-sample-count-in-results-table
Action required
feat: add sample count column to results table Tests #3930: Pull request #1280 opened by SnehaDeshmukh28
Action required SnehaDeshmukh28:feat/show-sample-count-in-results-table
SnehaDeshmukh28:feat/show-sample-count-in-results-table
Action required
feat: add sample count column to results table Quality #3931: Pull request #1280 opened by SnehaDeshmukh28
Action required SnehaDeshmukh28:feat/show-sample-count-in-results-table
SnehaDeshmukh28:feat/show-sample-count-in-results-table
Action required
Honor the model's generation_config.eos_token_id in the transformers backend Build PR Documentation #2032: Pull request #1279 opened by waqaskhan137
Action required waqaskhan137:fix-eos-token-id-chat-models
waqaskhan137:fix-eos-token-id-chat-models
Action required
Honor the model's generation_config.eos_token_id in the transformers backend Tests #3929: Pull request #1279 opened by waqaskhan137
Action required waqaskhan137:fix-eos-token-id-chat-models
waqaskhan137:fix-eos-token-id-chat-models
Action required
Honor the model's generation_config.eos_token_id in the transformers backend Slow end to end tests #1529: Pull request #1279 opened by waqaskhan137
Action required waqaskhan137:fix-eos-token-id-chat-models
waqaskhan137:fix-eos-token-id-chat-models
Action required
Honor the model's generation_config.eos_token_id in the transformers backend Quality #3930: Pull request #1279 opened by waqaskhan137
Action required waqaskhan137:fix-eos-token-id-chat-models
waqaskhan137:fix-eos-token-id-chat-models
Action required
[BUG] [eval] --max-samples 10 and then without, you get the cached data from the previous run. .github/workflows/pr_style_bot.yaml #262: Issue comment #1040 (comment) by NathanHB
Failure
Failure
Fix reversed gold index in boolq:contrastset prompt Build PR Documentation #2031: Pull request #1277 opened by vineethsaivs
Action required vineethsaivs:fix/boolq-contrastset-gold-index
vineethsaivs:fix/boolq-contrastset-gold-index
Action required
Fix reversed gold index in boolq:contrastset prompt Tests #3928: Pull request #1277 opened by vineethsaivs
Action required vineethsaivs:fix/boolq-contrastset-gold-index
vineethsaivs:fix/boolq-contrastset-gold-index
Action required
Fix reversed gold index in boolq:contrastset prompt Quality #3929: Pull request #1277 opened by vineethsaivs
Action required vineethsaivs:fix/boolq-contrastset-gold-index
vineethsaivs:fix/boolq-contrastset-gold-index
Action required
Fix reversed gold index in boolq:contrastset prompt Slow end to end tests #1528: Pull request #1277 opened by vineethsaivs
Action required vineethsaivs:fix/boolq-contrastset-gold-index
vineethsaivs:fix/boolq-contrastset-gold-index
Action required
feat: add static linter command for custom tasks Build PR Documentation #2030: Pull request #1268 synchronize by Kesav2k04
Action required Kesav2k04:feature/task-integrity-linter
Kesav2k04:feature/task-integrity-linter
Action required