Introducing Evaluation Cards: A Live Interpretive Layer for Understanding the AI Evaluations Ecosystem
• 1
AI & ML interests
We’re building a research coalition on evaluating evaluations (EvalEval)! Hosted by Hugging Face, University of Edinburgh, and EleutherAI.
Recent Activity
View all activity
Papers
Every Eval Ever: A Unifying Schema and Community Repository for AI Evaluation Results
Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting
Articles
evijit
updated a
bucket about 3 hours ago
j-chim
updated a
dataset about 8 hours ago
evijit
updated a
dataset about 12 hours ago
j-chim
updated a
bucket about 14 hours ago
EvalEvalBot
updated a
dataset about 16 hours ago
[Submission] swiss-ai/Apertus 1.5 Evaluation Card Follow-Up Results (checked)
4
#222 opened 3 days ago
by 
ymetz
[Submission] swiss-ai/Apertus 1.5 Evaluation Card Follow-Up Results (checked)
4
#222 opened 3 days ago
by ymetz
[Submission] swiss-ai/Apertus 1.5 Evaluation Card Follow-Up Results
4
#221 opened 3 days ago
by ymetz
[Submission] swiss-ai/Apertus 1.5 Evaluation Card Follow-Up Results
4
#221 opened 3 days ago
by ymetz
EvalEvalBot
updated a
Space 6 days ago
Carry the frozen hfopenllm_v2 archive to schema 0.3.0
1
#214 opened 16 days ago
by 
EvalEvalBot
j-chim
updated a
Space 6 days ago
[Submission] AISI cyber: align opus-4.5 model id and progress metric id
3
#220 opened 6 days ago
by evijit
[Submission] AISI cyber: align opus-4.5 model id and progress metric id
3
#220 opened 6 days ago
by evijit
[Docs] Restore the dataset card body and metadata lost to the config generator
#219 opened 6 days ago
by evijit
[Submission] AISI inference-scaling cyber aggregates (Cyber CTFs, The Last Ones)
3
#218 opened 6 days ago
by evijit
[Submission] AISI inference-scaling cyber aggregates (Cyber CTFs, The Last Ones)
3
#218 opened 6 days ago
by evijit
Aurelien-Morgan
posted an update 21 days ago
Post
2431
@retrain-pipelines execution engine is in perpetual evolution, with the aim to establish itself as SOTA, and for the long run.
However, we neglect no aspect of ML-Eng centricity.
If notebooks is where you like to do dev most,
we support you there 100% too.
Build crazy combos of inline tasks, deep parallel sub-DAG branches, nested asynchronous groups...
... the DAG renderer is undergoing an incremental upgrade
until the next one.
* starring toy tasks here. No ML has been hurt in this video 🙂
However, we neglect no aspect of ML-Eng centricity.
If notebooks is where you like to do dev most,
we support you there 100% too.
Build crazy combos of inline tasks, deep parallel sub-DAG branches, nested asynchronous groups...
... the DAG renderer is undergoing an incremental upgrade
until the next one.
* starring toy tasks here. No ML has been hurt in this video 🙂
Cerru02
authored a
paper 23 days ago
Cerru02
authored a
paper 24 days ago