@huggingface/huggingface-community-evals

Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.

View in AI SkillSafe app
5 scan findings
0 downloads
0 stars
0 demos
SKILL.md

Embed badges

Add these to your README to show the skill's verification status.

SkillSafe verified badge
Verified badge
[![SkillSafe verified badge](https://api.skillsafe.ai/v1/badge/@huggingface/huggingface-community-evals/verified)](https://skillsafe.ai/skill/@huggingface/huggingface-community-evals/)
Installs badge
Installs badge
[![Installs badge](https://api.skillsafe.ai/v1/badge/@huggingface/huggingface-community-evals/installs)](https://skillsafe.ai/skill/@huggingface/huggingface-community-evals/)
Scan badge
Scan badge
[![Scan badge](https://api.skillsafe.ai/v1/badge/@huggingface/huggingface-community-evals/scan)](https://skillsafe.ai/skill/@huggingface/huggingface-community-evals/)
Eval pass rate badge
Eval pass rate
[![Eval pass rate badge](https://api.skillsafe.ai/v1/badge/@huggingface/huggingface-community-evals/eval)](https://skillsafe.ai/skill/@huggingface/huggingface-community-evals/)