@huggingface/huggingface-local-models

Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.

View in AI SkillSafe app
Scanned · no findings
0 downloads
0 stars
0 demos
SKILL.md

Embed badges

Add these to your README to show the skill's verification status.

SkillSafe verified badge
Verified badge
[![SkillSafe verified badge](https://api.skillsafe.ai/v1/badge/@huggingface/huggingface-local-models/verified)](https://skillsafe.ai/skill/@huggingface/huggingface-local-models/)
Installs badge
Installs badge
[![Installs badge](https://api.skillsafe.ai/v1/badge/@huggingface/huggingface-local-models/installs)](https://skillsafe.ai/skill/@huggingface/huggingface-local-models/)
Scan badge
Scan badge
[![Scan badge](https://api.skillsafe.ai/v1/badge/@huggingface/huggingface-local-models/scan)](https://skillsafe.ai/skill/@huggingface/huggingface-local-models/)
Eval pass rate badge
Eval pass rate
[![Eval pass rate badge](https://api.skillsafe.ai/v1/badge/@huggingface/huggingface-local-models/eval)](https://skillsafe.ai/skill/@huggingface/huggingface-local-models/)