@orchestra-research/quantizing-models-bitsandbytes
Quantizes LLMs to 8-bit or 4-bit for 50-75% memory reduction with minimal accuracy loss. Use when GPU memory is limited, need to fit larger models, or want faster inference. Supports INT8, NF4, FP4 formats, QLoRA training, and 8-bit optimizers. Works with HuggingFace Transformers.
No skills found in this collection.
SKILL.md
Loading...
Select a file to preview
Analyzing security...
Checking scan reports and verification data.
Bill of Materials
Everything this skill can do — files, network, commands, and more.
No demos yet. To add one, ask your AI agent: "Submit a demo for @orchestra-research/quantizing-models-bitsandbytes" — or upload via the API.
To add a demo, ask your AI agent: "Submit a demo for @orchestra-research/quantizing-models-bitsandbytes"
No eval data yet. Eval results are published via the SkillSafe API.