@orchestra-research/gptq

Post-training 4-bit quantization for LLMs with minimal accuracy loss. Use for deploying large models (70B, 405B) on consumer GPUs, when you need 4× memory reduction with <2% perplexity degradation, or for faster inference (3-4× speedup) vs FP16. Integrates with transformers and PEFT for QLoRA fine-tuning.

View in AI SkillSafe app
Scanned · no findings
0 downloads
0 stars
0 demos
SKILL.md

Embed badges

Add these to your README to show the skill's verification status.

SkillSafe verified badge
Verified badge
[![SkillSafe verified badge](https://api.skillsafe.ai/v1/badge/@orchestra-research/gptq/verified)](https://skillsafe.ai/skill/@orchestra-research/gptq/)
Installs badge
Installs badge
[![Installs badge](https://api.skillsafe.ai/v1/badge/@orchestra-research/gptq/installs)](https://skillsafe.ai/skill/@orchestra-research/gptq/)
Scan badge
Scan badge
[![Scan badge](https://api.skillsafe.ai/v1/badge/@orchestra-research/gptq/scan)](https://skillsafe.ai/skill/@orchestra-research/gptq/)
Eval pass rate badge
Eval pass rate
[![Eval pass rate badge](https://api.skillsafe.ai/v1/badge/@orchestra-research/gptq/eval)](https://skillsafe.ai/skill/@orchestra-research/gptq/)