@orchestra-research/peft-fine-tuning

Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need to train <1% of parameters with minimal accuracy loss, or for multi-adapter serving. HuggingFace's official library integrated with transformers ecosystem.

View in AI SkillSafe app
Scanned · no findings
0 downloads
0 stars
0 demos
SKILL.md

Embed badges

Add these to your README to show the skill's verification status.

SkillSafe verified badge
Verified badge
[![SkillSafe verified badge](https://api.skillsafe.ai/v1/badge/@orchestra-research/peft-fine-tuning/verified)](https://skillsafe.ai/skill/@orchestra-research/peft-fine-tuning/)
Installs badge
Installs badge
[![Installs badge](https://api.skillsafe.ai/v1/badge/@orchestra-research/peft-fine-tuning/installs)](https://skillsafe.ai/skill/@orchestra-research/peft-fine-tuning/)
Scan badge
Scan badge
[![Scan badge](https://api.skillsafe.ai/v1/badge/@orchestra-research/peft-fine-tuning/scan)](https://skillsafe.ai/skill/@orchestra-research/peft-fine-tuning/)
Eval pass rate badge
Eval pass rate
[![Eval pass rate badge](https://api.skillsafe.ai/v1/badge/@orchestra-research/peft-fine-tuning/eval)](https://skillsafe.ai/skill/@orchestra-research/peft-fine-tuning/)