@davila7/long-context

Extend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques. Use when processing long documents (32k-128k+ tokens), extending pre-trained models beyo...

View in AI SkillSafe app
121725 downloads
0 stars
0 demos
SKILL.md

Embed badges

Add these to your README to show the skill's verification status.

SkillSafe verified badge
Verified badge
[![SkillSafe verified badge](https://api.skillsafe.ai/v1/badge/@davila7/long-context/verified)](https://skillsafe.ai/skill/@davila7/long-context/)
Installs badge
Installs badge
[![Installs badge](https://api.skillsafe.ai/v1/badge/@davila7/long-context/installs)](https://skillsafe.ai/skill/@davila7/long-context/)
Scan badge
Scan badge
[![Scan badge](https://api.skillsafe.ai/v1/badge/@davila7/long-context/scan)](https://skillsafe.ai/skill/@davila7/long-context/)
Eval pass rate badge
Eval pass rate
[![Eval pass rate badge](https://api.skillsafe.ai/v1/badge/@davila7/long-context/eval)](https://skillsafe.ai/skill/@davila7/long-context/)