@orchestra-research/long-context
Extend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques. Use when processing long documents (32k-128k+ tokens), extending pre-trained models beyond original context limits, or implementing efficient positional encodings. Covers rotary embeddings, attention biases, interpolation methods, and extrapolation strategies for LLMs.
No skills found in this collection.
SKILL.md
Loading...
Select a file to preview
Analyzing security...
Checking scan reports and verification data.
Bill of Materials
Everything this skill can do — files, network, commands, and more.
No demos yet. To add one, ask your AI agent: "Submit a demo for @orchestra-research/long-context" — or upload via the API.
To add a demo, ask your AI agent: "Submit a demo for @orchestra-research/long-context"
No eval data yet. Eval results are published via the SkillSafe API.