@kostja94/robots-txt

When the user wants to configure, audit, or optimize robots.txt. Also use when the user mentions "robots.txt," "crawler rules," "block crawlers," "AI crawlers," "GPTBot," "allow/disallow," "disallow path," "crawl directives," "user-agent," "block Googlebot," "fix robots.txt," "robots.txt blocking," or "search engine crawling." For indexing, use indexing.

View in AI SkillSafe app
Scanned · no findings
0 downloads
0 stars
0 demos
SKILL.md

Embed badges

Add these to your README to show the skill's verification status.

SkillSafe verified badge
Verified badge
[![SkillSafe verified badge](https://api.skillsafe.ai/v1/badge/@kostja94/robots-txt/verified)](https://skillsafe.ai/skill/@kostja94/robots-txt/)
Installs badge
Installs badge
[![Installs badge](https://api.skillsafe.ai/v1/badge/@kostja94/robots-txt/installs)](https://skillsafe.ai/skill/@kostja94/robots-txt/)
Scan badge
Scan badge
[![Scan badge](https://api.skillsafe.ai/v1/badge/@kostja94/robots-txt/scan)](https://skillsafe.ai/skill/@kostja94/robots-txt/)
Eval pass rate badge
Eval pass rate
[![Eval pass rate badge](https://api.skillsafe.ai/v1/badge/@kostja94/robots-txt/eval)](https://skillsafe.ai/skill/@kostja94/robots-txt/)