Skip to main content

Evals

Evaluates AI agent workflows using objective metrics and grading methods to ensure quality and performance.

Install this skill

or
81/100

Security score

The Evals skill was audited on May 24, 2026 and we found 11 security issues across 3 threat categories. Review the findings below before installing.

Categories Tested

Security Issues

medium line 20

Curl to non-GitHub URL

SourceSKILL.md
20curl -s -X POST http://localhost:8888/notify \
medium line 9

Access to hidden dotfiles in home directory

SourceSKILL.md
9`~/.pai/PAI/USER/SKILLCUSTOMIZATIONS/Evals/`
low line 105

Access to hidden dotfiles in home directory

SourceSKILL.md
105bun run ~/.pai/skills/Utilities/Evals/Tools/AlgorithmBridge.ts -s <suite>
low line 108

Access to hidden dotfiles in home directory

SourceSKILL.md
108bun run ~/.pai/skills/Utilities/Evals/Tools/FailureToTask.ts log "description" -c category -s severity
low line 111

Access to hidden dotfiles in home directory

SourceSKILL.md
111bun run ~/.pai/skills/Utilities/Evals/Tools/FailureToTask.ts convert-all
low line 114

Access to hidden dotfiles in home directory

SourceSKILL.md
114bun run ~/.pai/skills/Utilities/Evals/Tools/SuiteManager.ts create <name> -t capability -d "description"
low line 115

Access to hidden dotfiles in home directory

SourceSKILL.md
115bun run ~/.pai/skills/Utilities/Evals/Tools/SuiteManager.ts list
low line 116

Access to hidden dotfiles in home directory

SourceSKILL.md
116bun run ~/.pai/skills/Utilities/Evals/Tools/SuiteManager.ts check-saturation <name>
low line 117

Access to hidden dotfiles in home directory

SourceSKILL.md
117bun run ~/.pai/skills/Utilities/Evals/Tools/SuiteManager.ts graduate <name>
low line 126

Access to hidden dotfiles in home directory

SourceSKILL.md
126bun run ~/.pai/skills/Utilities/Evals/Tools/AlgorithmBridge.ts -s regression-core -r 3 -u
low line 20

External URL reference

SourceSKILL.md
20curl -s -X POST http://localhost:8888/notify \
Scanned on May 24, 2026
View Security Dashboard
Installation guide →