SkillEvaluator

Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset…

A new way for AI to search for data

View on GitHub

983GitHub stars

Python

What XERJ indexed

Snapshot

Whole repository

The whole repository at commit 2cc71b6551 (2026-09-29).

Selected work

Saibernard
@Saibernard

“compare only matching metric sets”. 6 files, 302 lines in tests, src/skillevaluator.

Also selected on this repository: @YMuskrat (64aac04ddf49).

Licence

The repository

Apache-2.0

LICENSE file checked at the pinned commit; the author agreed to inclusion.

The XERJ corpus

Apache-2.0, with credit

The author agreed by email on 2026-11-01. Same terms as the repository. Answers name the repo, the commit and the file:line.

selected for the XERJ Corpus Hublicence clearedsuggested use: adapt with attribution

agentic-aievaluationagent-evaluationagent-securityskillsagent-skillsbenchmarkclaude-code

Example questions

How does SkillEvaluator implement agentic-ai?
Where does SkillEvaluator handle “compare only matching metric sets”?
What does src/skillevaluator do in SkillEvaluator?

The prompt

Paste it into your AI agent. It clones NVIDIA/SkillEvaluator at the pinned commit and indexes it on your machine.

Search the GitHub repository NVIDIA/SkillEvaluator with XERJ (https://hub.xerj.org/corpus/nvidia--skillevaluator).
Run these in a shell, in order, and check each result before the next:
1. xerj --help  (success: it prints usage). If xerj is missing: curl -fsSL https://xerj.org/get | sh
2. git clone https://github.com/NVIDIA/SkillEvaluator SkillEvaluator && git -C SkillEvaluator checkout 2cc71b655111ef23687e0838a2dd520483814f2a
3. Start a local node and leave it running: xerj --insecure --data-dir ./xerj-data
4. xerj autoindex ./SkillEvaluator --url http://127.0.0.1:9200 --prefix skillevaluator --progress plain
5. xerj autoindex map --url http://127.0.0.1:9200
Then answer my question from the indexed files and cite the ax_path of every hit. Query syntax: https://xerj.org/llms.txt
Licence: Apache-2.0. Keep the copyright notice and credit the authors.

Saibernard AI, prompts and agents corpora agentbench inspect-ai admission-compare larchanka/skills Zizwar/memoryz andeeplus/aplus

Selected work and consent: the XERJ registry.