ruby-skill-bench

Evaluation engine that measures the ROI of context for AI agent skills. Ruby · blind LLM judge

A new way for AI to search for data
View on GitHub
0GitHub stars
192commits on main
0forks
v2.0.0latest release, 2026-09-24

Ruby 99.9%, Dockerfile 0.1% · created 2026-05-05 · last push 2026-09-24

What XERJ indexed

Snapshot

Whole repository

The whole repository at commit ca98a50e1f. It is the newest commit on main.

Selected work

Licence

The repository

MIT

LICENSE file checked at the pinned commit; the author agreed to inclusion.

The XERJ corpus

MIT, with credit

The owner added it on hub.xerj.org after signing in with GitHub, on 2026-10-28. Same terms as the repository. Answers name the repo, the commit and the file:line.

selected for the XERJ Corpus Hublicence clearedsuggested use: adapt with attribution

ruby-llmruby-evalsruby-llm-eval

Example questions

Inside the indexed corpus

Licence on GitHub and in the corpus

GitHub reported MIT for igmarin/ruby-skill-bench on 2026-10-29, and the LICENSE file at commit ca98a50e1f was reviewed as MIT. They match, so answers from this corpus carry the same terms as the live repository.

Contributors

Ismael Marín (@igmarin) has 9 selected repositories on the hub.

Their other repository pages: igmarin/rails-agent-skills, igmarin/rails-ai-bridge, igmarin/elixir-phoenix-skills, igmarin/ruby-core-skills, igmarin/pi-vida, igmarin/agnostic-planning-skills.

Using XERJ with ruby-skill-bench

The prompt

Paste it into your AI agent. It clones igmarin/ruby-skill-bench at the pinned commit and indexes it on your machine.

Search the GitHub repository igmarin/ruby-skill-bench with XERJ (https://hub.xerj.org/corpus/igmarin--ruby-skill-bench).
Run these in a shell, in order, and check each result before the next:
1. xerj --help  (success: it prints usage). If xerj is missing: curl -fsSL https://xerj.org/get | sh
2. git clone https://github.com/igmarin/ruby-skill-bench ruby-skill-bench && git -C ruby-skill-bench checkout ca98a50e1f3ac9407c5dc834b16a975d971a5e28
3. Start a local node and leave it running: xerj --insecure --data-dir ./xerj-data
4. xerj autoindex ./ruby-skill-bench --url http://127.0.0.1:9200 --prefix ruby-skill-bench --progress plain
5. xerj autoindex map --url http://127.0.0.1:9200
Then answer my question from the indexed files and cite the ax_path of every hit. Query syntax: https://xerj.org/llms.txt
Licence: MIT. Keep the copyright notice and credit the authors.

Related

Stats: GitHub API, fetched 2026-10-29. Selected work and consent: the XERJ registry.