arete-evals
Public LLM evaluation suites and run records for repeatable, evidence-based comparison
What XERJ indexed
Snapshot
The whole repository at commit 20b287e2bc. It is the newest commit on main.
Selected work
Licence
The repository
LICENSE file checked at the pinned commit; the author agreed to inclusion.
The XERJ corpus
The owner added it on hub.xerj.org after signing in with GitHub, on 2026-10-29. Same terms as the repository. Answers name the repo, the commit and the file:line.
selected for the XERJ Corpus Hublicence clearedsuggested use: adapt with attribution
ai-safetybenchmarkingeval-harnessllm-evaluationmlops
Example questions
- How does arete-evals implement ai-safety?
- Show the benchmarking code in arete-evals.
Inside the indexed corpus
- 95 files, 451.1 KB in total, about 4.7 KB per file.
- On GitHub since 2026-05-22, last push 2026-10-28, 27 commits on main.
Licence on GitHub and in the corpus
GitHub reported MIT for AreteDriver/arete-evals on 2026-10-31, and the LICENSE file at commit 20b287e2bc was reviewed as MIT. They match, so answers from this corpus carry the same terms as the live repository.
Contributors
James C. Young (@AreteDriver) has 6 selected repositories on the hub.
Their other repository pages: AreteDriver/agent-lint, Arete-Consortium/animus, AreteDriver/mcp-manager, AreteDriver/ai-spend, AreteDriver/context-hygiene.
Using XERJ with arete-evals
- RAG without a vector database: one hybrid index The hub files it under AI, prompts and agents.
- Best grep alternative for AI coding agents (2026)
- Ask questions about a GitHub repo without cloning it
- Index a reference library for a coding agent
The prompt
Paste it into your AI agent. It clones AreteDriver/arete-evals at the pinned commit and indexes it on your machine.
Search the GitHub repository AreteDriver/arete-evals with XERJ (https://hub.xerj.org/corpus/aretedriver--arete-evals). Run these in a shell, in order, and check each result before the next: 1. xerj --help (success: it prints usage). If xerj is missing: curl -fsSL https://xerj.org/get | sh 2. git clone https://github.com/AreteDriver/arete-evals arete-evals && git -C arete-evals checkout 20b287e2bc206246b6519e3430db78d6b6e96551 3. Start a local node and leave it running: xerj --insecure --data-dir ./xerj-data 4. xerj autoindex ./arete-evals --url http://127.0.0.1:9200 --prefix arete-evals --progress plain 5. xerj autoindex map --url http://127.0.0.1:9200 Then answer my question from the indexed files and cite the ax_path of every hit. Query syntax: https://xerj.org/llms.txt Licence: MIT. Keep the copyright notice and credit the authors.
Related
James C. YoungAI, prompts and agents corporagiskardann-benchmarksdeepevalgetaskclaw/ambercriticaldata/benchmaxxingaawhan0/ModelDock
Stats: GitHub API, fetched 2026-10-31. Snapshot: the git tree at the pinned commit. Selected work and consent: the XERJ registry.