evalaudit
Statistical validity checks for human-graded AI evaluations
What XERJ indexed
Selected work
“Pin the two-sample bootstrap and document its skewed-data undercoverage”. 6 files, 269 lines in tests, evalaudit.
Licence
The repository
Checked by a person at the pinned commit.
The XERJ corpus
The author agreed by email on 2026-10-22. Same terms as the repository. Answers name the repo, the commit and the file:line.
in licence reviewnot in the hub yetsuggested use: adapt with attribution
annotation-qualitybradley-terryinter-rater-reliabilitykrippendorff-alphallm-as-judgellm-evaluationpythonstatistics
Example questions
- How does evalaudit implement annotation-quality?
- What does evalaudit do in evalaudit?
- What changed in evalaudit for “Pin the two-sample bootstrap and document its skewed-data”?
The prompt
Paste it into your AI agent. It clones mokayahezron/evalaudit at the pinned commit and indexes it on your machine.
Search the GitHub repository mokayahezron/evalaudit with XERJ (https://hub.xerj.org/corpus/mokayahezron--evalaudit). Run these in a shell, in order, and check each result before the next: 1. xerj --help (success: it prints usage). If xerj is missing: curl -fsSL https://xerj.org/get | sh 2. git clone https://github.com/mokayahezron/evalaudit evalaudit && git -C evalaudit checkout b8fd719bc05a67c82fef13c04d21f7f86dc8d8f1 3. Start a local node and leave it running: xerj --insecure --data-dir ./xerj-data 4. xerj autoindex ./evalaudit --url http://127.0.0.1:9200 --prefix evalaudit --progress plain 5. xerj autoindex map --url http://127.0.0.1:9200 Then answer my question from the indexed files and cite the ax_path of every hit. Query syntax: https://xerj.org/llms.txt Licence: MIT. Keep the copyright notice and credit the authors.
Related
mokayahezronAI, prompts and agents corporadeepevalfastmcpcognitatarunagarwal1981/wobblyemalvarol/mocacoNixtla/statsforecast
Selected work and consent: the XERJ registry.