wobbly
Metamorphic testing for AI outputs: find wrong LLM answers without an answer key
What XERJ indexed
Selected work
“length_bias() + length_invariant(): verbosity-bias che…”. 5 files, 251 lines in wobbly, tests, scripts.
Licence
The repository
Checked by a person at the pinned commit.
The XERJ corpus
The author agreed by email on 2026-10-20. Same terms as the repository. Answers name the repo, the commit and the file:line.
in licence reviewnot in the hub yetsuggested use: adapt with attribution
aievaluationllmllm-evaluationmachine-learningmetamorphic-testingnlppython
Example questions
- How does wobbly implement ai?
- What does wobbly do in wobbly?
- Show the evaluation code in wobbly.
The prompt
Paste it into your AI agent. It clones tarunagarwal1981/wobbly at the pinned commit and indexes it on your machine.
Search the GitHub repository tarunagarwal1981/wobbly with XERJ (https://hub.xerj.org/corpus/tarunagarwal1981--wobbly). Run these in a shell, in order, and check each result before the next: 1. xerj --help (success: it prints usage). If xerj is missing: curl -fsSL https://xerj.org/get | sh 2. git clone https://github.com/tarunagarwal1981/wobbly wobbly && git -C wobbly checkout da5edf67a21a1620f6d90197fe94cb5af0d81a5d 3. Start a local node and leave it running: xerj --insecure --data-dir ./xerj-data 4. xerj autoindex ./wobbly --url http://127.0.0.1:9200 --prefix wobbly --progress plain 5. xerj autoindex map --url http://127.0.0.1:9200 Then answer my question from the indexed files and cite the ax_path of every hit. Query syntax: https://xerj.org/llms.txt Licence: MIT. Keep the copyright notice and credit the authors.
Related
Tarun AgarwalAI, prompts and agents corporaadalflowhaystackopennyai-legal-nlpTrustifAI/typed_evalsmcp-gtw/demo-gameEltarras/thunc
Selected work and consent: the XERJ registry.