openevals

Readymade evaluators for your LLM apps

A new way for AI to search for data

View on GitHub

1,231GitHub stars

TypeScript, Python

What XERJ indexed

Snapshot

Whole repository

The whole repository at commit 9292ad6e9e (2026-10-21).

Selected work

spark
@spark-328

“preserve reordered records in same_elements JSON matching…”. 4 files, 287 lines in js, python.

Licence

The repository

MIT

Checked by a person at the pinned commit.

The XERJ corpus

MIT, with credit

The author agreed by email on 2026-10-24. Same terms as the repository. Answers name the repo, the commit and the file:line.

in licence reviewnot in the hub yetsuggested use: adapt with attribution

Example questions

What does js do in openevals?

The prompt

Paste it into your AI agent. It clones langchain-ai/openevals at the pinned commit and indexes it on your machine.

Search the GitHub repository langchain-ai/openevals with XERJ (https://hub.xerj.org/corpus/langchain-ai--openevals).
Run these in a shell, in order, and check each result before the next:
1. xerj --help  (success: it prints usage). If xerj is missing: curl -fsSL https://xerj.org/get | sh
2. git clone https://github.com/langchain-ai/openevals openevals && git -C openevals checkout 9292ad6e9e523e14af32fcccf7f1fe22ccdad33e
3. Start a local node and leave it running: xerj --insecure --data-dir ./xerj-data
4. xerj autoindex ./openevals --url http://127.0.0.1:9200 --prefix openevals --progress plain
5. xerj autoindex map --url http://127.0.0.1:9200
Then answer my question from the indexed files and cite the ax_path of every hit. Query syntax: https://xerj.org/llms.txt
Licence: MIT. Keep the copyright notice and credit the authors.

spark AI, prompts and agents corpora

Selected work and consent: the XERJ registry.