← all corpora

xerj-search

reference corpus · status live · domain DB (Databases and storage engines) · lane A · refresh pinned · tags GLOBAL · SEARCH-ENGINE · DATA-ENGINES

What an agent uses it for

an agent working on full-text search internals queries this for how lucene/tantivy/quickwit/meilisearch/sonic/elasticsearch do BM25, merge policy and the ES wire

Use it
curl -fsSLO https://raw.githubusercontent.com/xerj-org/xerj/corpus-hub/tools/xerj-code/hub/xerj-search.json
xerj corpus add --from ./xerj-search.json
xerj corpus index xerj-search then xerj code xerj-search "your question"

Needs the xerj CLI and a local node running; the copy prompt covers both, checks each step, and shows how to stop only the node you started. No shell: the MCP tool xerj_code_search with corpus: "xerj-search", once the corpus is indexed on the node.

Sources and pins

sourcepinlicencesizereview note
tantivy 3a55bc986d10MIT 34.8 MB / 527 files
quickwit fb99535bccc4Apache-2.0 30.4 MB / 1,555 files LICENSE is plain Apache-2.0; LICENSE-3rdparty.csv is a dependency inventory, not this project's licence.
meilisearch be181e115792MIT AND BUSL-1.1 51.5 MB / 1,734 files MIT core, but Enterprise Edition parts are BUSL-1.1 (LICENSE-EE). Check the file's header and path before copying anything.
sonic 484339e891a5MPL-2.0 1.6 MB / 244 files File-level copyleft. XERJ is Apache-2.0, so read the design and write your own code; do not lift MPL files in.
elasticsearch ac375eb50ac5AGPL-3.0-only OR SSPL-1.0 OR Elastic-2.0 559.5 MB / 46,387 files Triple-licensed; the detector reports only the first (most restrictive) match. Never copy ES code into XERJ: beyond the licence, XERJ's public position is that it shares no code and no architecture with Elasticsearch.
lucene 9cda46563a4bApache-2.0 188.6 MB / 7,557 files Plain Apache-2.0: the same licence as XERJ: so unlike elasticsearch in this corpus it is adapt-with-attribution, not approach-only. Lucene is the library elasticsearch is built on, so it is the primary source for postings, codecs, segment merge, BM25 scoring and HNSW; prefer it over the ES entry.

866.5 MB across 58,004 files. Added 2026-08-07.

People behind this corpus

Upstream authors (5)

Owners of the pinned repositories, credited under each repository's licence. They have not signed up here; their pages are attribution.

apache@apache · upstream
elastic@elastic · upstream
meilisearch@meilisearch · upstream
quickwit-oss@quickwit-oss · upstream
valeriansaliou@valeriansaliou · upstream

All contributors.

Rights

AGPL-3.0-only OR SSPL-1.0 OR Elastic-2.0 + Apache-2.0 + MIT + MIT AND BUSL-1.1 + MPL-2.0. Redistribution permitted with attribution per the licence review. The review block records a human opening each licence file at the pin. Detector output is a hint, never the verdict.

Retrieval spot-check (G7)

Not yet spot-checked. Queries are pre-registered in the registry before grading.

Agent score

From structured reviews that AI agents send after they use this corpus: through xerj hub pull, MCP queries, or the xerj_corpus_feedback tool. Each review rates usefulness 1–5, whether the answer was found, and freshness. This is not the human hub star count shown above. The two are never mixed.

Loading agent reviews…

Score = Bayesian mean of usefulness (prior 3.0 with weight 5), so a few reviews cannot swing it. One voice per installation per corpus per week; abnormal-volume reviewers are dropped. Coverage gaps appear only once 3 or more agents report the same one. How it works.

Traffic

Traffic stats load from /api/hub-traffic when this page runs JavaScript.

Views: visits to this page (search-engine crawlers excluded). Unique: distinct visitors per day, by a hash salted with the day, so the 14-day unique figure adds up daily uniques. Pulls: growth of the GitHub release download count of this corpus’s pack (xerj hub pull downloads from there; includes our own pack-verification downloads). Searches: hosted-hub queries for this corpus. Referring sites appear after 3 views. What is collected.

Agent usage

Usage stats load from /api/hub-usage when this page runs JavaScript.

Counted: requests agents send to the hosted hub API (hub.xerj.org/api/v1/code, /def) for this corpus. Queries on your own node (xerj code, xerj ask with a local pack, the MCP tools) never leave your machine and are not counted. Templates replace identifiers, versions, paths, numbers and quoted text with placeholders; one is shown only once it has been seen 3 times in 30 days, and any word asked fewer than 3 times shows as <term>. Raw queries are never published. What is collected.