llm-compressor

State-of-the-art LLM compression, built for production inference with vLLM

A new way for AI to search for data
View on GitHub
3,910GitHub stars

Python

What XERJ indexed

Snapshot

Whole repository

The whole repository at commit 269a451824 (2026-10-23).

Selected work

“Refactor basic calibration to use the sequential pipeline”. 4 files, 263 lines in tests, src/llmcompressor.

Licence

The repository

Apache-2.0

Checked by a person at the pinned commit.

The XERJ corpus

Apache-2.0, with credit

The author agreed by email on 2026-10-23. Same terms as the repository. Answers name the repo, the commit and the file:line.

in licence reviewnot in the hub yetsuggested use: adapt with attribution

compressionquantization

Example questions

The prompt

Paste it into your AI agent. It clones vllm-project/llm-compressor at the pinned commit and indexes it on your machine.

Search the GitHub repository vllm-project/llm-compressor with XERJ (https://hub.xerj.org/corpus/vllm-project--llm-compressor).
Run these in a shell, in order, and check each result before the next:
1. xerj --help  (success: it prints usage). If xerj is missing: curl -fsSL https://xerj.org/get | sh
2. git clone https://github.com/vllm-project/llm-compressor llm-compressor && git -C llm-compressor checkout 269a4518241db8af3fd4e19c717abf713a176a72
3. Start a local node and leave it running: xerj --insecure --data-dir ./xerj-data
4. xerj autoindex ./llm-compressor --url http://127.0.0.1:9200 --prefix llm-compressor --progress plain
5. xerj autoindex map --url http://127.0.0.1:9200
Then answer my question from the indexed files and cite the ax_path of every hit. Query syntax: https://xerj.org/llms.txt
Licence: Apache-2.0. Keep the copyright notice and credit the authors.

Related

Selected work and consent: the XERJ registry.