Ant Group and the vLLM community have open-sourced Humming, a quantized inference kernel library.
Ant Group and the vLLM community have open-sourced Humming, a general-purpose high-performance quantized inference kernel library. The repository is located at github.com/vllm-project/humming.
Return to original text
A short introduction is retained here; the full text from the source website is not reposted. For specific wording and subsequent updates, please refer to the original article.
Open AIHOT original