Buoyant opens Kinference: An inference control plane for Kubernetes and vLLM
The company behind Linkerd, Buoyant, has released the open-source project Kinference, an inference control plane designed for Kubernetes and vLLM. The current version is v0.1.0-alpha.7, written in Rust under the Apache 2.0 license.
Return to original text
A short introduction is retained here; the full text from the source website is not reposted. For specific wording and subsequent updates, please refer to the original article.
Open AIHOT original