Inferra vLLM Connector Guide
This guide is intended for operators who already have an Inferra LCF cluster running and want to attach the LCF KV-cache connector to a vLLM serving pod. It covers only how to install and wire the connector plugin into a vLLM engine.
Standing up the LCF cluster itself (LCFC/LCFT, lcf-api, node labeling, XFS mounts, Cloudsmith login) is not covered here — see the Deployment and Usage Guide, which documents the lcf-cli deploy and the direct-Helm deploy. This guide assumes that one has been followed and the cluster is healthy.
What is in this guide
Values to Substitute Before Running
Placeholder | Meaning |
|---|---|
| Connector / |
| The Kubernetes namespace the vLLM pod runs in (default |
| The name of your vLLM Deployment (for example |
| The connector's logical KV-cache scope label (the |
The connector/pylcf wheel version (x.y.z) tracks the LCF release version. The version in the current Deployment and Usage Guide is 1.2.0 (PEP 440: 1.2.0) — so unless Lightbits Support tells you otherwise, use x.y.z = 1.2.0.