vLLM Connector
v1.2.0
Where the Plugin Lives — Cloudsmith
The wheels are published to the same Cloudsmith repository as the rest of Inferra (lightbits/lightbits-inferra, python format). You authenticate to Cloudsmith exactly as in the Deployment and Usage Guide: token as the username plus your $CLOUDSMITH_TOKEN as the password.
Property | Value |
|---|---|
Repository |
|
Format |
|
Username |
|
Password | your |
Packages |
|
How the wheels reach the pod
The wheels are installed into the vLLM pod at startup — the container's launch shim pip-installs them. You can instead bake the wheels, and the connector config, into a custom vLLM image.
Both patterns are valid; which one you use is your choice. See Get the Wheels into the Pod.
Last updated on
Was this page helpful?