0.0.0+develop
Classes
| Class | Description |
|---|---|
flytekitplugins.inference.nim.serve.NIM |
|
flytekitplugins.inference.nim.serve.NIMSecrets |
. |
flytekitplugins.inference.ollama.serve.Model |
Represents the configuration for a model used in a Kubernetes pod template. |
flytekitplugins.inference.ollama.serve.Ollama |
|
flytekitplugins.inference.sidecar_template.ModelInferenceTemplate |
|
flytekitplugins.inference.vllm.serve.HFSecret |
. |
flytekitplugins.inference.vllm.serve.VLLM |