Skip to content

Use the upstream inference gateway helm charts #312

@ahg-g

Description

@ahg-g

Component

Helm Chart

Desired use case or feature

Currently we couple the deployment of vllm and inference gateway into one helm chart, we should split them into two charts so that we can reuse the upstream helm charts (which provide support for various providers already): https://github.com/kubernetes-sigs/gateway-api-inference-extension/tree/main/config/charts/inferencepool

Proposed solution

Use the inference gateway upstream helm charts: https://github.com/kubernetes-sigs/gateway-api-inference-extension/tree/main/config/charts/inferencepool

Alternatives

No response

Additional context or screenshots

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    chartRelated to the Helm Chart

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions