Skip to content

Update LLM Inference recipes to latest vLLM #93

@amgowda-oci

Description

@amgowda-oci

vLLM version being used here is 0.6.3 while today we are at 0.9.1. Can you please update the vllm version, so we get the latest and better performance. Better yet please migrate to vllm:latest upstream container.

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions