You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I would like to ask a question, why with the possible support of such a large number of platforms, not to add a complex image in which both vLLM and TensorRT llm will be immediately located. As I think it would be super cool and would greatly simplify the work with this framework. To name it somehow by analogy with the already existing images according to the information from here https://catalog.ngc.nvidia.com/orgs/nvidia/containers/tritonserver . For example xx.yy-trtllm-vllm-python-py3 or xx.yy-complex-python-py3