Different result in triton with vllm backend and vLLM server #8392
Description
I am running same model on triton with vLLM backend and vLLM server.
vLLM result:
triton vLLM backend result
Why both are different?
{{ message }}
I am running same model on triton with vLLM backend and vLLM server.
vLLM result:
triton vLLM backend result
Why both are different?