Support llama-3.1 models

[xell]

Nvidia now offers llama-3.1 models for example https://build.nvidia.com/meta/llama-3_1-405b-instruct in the same api system. Is it possible to support them? Thanks.

[lakshaybhushan]

Hey @xell, I've tried integrating them, but right now they're just not working