Proxmox openid authentication failure; rhost=::ffff:192.168.XX.6 msg=Failed to contact token endpoint: Request failed

[dragonnn]

Hi!
I am trying to setup authentik with Proxmox PVE but I am getting this in logs when trying to log in with it:

openid authentication failure; rhost=::ffff:192.168.XX.6 msg=Failed to contact token endpoint: Request failed

That sounds to me like some kind of network issue with is pretty strange, I will explain my setup.
192.168.XX.XX network is an internal bridge between lxc on that node.

authentik is running in lxc in docker on that proxmox node and is exposed to public via Ngnix Proxy Manager that is running in another lxc in docker on that node, it has attached a valid https certificate and domain.
proxmox dashboard is also exposed via the same Ngnix Proxy Manager and has a valid certificate
So let say we have as a sample on that proxy:
pve.xxx.yy -> https://192.168.XX.254:8006
authentik.xxx.yy -> http://192.168.XX.22:9000
pbs.xxx.yy -> https://192.168.89.201:8007
komodo.xxx.yy -> http://192.168.89.14:9120

Ngnix Proxy Manager itself is exposed via 192.168.XX.6 internal to lxc and external via 192.168.YY.120
My xxx.yyy domian is pointing on a global dns to 192.168.YY.120
What is funny is that I got both pbs and komodo running just fine with authentik
The PVE node can access 192.168.89.6 from it self just fine, 192.168.YY.120 too. What could I be missing in this setup?
I am really confused that is going on, from authentik logs it kind looks fine.