About VRAM consumption

[Dongzt]

For the FLUX model, will scaled_dot_product_attention increase the video memory usage compared to F.scaled_dot_product_attention? How much video memory is needed to run it?

[Dongzt]

And can I visualize the attention map of non-10241024 size images (such as 8801184)? thank you for your reply