[ci] xfail more incorrect transformer imports.#12455

sayakpaul merged 7 commits intomainhuggingface/diffusers:mainfrom

fix-more-transformer-importshuggingface/diffusers:fix-more-transformer-importsCopy head branch name to clipboard