What was the disruptive change in terms of positional embeddings?

It was a pain to install the requested version of transformers (well, actually its `tokenizers==0.7.0` dependency) on our cluster. So I am hoping to contribute a fix to make the library compatible with recent transformers versions. Can you give a bit more information about the issues you experienced and what the problem is?