I think the inverse of `circshift(_, shifts)` is `circshift(_, map(-, shifts))`. Would that fit here?