Now, does tensor_parallel no longer support the huggingface trainer?

I'm trying to use the huggingface trainer after using tensor_parallel with the Llama2 7b model, by calling 
```python
model = tp.tensor_parallel(model)
```
but I'm getting the following error.
```
ValueError: Model parameters were moved to incorrect devices, did call on model.cuda() or model.to(device)? If so, please avoid doing that
```