Hi.
Maybe have a empty object as parent to the camera (so you can adjust the camera position.
the empty object should follow the exact position of the player.
Then also use the rotation of the player and you can get/set the rotation from player on the camera parent.
when switching player, get rotation of target player and tween to that rotation to make it smooth