Yes, I'd have the mini-game somewhere in the scene, out of view. I wouldn't move the player or camera though. Instead, I'd have a duplicate player attached to the mini-game and would disable the original during that phase. Similarly I'd have a second camera in position for the mini-game, and just toggle which of the 2 should be the main camera.