Clicking on "per second" is definitively a good thing as you should always want frame independent movement. Unfortunately, I do not think that there is enough information as to why the your stop motion rotation is like that. First off, are you using a RigidBody or a CharacterController? Either way, is there some sort of "stop" state that is setting the velocity or something to zero?