several things might be causing this
1 there might be other actions you're using that may be affecting this e.g smooth look at direction
2 the position of your environment relative to the object you're moving
3 self space or world space
i can't really tell until i see your fsms, but these could be the possible causes