Hi,
yes, you are likely not computing the direction vector properly.
The mouse position is expressed in screen coordinates, not in 3d coordinates.
So, for this, I would use the following scene as a starting point. It's a small sample showing how to have an object looking at the mouse, use this as your way to get the real direction in world of the mouse direction compared to another 3d object.
bye,
Jean