Turns out I was seriously overcomplicating things.
There was no need to store anything in a vector whatsoever.
For anyone who ever has this issue:
1) If your bullets spawn on an object that has rotation, they will rotate to the correct direction when spawned. You then just have to apply force to the bullet in the x direction.
2) If your bullets spawn on an empty object just infront of your object with rotation, you'll forever wallow in despair, and you'll want to kill yourself.
Just make your bullet spawn on the enemy, and adjust the collision you're using so that the collision mesh doesn't spawn directly ontop of the enemy's collision mesh.