Hi,
If you are using prefabs, indeed you can break connections even without leaving the scene, for example if you click Apply on a prefab instance.
But it seems that you are loosing connection while playing or debugging, which is indeed not something that should happen, unless the gameobject you are referencing is getting deleted and recreated or something along these lines.
Bye,
Jean