Hi,
you should not parent different network views together, instead one should follow it on late update, or something along that thinking.
when you do this, you should have a different set of network objects, one for the lobby, and one for playing, and they should only communicate via either player properties or room properties. think of them as belonging to do different context, they should not interact with one another directly.
Bye,
Jean