Hi,
You can only to destroy a network GameObject when you are the Owner. This means you need to check the "IsMine" and it has to be true, then you can delete this networked GameObject.
IF you created a scene GameObject ( not owned by any client), then you MUST be in the MasterClient to destroy it.
Bye,
Jean