Yeah, I just checked this and it seems like the delete key gets used by the Inspector first when it's on the left. The context menu Delete still works though.
The Inspector positioning is a little experimental so thanks for reporting this! I'll try to fix this in the next patch.