Any performance impact should be negligible... Inactive actions are still loaded which takes some time, but they are not run. If you wanted to squeeze every last drop of performance out of your game you could delete inactive actions before publishing, but it's probably not worth it.