One simple way is to parent all the created clones to a parent object, then delete the parent object to delete all the clones. You can then make a new parent object so you can repeat this over and over...
You can often use the scene hierarchy to make group operations much easier. E.g.,
you could extend this idea to organize different "buckets" of objects under different parents.