...don't dump them in a nearby river. Or lake. Colorado is having to consider completely draining one lake as the only way to get rid of invasive goldfish. It's not cruel to the fish - just the native species they tend to outcompete.
(Basically? Don't ever release any pet into the wild. Either they won't survive, which is cruel to the animal, or they will with sometimes devastating results).