Should I let these fish go, or keep them?

Let them go! You kidnapped them and they are starting to die so let them back where you got them, they will be healthy and happier if you do.