I find it interesting that some people are okay with feeling guilty and they are not concerned with the damage it create for themselves. There is a gain to everything we choose to do, even when we chose to keep guilt. Its like is it way to keep ourselves in check and to motivate ourselves; a way to self punish to "pay the price". But do we really need to ? I don't think so.
Guy Finley, the author of "The Secret of Letting Go" discusses this in his book. here is an article he has written on it. http://www.guyfinley.org/free-content/writings/special-lessons/2659 Love yourself enough to let go of guilt!