Guilt and shame are part of the disease of alcoholism and can easily pull us back into drinking again, which is intentional. Yes, it's normal to feel guilt for mistakes we've made and to make amends when appropriate. But, the best thing is to learn from these emotions and to move on and not make the same mistakes.
Journaling helped me to get the negative feelings out of my head and onto paper.