I assume that a lot of people who see psychologists deal with guilt. Much of the advice is to try to get rid of those guilt feelings. They often assume that the feeling itself is the problem. They figure if they can just get rid of that feeling the problem would be solved. They overlook the fact that people often experience genuine guilt for having wronged someone like a person or even God himself. The problem that is overlooked is that a precious relationship might have been broken. That feeling assures us that much of our guilt isn't just a feeling - it is a real awareness of harm done to someone and steps need to be steps taken beyond just dealing with the feeling for true healing to come about.
The good news is that God is willing and eager to forgive us, cleanse us of guilt, and restore joy to our life.
There is also guilt that is produced by our enemy Satan who is the great accuser. The bible deals with both issues.
O God, You know my foolishness; And my sins are not hidden from You. Psalms 69:5 (NKJV)
He has not dealt with us according to our sins, nor punished us according to our iniquities. For as the heavens are high above the earth, So great is His mercy toward those who fear Him; As far as the east is from the west, So far has He removed our transgressions from us. As a father pities his children, So the LORD pities those who fear Him. For He knows our frame; He remembers that we are dust. Psalms 103:10-14 (NKJV)
Let the wicked forsake his way, And the unrighteous man his thoughts; Let him return to the LORD, And He will have mercy on him; And to our God, For He will abundantly pardon. Isaiah 55:7 (NKJV)
For all have sinned and fall short of the glory of God, being justified freely by His grace through the redemption that is in Christ Jesus, Romans 3:23-24 (NKJV)
But if we walk in the light as He is in the light, we have fellowship with one another, and the blood of Jesus Christ His Son cleanses us from all sin. 1 John 1:7 (NKJV)
Then I heard a loud voice saying in heaven, "Now salvation, and strength, and the kingdom of our God, and the power of His Christ have come, for the accuser of our brethren, who accused them before our God day and night, has been cast down. Rev 12:10 (NKJV)