Guilt is an emotion, and many believe that this emotion shows the existence of a conscience in a person. Sociopaths can hurt anyone and feel no guilt, but honest people who have wronged a person or harmed someone in some way will feel bad about it, and that is guilt. When you feel guilty then you want to make amends, and often a simple apology will do this perfectly because you acknowledge your actions and the hurt they caused.