What's better forgiving but not forgeting or not forgiving at all?

I choose to forgive the person so that I can also move on. But forgiveness is different from trust so I am also cautious.