People are going to talk about you whether you're alive or dead, succeeding or failing, happy or sad and even if they're a family member or friend.
Talk is cheap; don't let talk bring your value down.