Replace Charisma with a “morale” stat, which decreases when you die and get lifesaved, eat terrible food, and so on, and makes you lose the will to go on if it gets low enough. However, it would need some other effects to be fully fleshed out.