A player fear system should track the sources of fear and slow down the timeout for the fear the closer you remain to them, particularly if you remain in line of sight; and/or accelerate the timeout so it goes away faster if you are far away and not in line of sight.