Restore ability sources (including unicorn horns) only restore stat points up to their starting values, not to the highest values reached. Alternatively, restore up to the average of the starting and maximum value, rounded down.