You can only use cursed potions of gain level once or twice while carrying the Amulet. After a few uses, the Amulet will start to pull you back down as you rise up, wasting the potion.