Remove the ability of speed potions to always, reliably confer the speed intrinsic. Instead, you need to already have a lot (at least 100 turns) of temporary very fast speed before drinking a potion of speed will give you the intrinsic.