The Oracle offers a service in which she reallocates some skills of your choice, costing some amount of money. Perhaps she can only skill you up to skill levels you formerly had before forgetting them, or else she can only make you forget skills (but you get to choose which unlike with amnesia).