Revamp the Oracle: move it lower in the dungeon, add level variants that make it look like a real temple instead of a small room inside a big room, and make the Oracle act as a real priestess, providing consultations along with regular priest services.

The Oracle centaur statues may contain sizeable piles of ranged ammunition, particularly arrows and crossbow bolts.

The Oracle should stand on a neutral altar, but killing her to access the altar should set your luck to -10. Not specified what should happen if you teleport her off the altar to access it.