A blessed scroll of teleportation should allow you to follow monsters that recently teleported away, whether that is a levelport or a normal horizontal teleport.