A blessed scroll of teleportation will allow you to follow monsters that recently teleported away, whether that is a levelport or a normal horizontal teleport.