Stairs should show any annotation of the level they lead to. Probably not by default, instead when using the nearlook and/or farlook command.

E.g. “There is a staircase down to level 2 (MUMAK BY THE STAIRS!!) here.”