There should be a Dexterity saving throw against taking fall damage when you fall through a hole or trap door and land on a different floor.