Elementals on their respective home Planes life-save and teleport away from you when you kill them. (Or, alternatively, another one just spawns somewhere on the edge of the map not near you.)