Answer
The flight controller may combine several sensors for height estimation, and the importance of each source changes with mode, altitude, and environment. A degraded barometer can affect height hold or the consistency of automated altitude behavior.
Explanation
Sensor fusion does not make every sensor optional. It combines imperfect sources, and the loss of one can reduce the quality of the estimate.