Fix a bug where intermediate phase outputs could get too low height.