It's probably an issue that almost everybody who uses matplotlib would have encountered. If you generate a figure - which often contains axis labels and legends - and save it with default settings, ...
When adding multiple colorbars with plt.colorbar to different subplots and then removing them again, the removal affects the width of the other subplot. This bug occurs with matplotlib>=3.4.0, ...