It is not the temperature fluctuations that cause the problems per se. It is the resulting rapid fluctuations in relative humidity as a result of the temp fluctuations that cause the problems.
So, still rapid temp changes can be a problem. The relative humidity is dependent upon temperature. Cool too rapidly ==> condensation. Heat too quickly ==> drying. These rapid changes then are what can cause the tobacco to swell/shrink and lead to damage of the wrappers.