Dry vs. moist

As long as the inner layers are dry, heat won't be transported away and the temperature will stay high (top). But as soon as water starts condensing on the inside, the insulation starts leading heat away from your body and you start freezing (bottom).