Think in terms of heat conduction, radiation and convection currents. In this case the air in the jacket is relatively still so the concept of conduction should apply.

When keeping things warm, heat should be kept in (hard for heat to get away), while for cooling things, heat must be removed (easy for heat to get away).

Hope this explaination helps :)