Control Cortisol by Chilling Out and Lose Fat Stress works against you in many ways. It can be a huge barrier to losing weight, and can even be a factor in weight gain.