How do fat people lose their fat reserves?

So I heard that when you don't eat, your body goes into starvation mode and it starts eating the muscle mass instead of the stored fat in your body. But if your fat, won't it just use your stored fat in your body instead of using muscle mass? I don't get it.