Your side keeps looking at it as normal priced items vs expensive items.
In practice it's usually expensive items vs no items.
Whoever already had a stock in the disaster area benefits but the people also benefit in that more gets shipped in when that normally wouldn't happen. If you have to ship goods into the disaster area but can only sell them for normal price you're not going to bother.
- - - Updated - - -
If you think price gouging is just fine, you're implying that it's the person's fault that they can't afford food during a natural disaster, where they lost everything.
Most of us are not saying it's fine. Rather, we are questioning which is the lesser evil.