Also there is much scaremongering about an EMP disabling all electronics in the US throwing us back into some sort of Revolution-like state. It would cause extensive damage but maximum electric field amplitude (in kV/m) would be only over a relatively small area with amplitude dropping off.
Also consider what a pulse is. A very short, intense pulse is a very broadband signal in the frequency domain. So passing through things like buildings, metal car bodies etc. is going to attenuate it, especially the high frequency components. Even heavy cloud cover and rain can attenuate high frequency signals several orders of magnitude.
So yes, there would be widespread damage, but maximum damage would occur over a relatively small area and whoever attacks us should chose a nice day with as little cloud cover as possible.

Also, a HEMP will not bring us back to horse and buggy technology, sorry ...