Seriously, that philosophy is very badly at odds with morality as it is practiced by most humans.
Humans are emotional, and they are a social species. Any philosophy that denies or ignores these facts as part of their set of axioms is doomed; At best such a philosophy will be widely derided. At worst, it will be implemented as part of public policy. The results of the latter are invariably ugly.
If my neighbor is hungry and comes to me for something to eat, I will not let him go away hungry. No way in holy hell would I do that. The
issue is whether
not helping equates to
hurting, and I think the answer hinges on an
underlying issue, namely whether I have an obligation to help when asked--not whether I help if asked.
If I am a caregiver to my neighbor and fail to provide care, then I'm not living up to my responsibility and can rightly be said to be hurting someone by my failure to help when asked.
Now, if I have no duty to help, and if I don't help, I ought not be regarded as one that is hurting my neighbor. It sounds to me that if you want to argue that I am hurting my neighbor, you need to argue that I do in fact have a responsibility, duty, or obligation despite not being a caregiver.
I don't mind being called irresponsible when I'm in fact irresponsible. For example, if I sign up for a credit card and make all my payments on time for twenty years except for one payment ten years ago being a single day late, then yes, call me an irresponsible little shit for not always paying as agreed. I can handle that, for either I did or did not always and without fail live up to my responsibility to pay it on time.
But, don't say I've hurt you by not helping you unless you can show I most certainly had an obligation to do so. If I have an obligation to help every Tom, Dick, and Harry that crosses my path, that's one thing, but it's going to take a hell of a lot more that an espoused view that I have an obligation. In fact, I'm quite unreasonable to even argumentation, so if you come at me merely armed with an argument, expect not to get through to me, as I don't take accusations of having an obligation to do as others claim too easily.