One huge blocker to caring for the wellbeing of others is the all-to-common choice to reason as if one's own preference automatically renders others' preferences null and void.
For example:
"X wouldn't bother me so I don't understand why it should bother anyone?"
"Y works for me so it should work for everyone."
"Z is the phrase I have always used, and it will of course continue to work because it has worked great for me in the past."