Maybe you have noticed this.

Someone asks if you are doing Bloomsday. You answer that you are not. And the person to whom you are speaking leaps to the assumption that you actively dislike the annual event.

Since when does not participating imply hostility?