1. To say that "act A is not objectively evil" is not equivalent to saying that "act A is good." An act can fail to be objectively evil and still be evil.
It's not objectively evil to go have a few beers with your buddies after work. That doesn't mean that there is no moral difference between going home to eat dinner with your family and going out for said beers. It is illegitimate to say that one of those choices cannot be said to be a morally bad, i.e. evil, choice.
2. The main question when reasoning about the morality of an action is not, "how will the affect the world?" Rather, it is, "how will this affect my soul and character?" How an act will affect the world is not unimportant, but it is secondary.