How can you get mad at the way someone does something in private?

It's their doing.  Why does it have to affect your stance?  What's the deal here???