How Your Influence Betrays You