Because currently, it seems like the only thing it’s recording are downvotes. Meanwhile upvotes are completely ignored, leading to pretty much every profile I see having a negative reputation.
Also, I have a very fragile ego and my -6 reputation hurts a bit.
From what I understand, currently it works like this: boost = +1, downvote = -1, and upvotes do not feed into reputation.