Yes, after all other servers need this information in order to prevent double voting, you can’t just have servers sending each other information “somebody upvoted this” and also tell when servers are allowing users to vote more than once.

So upvotes and downvotes aren’t actually private, never have been, some servers may display them publicly even if most don’t.