I think I’ve settled on the latter. Disagreement is maybe best communicated by the absence of an upvote? And downvotes work best when they signal something that is just off base, and while not reportable, is not appreciated at a broad cultural level.
I feel like this is a good approach. Honestly an invisible voting system might be better cause how many up or down votes something has prevents others from fully forming their own opinion.