Hm… what if downvoting was weighted only 1/10th as much as upvoting? So a few downvotes here and there from people doing it wrong wouldn’t amount to anything in others’ view, but if a post is heavily downvoted due to being in the wrong community or low effort, that’s visible?
It’s called fine-tuning, and if everyone gave up that easily, many domains would suffer, like medicine, architecture, manufacturing design etc. Don’t be afraid of something simply because the ideal fix is more complicated than 2+2.