Actually, I think I agree with what you're saying. The "privilege" framework that has become so popular as to be inescapable these days really makes an error in framing things on individual terms. Culturally we've become focused on naming the privileges that individual people have, as if those individuals are not ruled by the very same oppressive systems that shunted them into those identity roles in the first place. Despite how uncomfortable it makes many progressives, it's not "men's rights activism" or apologism for abuse to say that actually, it does really suck to be a cis man. The average cis man has very limited social and economic power, and has been pushed all his life to embody a narrow set of masculine standards, and that makes his life really tough. And so when he gets told that his gendered prison is actually a source of personal "privilege," he gets pissed and feels attacked. As do white people when we hear we're privileged, etc.

What would have been a lot more productive was to focus on naming oppressive systems -- laws, policies, cultural norms, ways power gets structured -- and speak about those as the source of our collective suffering. Cis guys, too, suffer from cissexism. Just like everyone else, they were forced to be a particular gender by medical institutions and legal policies, and then culturally, they were forced to embody what society says a man is supposed to be. That cissexism hurts trans people in other ways, but the cis guys are hurt too. We screwed up royally as left-leaning people when we started making some of our potential allies into our enemy and attacked them rather than raising their class consciousness. I actually think that framing of "privilege" instead of collective "power" was an inside job -- wealthy liberal academics and political leaders had a vested interest in us not all taking the same side together against the existing regime.