I don't think you're wrong; to my knowledge none of his adversaries had a thick dislike of Hitchens. Despite the nature of his far-less-than-subtle retorts in debate, I've always perceived some respect between him and whomever his opposition was, which I think was what made Buckley stand out in respect to Vidal. I don't think Hitchens wanted to compromise his message by resorting to ad hominems, and was acutely aware when he treaded in that direction.

“Edward genially enough did not disagree with what I said, but he didn't seem to admit my point, either. I wanted to press him harder so I veered close enough to the ad hominem to point out that his life—the life of the mind, the life of the book collector and music lover and indeed of the gallery-goer, appreciator of the feminine and occasional boulevardier—would become simply unlivable and unthinkable in an Islamic republic. Again, he could accede politely to my point but carry on somehow as if nothing had been conceded. I came slowly to realize that with Edward, too, I was keeping two sets of books. We agreed on things like the first Palestinian intifadah, another event that took the Western press completely off guard, and we collaborated on a book of essays that asserted and defended Palestinian rights. This was in the now hard-to-remember time when all official recognition was withheld from the PLO. Together we debated Professor Bernard Lewis and Leon Wieseltier at a once-celebrated conference of the Middle East Studies Association in Cambridge in 1986, tossing and goring them somewhat in a duel over academic 'objectivity' in the wider discipline. But even then I was indistinctly aware that Edward didn't feel himself quite at liberty to say certain things, while at the same time feeling rather too much obliged to say certain other things. A low point was an almost uncritical profile of Yasser Arafat that he contributed to Interview magazine in the late 1980s.”

This is 100% google sourced though; I'm not very well acquainted with Hitchens aside from reading a few of his books and watching a few of his debates years ago (aka I don't know what I'm talking about). Hopefully someone more knowledgable can correct or confirm.