The part of the argument that irritates me is the fall back to religion rather than law. You are welcome to believe whatever religion you would like in this country. That said, your religion is yours, not mine, and I should not be held to its tennets.
Nor should people be treated as less of a person because of who they love or the color of their skin. The anger over this ruling that I've seen in the media has mostly been one centering on religion and less about whether the law was somehow unjust. Looking at many of remarks from presidential candidates, you see God or Christian rights being brought up again and again (except for Trump, who took a shot at Bush instead. Because Trump.)
If, as Dr. Carson remarked that "marriage is a religious service not a government form", then the government needs to separate all the legal and tax related perks from it. Because this isn't just about having a ceremony and flowers and a cake, but about all the other things that make up a marriage.