I don't think belittling individuals because of where you believe they sit on the societal slippery slope is really a good look.
Nor do I believe that any sport has a monopoly on fans from certain demographics.
I agree with your first point. However, having played both codes, and watched both, I have to say that there are (or were) some pretty significant differences overall.
On the subect of referees, which is a particular point of difference. In rugby, referees have always been treated with respect.
In your code, referees are tolerated (at best) and are often treated very poorly.
Some other differences. To generalise, rugby is a game that tends to be played in the older, more established, universities and schools, including the academically selective schools. Many top rugby players over the years have attained tertiary education.
In loig, it is not unusual for kids to be signed up at the age of 14, at which point they lose any interest in their education (if they ever had any).
A lot of people still play rugby for fun as adults. How many people play loig for fun?
This does say something about the respective codes, whether you like it or not.