I don't have Ted's experience, but I've refereed a few games around Subbies - lower grades in high divisions, primarily, so probably not quite the crowd at that time of day (or the beers!)
Two further questions I'm sure you've answered 100 times already... 1: do you find the sideline abuse is worth that physical and mental challenge?
Most of the time I don't even hear it - I'm focused on what is in front of me. When you're further than 10 metres from the sideline it's all just noise.
2: I've always wanted to know, do you find yourself sub-consciously wanting to reward the team that isn't chirping back at decisions? I guess the actual question is do you subscribe to 'keeping the ref on your side'?
Personally, no. At each contest I'm looking for particular behaviours or actions from players in terms of applying the Law. Given it is mostly 3rd Grade or lower, I make allowances for the fitness and skill that is in front of me - who am I to criticise on that front?
It isn't playing "evensies" as much as it is taking into account it is a game, it is serious during the match, but we all go to work Monday.
However, I have seen incidents where the ref has started to become more erratic as the game heats up. It is only natural as we're all human and meant to be doing this for fun. When tensions rise, particularly where there has been a bit of foul play, we all respond differently.
Additionally: nobody knows the mind of another.
Maybe that player had a shit week and is lashing out from frustration elsewhere in their lives.
Maybe the ref has had a shit week and isn't in the right headspace to put up with that kind of rubbish.