All-time in Super Rugby the Waratahs are about the 4th best team, for the period to 2010 at any rate.
The data was looked at in 2010 to see if there was a "Kaplan Effect" on Watatahs games over full span of the competition 96-09. i.e. Tests for statistical significance on Waratahs games with and without Kaplan were done for:
(i) average points For - Against; and
(ii) Matches Won (%).
1. On analysis of the raw data for all Waratah games (see Fig.1, N = 168 games to 2010) there was:
(i) A nett points degradation of about 17 points on average with Kaplan compared to without, and
(ii) A win percentage at 6.3% with Kaplan compared to 57.9% without.
And respective Proportion test and T-test with alpha= 0.01 supports with 1% probability of error (actually much less than 1% error) the hypothesis of a relationship between Kaplan refereeing and the Waratahs losing.
But to control for strength of schedule, an analysis limited only to matches between comparable teams can be done.
2. On analysis of comparable opposition, i.e. only matches where the Waratahs and their opposition finished the season within 1 win on the ladder (see Fig.2, N = 69 games to 2010) there was still:
(i) A nett points degradation of about 9 points on average with Kaplan compared to without, and
(ii) A win percentage at 9.1% with Kaplan compared to 51.7% without.
And respective Proportion test and T-test with alpha= 0.01 still supports with less than 1% probability of error the hypothesis of a relationship between Kaplan refereeing and the Waratahs losing.