1.
The Grand Finals for the Swinburne World Schools Debating Championship is held in the Swinburne Sarawak campus Lecture Hall, a beautiful, carpeted, multistage auditorium with plush green-and-white padding for walls and crystal acoustics (if you're interested, that is - like I was - in the tonal differences of each speaker's voice). The adjudicators sit in two rows of cushioned ecstacy, 2nd and 3rd from the front; flow sheets and paper on black plastic surfaces that swing out at an angle from the sides of the auditorium seats. In front of them is a scrum of photographers. Their faces are attached to the behinds of their mounted SLRs, which are in turn attached to silver aluminium frames and adjusted to handle the orange downlights of the hall. Everyone, from adjudicator to lensmen to the 100 odd students seated in all extremeties of the auditorium, is staring at two benches and a presentation platform; rising up over these is a projector screen, displaying the motion for the Grand Final; in the middle, dead centre in the front of the hall, is a single mounted mike. It is from this mike that the final speeches of the final debate of WSDC 2009 are delivered, and it is from this mike that the dreams of so many individuals of the past four days are awarded, or destroyed.
To understand the weight of the competition in that room, in what is but an intra-school debate competition, you would first have to understand the context of this final debate. The Swinburne World Schools Debating Championship is a yearly tournament held at high school level in the icy classrooms and the carpeted halls of the Swinburne Sarawak campus. Most of this competition happens in the aging G-block auditorium in the main Swinburne building, with its vomit-coloured carpeting and its 9-flights of stairs and its lack of reliable elevators; and also in two rooms with uncovered ceilings in the B-block. Each high school is allowed to enter up to four teams, divided by age category: two teams for the Seniors (Form 4 and above), and two teams for the Juniors (Form 3 and below). WSDC is four years old as of press time; it is organized by a team of highly-experienced Uni-level debators and administrators, it owes a huge amount of support to Swinburne's academic staff, and it owns a solid reputation for being the only debate competition worth joining in the whole of Kuching city.
This year, however, that reputation took a hit. The Grand Finals (THW respect the right of North Korea and Iran to develop its nuclear potential) between Gapor A and St Joseph A turned out to be one of the messiest debates in the entire competition. And that is strange, if you think about it, for two particular reasons. The first reason is that the scoring systems in debate tournaments are designed to promote the very best teams to the finals (as in every other competitive sport system, to be honest). Good teams don't normally cause messy debates - if they do, they know how to salvage them at the latter part of the round. In simple terms, an uncharacteristically messy debate in the finals would mean that the two teams in the finals aren't the best in the competition, but they got there anyway. Secondly, consider: it is within the organizers' best interests to have a lively, high quality debate at the tail end of the tournament, not only because the finals is the round that matters most, but also because they are the ones with the most people watching. The very fact that the GF was a lacklustre debate should raise a few red flags in anyone's head - and for good reason. Something went wrong in this year's WSDC. Something allowed two lacklustre teams access to the finals, and something allowed two uncharacteristically lousy debates to happen in front of a hundred-odd audience. The feedback I'd gotten from high school students, post-competition, have largely been negative, with one or two telling me that they're 'pissed off with Swinburne'. I do not believe that this is Swinburne's fault. I believe instead that a series of things came together in exactly the wrong way to cause a general skew in this year's competition results. This post attempts to explain how this happened.
2.
Swinburne WSDC as a debate tournament is organized in the generally accepted fashion of international debate competition. It's divided into two stages: the first, called the preliminaries, consist of a collection of rounds used to determine the 8 teams that would later advance into the second section. This second section are the elimination rounds, where losing means being kicked out of the competition. Swinburne's system is designed to keep the strongest teams in play, and they accomplish this via two particular ways. The preliminary matchups are done by power placement, a mathematical approach to pit teams of equal ability against each other. How exactly they calculate this and what algorithms they use I won't know, but let's say for the sake of argument that this system is perfect, and that it gives us at the end of the prelims an ideal list of teams arranged according to ability. The top 8 teams on that list for both categories is then taken out and moved into the elimination rounds. The second system that Swinburne uses is simple: in the elimination stage the strongest teams (that is, the teams that placed at the top of the break) are pitted against the weakest teams (the ones at the bottom). This means that the top team goes up against the 8th team, the 2nd against the 7th, and so on so forth. Hypothetically, at least, this system allows the good debators an easier run into the finals.
The second system that we need to talk about when we want to figure out what went wrong in WSDC is the way adjudication is carried out. Swinburne's system does not allow conferring of opinion between adjudicators while giving out scores. They assume that all adjudicators have experience in judging debate, and therefore each and every individual should make their own decisions according to that experience. Again, this system makes sense at an international level - in a competition where all adjudicators are above a certain threshold of experience, a prevention of opinion-sharing helps to stop overly-opinionated people from influencing the decisions of other adjudicators. A gag-order also provides a check and balance to the inherent subjectivity of the sport - sometimes (though this happens very rarely) debates are so close that the winning team becomes a matter of opinion, in which case a majority decision in an odd-numbered panel is the fairest way of deciding the winner.
The one last thing that we've got to make clear before we move on to what went wrong: adjudication in debate is a tricky thing. There are half a dozen different things an adjudicator needs to look out for - and the most important of these is the difference between a good debator and a good public speaker. There is a tendency for inexperienced adjudicators to award rounds based on the speaking ability of the speakers, ignoring in the process the importance of debate skills like strategy and flexibility and the ability to highlight relevant issues at the right time in the debate. I'd say that non-debators have a harder time knowing when a debator they're adjudicating is doing something smart vs when he's just spewing wonderful-sounding garbage. The earlier matches of WSDC saw teachers entering debate rooms as trainees, under experienced Swinburne debators. They had no say on who won or lost the round. Midway through the prelims, however, some teachers demanded that they be allowed to adjudicate in proper, at which point Dr Sooch agreed and placed them as panelists.
3.
So what happened this year? If we look at the the preliminary rounds we will find that certain teams had an easier time breaking into the elimination stage: St Mary A for instance, went up against 4 junior teams. On the flip side, we see junior teams like Green Road D competing against 4 senior teams in 4 out of their 5 prelim rounds. I'd like you to note that this happens even in top international competitions, especially when those competitions have teams that number in the hundreds. But in this case the random-luck effect was made more pronounced by the fact that the algorithm used in power matching failed to take into account the real ability of these teams - like whether or not these teams were junior or senior (which, I'd say, matters more at high school level than at University level, due to the large gap in maturity between the two categories). All the system takes note of is the number of wins vs the number of losses, and the teams who win go up against other teams who also win. In this system, it doesn't take a genius to figure out there would be scenarios in which junior teams who win against other junior teams suddenly find themselves up against a senior team that has also won in the last round (and that when they lose that round, they suddenly find themselves against another senior team ... but one that lost the last round). Because the algorithm does not discriminate between quality of wins, certain teams benefit, going up against multiple junior teams, while other teams lose out.
These imperfections in the preliminary matchups meant that the results in the elimination rounds were affected as well. Teams that shouldn't have met up in the Quarters and the Semis did, and having two high-quality teams go up against each other in earlier elimination rounds meant that there was less of a chance of the best teams ending up in the finals.
But there's more to it than that. Let's take a look at the two finalists of the Junior category - which by the way, between them performed a classic lousy debate in the Junior finals. Both these teams benefited from an added effect - one that came about through a flaw in the adjudication systems. The gag-order between adjudicators in debate rounds that made sense at international level worked against WSDC, simply because they were not designed to compensate for inexperienced adjudicators. St Teresa C won a prelim round even though they'd presented a hung-case because two high school teachers overrode the Chair.
[1] Lodge C, in turn, won an elimination round because two teachers overrode their Chair and awarded their team the debate, making their decision
solely on the performance of Lodge's 3rd speaker.
[2]
A few things happened as a direct result of such overrides. Firstly, two teams that otherwise would not have made it to the Junior finals did, and performed a below-average debate in full view of the 15 schools that were watching (108 or so students, plus teachers, plus photographers, plus VIPs). Secondly, because inexperienced adjudicators are more pursuaded by style over strategy and substance, the speaker rankings were skewed in favour of debators with better elocution. The top 3 speakers in the rankings, for instance, are the ones with impeccable delivery, while other debators displaying more valuable but less obvious debate skills like strategic savvy and the ability to construct a response-case on the fly were displaced, and placed lower down in the overall competition.
4.
An obvious question to ask now would be: who do you blame? And the answer to that isn't as clear-cut as you might suppose. Some high school debators got prissy with Swinburne in the aftermath of the competition, but now that we've taken a look at the systems and the flaws that lead to these results, I think that we can no longer say that Swinburne and Swinburne alone is at fault for these imperfections. A major problem with this competition was from adjudication, and the lack of experience amongst the adjudicators that took part in this year's tournament. But let's be honest: how many high school teachers out there have debated anyway? And how many adjudicators could Swinburne pull in to handle the huge number of teams that participated this year? You've to remember that all the universities in Kuching - even the Swinburne students themselves - were on study leave for their mid-term exams. Adjudicators that came from UNIMAS and UiTM last year could not make it this time around because they were caught up with their own exam schedules. And, most importantly, you cannot blame the organizers for the imperfections of a fair system, the same way you cannot hate the government for the occasional hiccup that happens in a democracy.
That isn't to say that I don't worry. I teach debate in St Thomas's and in St Mary's. I teach my speakers how to create cases, what good arguments are, and how to best deliver them. I worry whenever teams like St Teresa - who benefit from public speaking ability - win places in debate finals due to adjudicator inexperience. I wonder too if there is any way to circumvent this, considering that we're in East Malaysia, after all, and we have but a small pool of debators to source adjudicators from. For if undeserving teams win debate competitions, and undeserving speakers win speaker awards, then the connection between effort and reward will eventually and irrevocably be severed, and frayed, and torn asunder. And then it'll be harder to get kids to continuously improve, for why work hard when winning is but a lottery?
5.
The first speaker of the Grand Final is Rebekah Dawn Ba'o Ritchie. Her hair is orange in the glow of the auditorium's downlights, and her face pale against the black of the microphone. She is one of the better debators in this year's competition. I suppose it wouldn't be too far along to say that she is the reason Gapor A are here in the finals - I remember adjudicating her in Prelim 5 over a motion I had advised my debators never to touch, and by the end of her 1st Opp speech I realized that I was looking at a classic policy-response case - the kind that I myself would've done, had I been in her shoes.
Bekah walks to the front now, in white baju kurung, while Ashik introduces her as '... wants to be a bouncer in SoHo when she grows up' and the crowd cheers their approval. Dr Sooch is sitting directly in front of me and he's drawing lines on a sheet of paper with a black pen. I look down at my flow sheet, and up again, in time to see Bekah tapping at the mike ...
She looks up at us now, the hundred or so people in the hall, and begins. "Good morning I bid to the Floor ..."
And the debate has started proper, and I remember thinking to myself, praying, even, that it would be a clean, good one. But in the space of those few words the debate is still full of promise, because just sitting at the Finals, in an adjudicator's chair, you don't think of systems and flaws and problems, you think of ideas and arguments, and the verbal wordplay that will unfold before you. I bite my lip and begin writing furiously. The debate is on.
1. You can't blame them, really - not many high school debators know what a hung case is, what more to say their teachers? ↩2. This is known, in debate circles, as the Crescendo Effect. The Crescendo Effect states that speakers who speak later in a debate will have greater influence on the adjudicators, primarily because speeches you heard last are easier to remember. Good adjudicators usually compensate for this effect by keeping rigorous notes, and giving wins based on those. ↩