doctor explains that all the trial researcher will do to work out where you sit is ask you a number of questions about yourself, such as whether you are sleeping well, whether you have an appetite, whether you are suffering from negative thoughts, and so on. Youâll then be given points for each of the answers you give. For example, if you answer that you are sleeping well, youâll be given one point, whereas if you say you are hardly sleeping at all, youâll be given four points. The more points you accumulate, the higher you are rated on the scale, and the higher you are rated on the scale, the more likely you are to be classed as depressed. Thatâs how the Hamilton Scale works: If youâre rated at 26, youâre thought to be more depressed than if rated at 19. Youâve got the idea.
After this initial assessment, the trial researcher will then place you in one of two groups of patients and prescribe a course of pills. But thereâs a catch. Youâll be told that only one group of patients will be prescribed the real antidepressant, while the other group will be given a âplacebo pillââa pill that is made of sugar and which therefore contains no active chemical properties. No one will be told which group they are in, nor will anyone know what pill they are taking until their treatment has ended some three months later and their levels of depression have once again been measured on the Hamilton Scale. Your first rating (pre-treatment) and second rating (post-treatment) will then be compared.
Now, if your rating has gone down after treatment, it means you have improved (and thus the pill has worked). But if it has increased, it means you have worsened (and thus the pill hasnât worked). Once the researchers gather the ratings for all patients in the trial, they can then compare the two groups to assess how superior the antidepressant is to the sugar pill in alleviating depression.
Now imagine that the clinical trial you have just participated in contained about five hundred other patients, all going through the same process as you. This of course is a significant amount, but itâs still only one trial. What Kirsch did, youâll remember, is pool the results of all the trials he surveyedâboth published and unpublished. So in effect Kirschâs second meta-analysis collated the results of many thousands of patients, all of whom had been studied in trials like the one I have just described. And it was on the basis of this second analysis, as I mentioned a moment ago, that Kirsch reached the alarming conclusion that antidepressants work hardly better than placebos. Here is what his results looked like.
As in his first meta-analysis, which only looked at the published trials, Kirschâs second meta-analysis, which assessed both published and unpublished trials, revealed that both placebo and antidepressant groups got better. But his second meta-analysis also revealed that the difference in rates of improvement between the antidepressant group and the placebo group was insignificant.
And thatâs the important bit. âAfter surveying all the trials, we discovered that the antidepressant group only improved by 1.8 points on the Hamilton Scale over the placebo group,â stated Kirsch. âNow, this may not mean much to you. But what if I were to tell you that your score can be reduced by a full 6.0 points if you are merely sleeping better? Well, youâd rightly conclude that 1.8 is a tiny difference. And thatâs precisely why the NICE [National Institute for Clinical Excellence] has said there must be a difference of at least 3.0 points for the difference to be deemed clinically significant. Yet the difference we found was only 1.8 pointsâtotally clinically insignificant.â
Indeed, a 1.8 difference on the Hamilton Scale is barely noticeable in terms of a personâs actual experience. But what was also interesting for Kirsch was that
Dean Wesley Smith, Kristine Kathryn Rusch
Martin A. Lee, Bruce Shlain