How Do You Know If a Treatment Is Actually Working?
By Dr. Chris Cormier, DC — EBOO Prime How do you know if a treatment is working? We sell one, so you can take this article two ways — and I would rather you took it the second. Anybody spending money on their health deserves a way of telling whether it is doing anything — including when the treatment in question is ours. What follows is the method we would want a member of our own family to use, applied to us as readily as to anybody else. Why knowing whether a treatment is working is harder than it sounds Three things make it genuinely difficult to tell whether a treatment is working, and none of them involve anybody being dishonest. 1. You start treatments when you feel worst This is the big one, and it has a name: regression to the mean. Most symptoms fluctuate. You do not book an appointment on an average week — you book it during a bad one, usually at or near the peak. From a peak, the most likely direction is down, with or without treatment. So almost any intervention started at your worst moment will appear to work. Some researchers think this accounts for more apparent improvement than the placebo effect does. 2. Conditions improve on their own A great many things that bring people to any practitioner are self-limiting. They come and go. As one review of this problem puts it, a condition that naturally waxes and wanes gives both patient and practitioner repeated opportunities to credit a treatment that did nothing. 3. Expectation produces real effects Placebo effects are not imaginary and they are not a failure of character. Context, expectation and the experience of being cared for produce measurable changes in how people feel and function. Which is fine — feeling better is the point. You just want to know which thing you are paying for, because one of them is considerably cheaper to obtain elsewhere. None of this is a reason to be cynical about treatment. It is a reason to measure properly, which almost nobody does. How to tell whether a treatment is working, in six steps Step 1: Decide what you are measuring before you start This is the step that does almost all the work, and skipping it is why most people never really know. Chosen afterwards, the measure will always be whatever happens to have improved — not through dishonesty, but because memory reorganises itself around the outcome. Write it down before session one. On paper, dated. Step 2: Pick something countable “Feeling better” cannot be assessed. These can: One or two of these. Not twelve — tracking everything becomes its own burden and tells you less, not more. Step 3: Get a baseline first Two weeks of measurement before you start anything. This is the step people hate, and it is the one that makes the rest meaningful — without it you are comparing against memory, and memory is the least reliable instrument you own. A baseline also shows you your own range. Most people are surprised by how much they fluctuate anyway. Step 4: Set a review date and a decision rule Before you begin, write two things: when you will review, and what result would make you continue. By 15 March I will have had six sessions. If I am not sleeping through at least two more nights a week than my baseline, I stop and reconsider. That sentence is worth more than any amount of intuition, because you write it while you are still capable of being objective — before you have invested money, time and hope. Step 5: Change one thing at a time The usual pattern is to start a treatment, three supplements, a new sleep routine and a diet change in the same fortnight. If things improve, you have learned nothing about any of them — and you will probably keep paying for all five. One change, long enough to read, then the next. Step 6: Review honestly, including the option to stop Go back to the paper. Compare like with like. Be specifically suspicious of the thought “it must be working somehow” — that is usually the sound of money already spent looking for a justification. What makes a good measure That last point is the one worth keeping. The strongest evidence that something is working is usually something you have started doing again — the walk you stopped taking, the stairs you used to avoid, the evening you no longer write off. Dr. Cormier has written about the limits of measurement in the machine I keep wishing for. Questions worth asking any practitioner, including us Ask these before you start. The answers tell you a great deal, and so does the manner in which they are given. The third one is the most revealing question you can ask anybody in this industry. A practitioner with a clear answer has thought about where their work ends. A practitioner who cannot imagine circumstances in which you should stop is telling you something important, however warmly they say it. We would answer all five, and our page on questions to ask before a procedure sets out more. Dr. Cormier has written candidly about the professional temptation on the other side of that conversation in the most flattering thing a patient can say. One important exception None of this applies to medication prescribed by your doctor. Many prescribed treatments work without producing any sensation at all — blood pressure medication, statins and thyroid treatment usually feel like nothing. “I do not feel different” is not evidence that they are not working. Never start, stop or change a prescribed treatment based on a self-assessment. Speak to your prescriber. This matters enough to repeat in plain terms. The method on this page is for elective treatments you are choosing and paying for — therapies, supplements, programmes, devices, and services like ours. It is not a tool for auditing your prescriptions.