There’s a version of this experiment you’ve probably already run without realizing it. You read a horoscope or pulled a transit report, something happened that matched, and you thought: this thing is actually working. That’s a hit. What you almost certainly didn’t do was write down the days when nothing matched, the predictions that evaporated without consequence, the warnings about difficult conversations that never came. Those are misses — and they’re the data point that actually matters.
The astrology hit rate question — not “does it feel accurate” but “what percentage of specific predictions materialize” — is the right question to ask if you want to know what’s actually happening when you use any oracular system. It’s also almost never asked, and almost never answered carefully. This article is about how to do it, what the research suggests you’ll find, and what to do with the result either way.
Why Tracking Hits and Misses Is Harder Than It Sounds
The instinct, when someone suggests tracking astrology predictions, is to think: I’ll just pay more attention. But paying more attention isn’t enough, for reasons that go deeper than motivation.
The core problem is what psychologists call asymmetric feedback. When a prediction hits — when something the horoscope described actually happens — you get immediate positive feedback: the recognition response, the pleasurable jolt of yes, exactly. This encodes the hit in memory. When a prediction misses, the feedback is the absence of an experience: nothing matches, you move on, nothing is encoded. By the end of a month of reading horoscopes, your memory of the system’s performance is built almost entirely from its hits, not from a representative sample of all its outputs.
This is why confirmation bias is so robust even in intelligent, reflective people. It’s not that they’re ignoring the misses. It’s that misses don’t generate the kind of signal that forces itself into memory. Without a deliberate record, they simply disappear.
A second problem is retroactive reinterpretation. The horoscope that said “expect turbulence in communication” gets remembered, after a difficult email exchange, as having predicted that specific event — even if the prediction was vague enough to fit almost any day. This isn’t dishonesty; it’s a well-documented feature of human memory, studied extensively since Frederic Bartlett’s work in the 1930s. Memory is reconstructive, not archival. We remember what happened through the lens of what we know happened next.
The third problem is base rate blindness. If Venus retrograde is associated with relationship difficulties, and you experience relationship difficulties during Venus retrograde, this feels like confirmation. But the relevant question is: how often do you experience relationship difficulties outside Venus retrograde? If the answer is “fairly often,” then the retrograde correlation tells you very little. Your brain doesn’t automatically make this comparison. You have to force it.
Solving all three problems requires the same thing: a written record made before you know the outcome.
What the Research Actually Shows
The most rigorous attempt to study astrological hit rates systematically was conducted not by a skeptic trying to debunk the practice but by a practitioner who wanted to know whether his work was actually helping people.
Geoffrey Dean, an Australian researcher and former astrology advocate, spent several decades accumulating and re-examining studies of astrological predictions. The results, compiled in a landmark 1992 paper co-authored with Ivan Kelly, were unambiguous: when specific, verifiable astrological predictions were checked against outcomes under controlled conditions, accuracy rates were indistinguishable from chance. This held across sun-sign predictions, more sophisticated natal chart interpretations, and claims about time-sensitive transits.
What made Dean’s work particularly striking was his account of the subjective experience from the inside. When he was practicing astrology and relying on his memory of outcomes, he felt he was producing accurate, insightful work. When he actually checked his predictions systematically, the picture looked completely different. The felt accuracy and the measured accuracy were describing different realities.
The most cited controlled study remains the Shawn Carlson double-blind experiment, published in Nature in 1985. Carlson asked professional astrologers — selected by and acceptable to the astrological community — to match natal charts to psychological profiles from the California Psychological Inventory. The astrologers performed at chance. Critically, they had predicted before the experiment that they would perform significantly better than chance, which itself illustrates the mechanism: high subjective confidence, average objective accuracy.
More recently, a 2006 study by David Voas, using UK birth registry data for over two million people, found no correlation between astrological sun signs and the personality traits associated with them. The sample size was large enough that even small effects would have been detectable.
None of this is to say that divination systems have no value, or that all divination claims are identical in their testability. It’s to say that the specific claim — that astrological predictions are accurate at a rate better than chance — has been tested in controlled conditions and has not held up. This is the honest summary of the evidence.
The Steelman: What These Studies Don’t Test
The studies above are worth taking seriously. They’re also worth understanding precisely, because they have genuine limitations that serious defenders of oracular practice can reasonably point to.
Vagueness is a feature, not only a bug. The Carlson experiment and similar studies test specific, verifiable predictions. But much of what practitioners find valuable about astrology isn’t prediction at all — it’s interpretation. The question “what does my chart say about my relationship to authority?” doesn’t generate a falsifiable prediction. It generates a frame for reflection. Studies designed to test predictive accuracy don’t say much about interpretive utility.
The systems being tested matter. Newspaper horoscopes and sun-sign astrology are the most studied and the least defensible. More complex systems — precise natal chart interpretation, BaZi’s calculation of decade-long luck pillars, Zi Wei Dou Shu’s specific claims about life periods — generate predictions that are harder to test but more specific when they do generate them. The evidence base for these systems is thinner partly because they haven’t been studied as rigorously, not necessarily because they perform identically to chance when studied carefully.
The mechanism question is separate from the utility question. Even if astrology doesn’t work as a predictive mechanism — even if the planets genuinely have no causal influence on human affairs — the practice might still be useful. A system that reliably prompts people to examine their relationships, their habits, or their assumptions has value independent of whether the underlying cosmology is accurate. This is a defensible position, and it’s distinct from the claim that astrological predictions are objectively accurate.
The honest synthesis: the predictive accuracy claim is weak and the evidence against it is substantial. The interpretive utility claim is more defensible but harder to test. Conflating the two — feeling that the interpretive resonance proves the predictive accuracy — is the cognitive move worth watching.
A Practical Method for Tracking Your Own Hit Rate
If you want to know what’s actually happening in your own practice, here’s the minimum viable tracking method. It takes about five minutes a day and produces meaningful data within a month.
Step one: Write the prediction before the period. Each morning, or at the start of a retrograde or transit period, write down in plain language what the system is specifically predicting. Not “turbulence” but “I am expecting a difficult conversation with someone close to me.” Not “financial opportunity” but “I am expecting an unexpected income source or a notable purchase decision.” The more specific the prediction, the more informative the hit or miss.
Step two: Set a resolution date. A daily horoscope resolves in 24 hours. A Mercury retrograde resolves over three weeks. Write the resolution date next to each prediction so you know when to evaluate.
Step three: Record outcomes without reinterpretation. On the resolution date, write down what actually happened and make a binary call: did this specific prediction materialize, yes or no? The temptation to reinterpret (“well, the difficult conversation didn’t happen but there was tension, so that counts”) is exactly the mechanism you’re trying to counteract. Hold the line.
Step four: Calculate the base rate. After 30 days, also note how many times the predicted event type occurred on days when it wasn’t predicted. How many difficult conversations happened without a specific prediction? How many financial surprises occurred in non-retrograde periods? This is the base rate comparison that your brain won’t make automatically.
Step five: Look at the ratio. Your hit rate is: predictions that materialized ÷ total predictions made. The base rate is: unpredicted events of the same type ÷ total non-prediction days. If the hit rate is substantially higher than the base rate, you have something worth examining more carefully. If they’re similar, that’s your answer.
Most people who do this rigorously find the ratios converge. Some find genuine surprises. Either outcome is more informative than continued reliance on memory.
What to Do With the Results
If your hit rate comes out near chance, there are three reasonable responses, and they’re not mutually exclusive.
The first is to shift your relationship to the practice from prediction to reflection. Stop using the system to anticipate what will happen and start using it to examine what is happening. This sidesteps the accuracy question entirely and captures the genuine utility the system may have as a framework for attention and self-examination. “Mercury retrograde asks me to revisit communication patterns” is a reflective orientation; “Mercury retrograde will cause a communication failure” is a prediction that can be falsified.
The second is to get more specific. If you’ve been tracking sun-sign horoscopes, try tracking a more precise system — a natal chart interpretation, a BaZi luck pillar analysis, a Nine Star Ki monthly overlay. The evidence against sun-sign astrology is strong; the evidence against more specific systems is thinner, in part because they’ve been tested less often. More specificity creates more genuine testability, which is actually a more honest way to engage.
The third is simply to accept the results and use the practice for what it demonstrably offers: a regular pause to examine your experience, a vocabulary for discussing psychological states, a cosmological frame that some people find genuinely orienting even without predictive validity. This is a more modest claim than most astrology marketing makes, but it’s defensible, and it’s honest.
If your hit rate comes out significantly above chance — if your specific, written-in-advance predictions materialize at a rate that seems too high to attribute to coincidence — then you have something genuinely interesting. The appropriate response is to tighten the methodology (were the predictions actually specific? was the evaluation genuinely binary?) and to replicate over a longer period before drawing conclusions. The goal isn’t to be a committed skeptic; it’s to know what you actually know.
How The Whisper Thinks About This
The Whisper is built on the premise that divination systems — including astrology, BaZi, I Ching, and twelve others — are worth taking seriously as frameworks for self-reflection, not as prediction engines that can be validated or invalidated by a single day’s outcomes. This isn’t evasion; it’s a distinction that the evidence supports.
What the research on hit rates makes clear is that the felt accuracy of these systems — the warm recognition, the sense that the reading was written specifically for you — is an unreliable guide to predictive accuracy. These are different things. The Barnum Effect and confirmation bias can generate a strong sense of felt accuracy from a system that is performing at chance. Understanding this doesn’t eliminate the utility of oracular practice; it clarifies what that utility actually is.
The readings The Whisper generates are designed to be specific rather than vague — to use the particular structure of your BaZi chart or your natal placements rather than the general characteristics of your sun sign — precisely because specificity is the only condition under which a genuine test is possible. A reading that could apply to anyone isn’t wrong; it’s just not very interesting, and it’s not what the synthesis of fifteen systems is designed to produce.
Tracking your own hit rate, if you do it carefully, is one of the more useful things you can do as a user of any oracular system. You might find that the numbers are sobering. You might find that the practice retains its value even so. Either way, you’ll be engaging with it honestly — which, in the long run, is the only form of engagement worth having.
Curious about the psychology behind why readings feel accurate? See Confirmation Bias and Astrology and The Barnum Effect.