How Large Language Models Generate Horoscopes (And What That Means for Accuracy) cover

How Large Language Models Generate Horoscopes (And What That Means for Accuracy)

AI-generated horoscopes are produced by next-token prediction over patterns in training data, not by any astrological calculation happening inside the model. Here's what that means for evaluating their accuracy.

What’s Actually Happening Inside the Model

A large language model generating a horoscope is doing something quite specific and quite different from what the output might suggest. At its core, an LLM is a system trained to predict the most statistically probable next word (more precisely, the next “token” — a word or word-fragment), given everything that’s come before it in the current context. It was trained by being shown enormous quantities of text and adjusting its internal parameters, over and over, to get progressively better at this single task: predicting what word comes next.

When a model generates a horoscope, there is no internal module performing an astrological calculation, no symbolic representation of “Mars in Scorpio” being processed according to traditional astrological rules, and no retrieval of a stored, pre-written prediction matching the input. What’s happening is that the prompt — which might include a birth date, a sun sign, a request for “today’s horoscope for a Scorpio” — shifts the probability distribution over what the next words should be, based on patterns the model absorbed from the enormous amount of astrological and horoscope-related text it was trained on. The model has, in effect, learned the statistical texture of how horoscopes are written: what vocabulary tends to appear, what sentence structures are common, what topics (relationships, career, self-reflection) tend to follow which prompts, and how the language associated with “Scorpio” differs, in the training data, from the language associated with “Gemini.”

This is a genuinely different process from what a human astrologer does, even a human astrologer working purely from memorized rules without any chart calculation. A human, even when working sloppily or from memory, is applying something resembling a rule system, however imperfectly — this planet in this sign means this. The model is doing something more like an extremely sophisticated form of style and content imitation, calibrated entirely by what kind of text has historically followed similar prompts in its training data.

Why This Produces Fluent, Confident Output Regardless of Accuracy

One consequence of this mechanism, well worth understanding, is that nothing about how language models are trained creates any pressure toward the model being right about astrological claims, as opposed to being fluent and convincing in the style of astrological writing. The training objective — predict the next word accurately, based on patterns in human-written text — optimizes for matching the statistical patterns of how humans write about a topic, not for the truth of the claims being made.

This is true of LLM output generally, not uniquely true of horoscopes — it’s the same underlying reason language models can produce confidently-stated factual errors (sometimes called “hallucinations”) about any topic: the model is optimized to produce text that’s statistically plausible given the prompt and its training data, and plausible-sounding text and true text are correlated but not identical categories. For most factual domains, this creates a real problem, because there’s an objectively correct answer the model might fail to produce. For horoscope generation specifically, the situation is subtly different: there often isn’t a “correct” astrological prediction to fail to produce, because (as discussed at length elsewhere in this series) the underlying astrological claims don’t have established empirical validity to begin with. The model isn’t failing to retrieve a true prediction. It’s generating text in a genre where “true” isn’t really the operative category for most of its content — closer to generating fluent poetry than fluent arithmetic.

This means AI horoscope generation is, in an important sense, not a case where the model’s known unreliability (hallucination) is the central problem. The central feature is more specific: the model has become extremely good at producing text indistinguishable, in surface fluency and stylistic convention, from human-written astrological content — which is a genuinely impressive capability, and one that raises the question of what “accuracy” could even mean for output in a genre where the human-written version it’s imitating wasn’t reliably accurate either.

The Barnum Effect, Automated and Scaled

This connects directly to the Barnum effect mechanism discussed in detail elsewhere in this series. Bertram Forer’s original 1948 demonstration used a personality description he assembled by hand from a newsstand astrology book — broad, vague, widely-applicable language that nearly everyone rated as personally accurate. A large language model trained on a vast corpus of similar material has, in effect, learned the statistical signature of exactly this kind of writing — language calibrated, whether by deliberate craft or by the selective survival of effective phrasing over decades of horoscope-column writing, to feel personally resonant to a broad audience.

This means an LLM generating horoscope-style content isn’t just capable of producing Barnum-effect-style text — it may be unusually well-suited to it, in a specific sense: it has been trained on an enormous sample of exactly the kind of language that historically produces this effect, and the next-token-prediction training objective will tend to reproduce the statistical patterns that made that language work, without the model needing any explicit “goal” of producing broadly-applicable language. The pattern is simply baked into what fluent horoscope-genre text looks like, statistically, across the training corpus.

This is worth stating plainly because it cuts against an intuition that more sophisticated AI should produce more individually tailored, and therefore more accurate, output. The mechanism that makes the output feel personally resonant — broad applicability dressed in specific-sounding language — is largely orthogonal to, and may even work against, genuine individual tailoring. A model could become extremely good at producing text that feels personalized while becoming no better (or even slightly worse, if optimized purely for felt-resonance) at producing text that’s actually personalized to verifiable facts about the specific individual.

Where Personalization Can Genuinely Enter

This isn’t an argument that AI-generated astrological content is necessarily less personalized than human-generated content, only that the mechanism by which personalization could occur needs to be specified carefully, because next-token prediction alone doesn’t supply it.

Genuine personalization in an AI system requires that real, individuating information about the specific person — actual chart data calculated from their actual birth details, actual context about their stated situation or question — be provided as part of the input the model conditions its generation on, and that the generation process actually attends to and incorporates that specific information rather than defaulting to generic, broadly-applicable language regardless of what’s in the prompt. Well-designed systems do this by combining a deterministic calculation engine (computing actual chart positions, actual numerological reductions, actual hexagram results from real input data, not invented by the language model) with a generation layer that’s specifically prompted to synthesize and reference those calculated, individual-specific outputs rather than producing generic horoscope-genre text that happens to be dressed in the right vocabulary.

This distinction — between a system that calculates real, individual-specific data and then generates language describing it, versus a system that generates plausible-sounding astrological text without any real calculation underlying it — is the single most important technical fact for evaluating any AI divination tool, and it’s usually invisible to the end user, who sees only fluent output in either case. The fluency of the output tells you nothing about which kind of system produced it.

What “Accuracy” Would Even Mean Here

Given all of this, it’s worth being precise about what evaluating an AI horoscope’s “accuracy” should actually involve. It’s not primarily a question about the language model’s reliability in the sense usually discussed for AI systems (does it hallucinate facts, does it follow instructions correctly) — those are real concerns but somewhat beside the point for this specific genre. The more relevant questions are upstream of the language generation entirely: is the system calculating real chart data from real input, or just generating plausible-sounding astrological vocabulary? Is the underlying astrological framework being applied one that has any documented validity, independent of how fluently the AI describes it? And is the generated language actually conditioned on and responsive to the specific calculated data, or is it defaulting to broadly-applicable Barnum-style content regardless of what the calculation produced?

None of these questions are answered by how convincing or well-written the output sounds. A perfectly calculated, individually-specific chart reading and a generic, broadly-applicable horoscope can both be generated with equal fluency by the same underlying model — the difference lies entirely in what’s happening before the text generation step, in whether real calculation and real individual data are actually driving what gets generated. The model doesn’t know astrology. It knows what astrology sounds like. Whether what it produces is also, separately, tethered to something real about you is a question the fluency of its prose will never answer.

Some patterns only appear when the reading becomes personal.

Your reading

Enter your birth date to see your numbers.

Calculating your lenses…

Your Compass

Your Numerology meets Western Astrology →