The mathematical reality of market returns means that missing just a few top-performing stocks can doom an active portfolio to permanent underperformance.
Beyond Fees and Competition
In the ongoing debate between active and passive investing, the arguments against active management usually center on two practical hurdles: high management fees and the sheer intensity of competition. It is a zero-sum game where, after accounting for the costs of research and trading, the average manager is almost mathematically certain to lag behind a low-cost index. However, there is a third, less obvious reason why beating the market is so difficult. It isn't just about what you pay or who you are playing against; it is about the fundamental distribution of stock market returns.
Empirical data suggests that the performance of a broad market index is not driven by the steady, average growth of all its constituents. Instead, index returns are typically propelled by a very small number of stocks that experience extraordinary growth. This reality creates a 'skewness trap' for anyone attempting to pick winners. When you try to select a subset of stocks from an index, you aren't just looking for gems; you are inadvertently increasing the mathematical probability that you will miss the few stocks that actually matter.
The Power of the Top Ten Percent
To understand the severity of this distribution, one only needs to look at global market data from the last few decades. Between 1994 and 2016, global stocks returned an average of 7.3% per year. This is a respectable figure that compounds into significant wealth over time. However, if you were to remove just the top 10% of performing stocks from that global portfolio, the average annual return would have plummeted to 2.9%. If you were even less fortunate and missed the top 25% of performers, the return would have turned negative, dropping to -5.2% annually.
This data reveals a stark reality: the 'average' stock is actually quite mediocre. The healthy returns we associate with the stock market are heavily dependent on a tiny elite of super-performers. For an active manager to beat the market, they cannot simply be 'good' at picking stocks; they must be exceptional at ensuring they do not accidentally exclude the handful of companies that provide the lion's share of the index's total return.
The Mathematics of Underperformance
A 2017 paper by Heaton, Polson, and Witte, titled 'Why Indexing Works,' provides a helpful thought experiment to illustrate this challenge. Imagine an index consisting of only five stocks. In a given period, four of those stocks return 10%, while one 'super-performer' returns 50%. If an active manager creates a portfolio by selecting only one or two of these stocks, there are fifteen possible combinations they could choose. Because the 50% return is concentrated in only one stock, ten out of those fifteen possible portfolios will fail to hold it.
In this scenario, two-thirds of all active managers will underperform the index simply because they didn't own the right stock. While the average return of all managers combined will still equal the market return of 18% (before fees), the individual experience for most managers is one of failure. The index wins not because it is smarter, but because it is the only portfolio guaranteed to own the 50% winner. By trying to be selective, the active manager effectively bets against the odds of inclusion.
The High Conviction Paradox
Faced with the threat of underperformance, many active managers fall into the trap of 'closet indexing'—holding a portfolio that looks almost exactly like the index while charging high fees for the privilege. This is a strategy guaranteed to lose after costs. To counter this, some managers pitch 'high conviction' or 'high active share' strategies, arguing that by being very different from the index, they have a better chance of outperforming it. They lean into concentrated bets to prove their value.
However, the research suggests that this approach only heightens the risk. While a concentrated portfolio has a theoretical chance of massive outperformance if it hits the right outliers, the statistical likelihood of missing those outliers increases as the portfolio becomes more selective. In a market where returns are driven by a few winners, the more 'active' a manager becomes, the more they rely on pure luck to ensure those winners are in their narrow selection. This makes the already difficult task of identifying a truly skilled manager nearly impossible for the average investor.
The Indexing Advantage
Ultimately, the success of indexing isn't just about low costs; it is about capturing the full distribution of returns. An index fund is a passive recipient of the market's occasional, unpredictable windfalls. It doesn't need to predict which company will be the next global titan because it already owns all of them. By contrast, the active manager must be right every time, avoiding the pull of the mediocre majority while catching the few stocks that move the needle.
When we combine the burden of fees with the mathematical probability of missing the market's top performers, the case for active management becomes increasingly fragile. Even if a manager is talented and the fees are reasonable, they are still fighting against the basic geometry of market returns. For most investors, the most reliable way to ensure you own the winners is to simply own everything.