Market predictions are notoriously unreliable, but understanding why they fail can help you build a more resilient long-term financial plan.
The Low Accuracy of Professional Gurus
Every year, analysts and financial media outlets release a barrage of forecasts regarding interest rates, currency fluctuations, and market returns. These predictions often carry an air of certainty, yet their historical track record is dismal. Larry Swedroe of the BAM Alliance has tracked 'sure thing' predictions since 2010; of the 69 major forecasts he tallied through 2018, only 32% actually materialized. If a prediction is framed as a certainty, a 32% success rate is worse than failure—it is a distraction.
Formal academic research mirrors this finding. A 2018 study titled 'Do Financial Gurus Produce Reliable Forecasts' examined over 6,600 predictions from 68 different forecasters. The researchers found that roughly 48% of these forecasts were correct, with two-thirds of the individual forecasters scoring below a 50% accuracy rate. In essence, listening to human market experts provides no more utility than a random guess, yet these forecasts continue to drive investor anxiety and impulsive decision-making.
The Trap of Market Timing
Even when we move away from human intuition and toward quantitative measures like the Shiller Cyclically Adjusted Price Earnings (CAPE) ratio, the data remains difficult to weaponize. The Shiller CAPE is a reliable indicator that high stock prices generally lead to lower future returns. However, using this as a timing tool is notoriously difficult. A study by AQR examined a strategy that adjusted stock exposure based on valuations from 1900 to 2015. While it added value in the early 20th century, it underperformed significantly from 1958 onward.
The reason for this underperformance is that markets can remain 'expensive' or 'cheap' relative to historical norms for decades. An investor who exited the market in the 1990s because the Shiller CAPE looked high would have missed years of substantial gains. Valuations can drift without returning to a mean for a very long time, making it nearly impossible to categorize a market as definitively overvalued without the benefit of hindsight calibration.
Recessions vs. Returns
Another popular forecasting tool is the inverted yield curve, which occurs when short-term treasury yields exceed long-term yields. This phenomenon has a remarkable track record of predicting US recessions, successfully signaling six of the last seven. While this might seem like a clear signal to move to cash, the link between economic contraction and stock market performance is not as direct as one might assume. Predicting a recession is not the same as predicting a negative equity premium.
Research by Eugene Fama and Ken French analyzed whether investors could improve returns by shifting to treasury bills following a yield curve inversion. They found no evidence that this strategy helped investors avoid poor stock returns. In fact, investors who exited stocks often sacrificed the 'unconditional expected equity premium'—the extra return earned for taking on market risk. While the yield curve may forecast economic activity, it does not reliably forecast the stock market's reaction to that activity.
Calibrating Expectations for the Future
If these tools aren't useful for timing the market, they are invaluable for financial planning. Many investors base their retirement projections on historical averages, such as the S&P 500’s long-term return of roughly 11%. However, current valuations suggest that using such a high figure today is dangerous. By taking the inverse of the Shiller PE (the earnings yield) and adding expected inflation, we can estimate a more realistic nominal return. For a US market with a high CAPE ratio, that expected return might drop to 4.6%.
This lower expectation shouldn't lead to panic, but rather to a broader perspective. While US stocks may look expensive, other regions often tell a different story. Canadian, international developed, and emerging markets frequently offer higher expected returns based on their current valuations. A diversified global portfolio allows an investor to capture the equity risk premium across different geographies, even when one specific market, like the United States, appears priced for lower growth.
The Value of Staying the Course
Ultimately, the problem with high valuations is not that they guarantee a crash, but that they widen the range of possible outcomes. Analysis of historical decades shows that even when the Shiller PE is at extreme highs, the gap between the best and worst possible ten-year returns remains massive—over 12 percentage points. High prices shift the average outcome downward, but they do not make the future any more certain or predictable in the short term.
The only forecasts worth paying attention to are those rooted in long-term data, and even those should only be used to tweak your planning assumptions, not your portfolio's core strategy. By sticking to a consistent asset allocation, you ensure that you remain exposed to the reliably positive equity risk premium. The goal of investing is not to outguess the next economic cycle, but to build a plan that survives regardless of which forecast eventually comes true.