Register For Our Mailing List

Register to receive our free weekly newsletter including editorials.

Home / 398

Investment forecasts: foresight or folly?

Forecasting is an integral part of the human experience. Almost every key decision we make in life involves some element of guessing at the future; from the suburb in which we buy a property, the studies we undertake and those we might encourage our children to pursue, the career direction we take and, of course, to the investment decisions we make.

We want our financial futures to be as secure as possible, and so it is only to be expected that anyone claiming investment foresight (real or otherwise) will find a willing ear.

We therefore listen attentively to the forecasts of those only too happy to prognosticate on television, the radio or online. And there is, at present, no shortage of investment sages proffering views on everything from the re-emergence of US inflation to the future of fiat currencies.

But how do we, the investing public, determine if any of these predictions are in any way superior to simple guesses? Well, help is at hand.

The Professor of Prescience

Enter Philip E Tetlock. Tetlock is a Professor at the University of Pennsylvania, with appointments across the Wharton Business School, psychology and political science. In 1984 Professor Tetlock embarked on a multi-year research project to understand the nature of expert judgement, studying some 28,000 forecasts made by hundreds of experts across a variety of fields including politics, the economy and finance. His is among the longest, most detailed academic studies of whether humans can actually predict the future with any statistically significant degree of accuracy.

Tetlock pitted the expert forecasts against a range of algorithmically derived forecasts (so-called ‘Clinical’ versus ‘Actuarial’ forecasts). His conclusions at the end of almost 20 years of investigation? “Surveying these scores across regions, time periods, and outcome variables, we find support for one of the strongest debunking predictions: it is impossible to find any domain in which humans clearly outperformed crude extrapolation algorithms, less still sophisticated statistical ones.”

Forecasts made by the experts were statistically indistinguishable from random guesses. This finding subsequently morphed, somewhat unflatteringly, into a metaphor of the average finance guru being no more accurate than a ‘dart-throwing chimp’ in guessing future investment outcomes.

Are investment professionals better forecasters?

OK, so geo-political analysts can’t predict the location and timing of the next military coup. But surely seasoned investment professionals, with all that financial market data at their disposal, can outperform random guesses? One might be tempted to think so.

Unfortunately, the evidence is to the contrary. In a 2015 study of investment analyst forecasts, researchers Marcus Spiwoks, Zulia Gubaydullina and Oliver Hein found that none of the predictions for share markets, interest rates and exchange rates for four countries were able to beat simple forecasts based on a simple ‘random walk’ assumption (that the best guess as to the future state is the current state).

Delving specifically into the forecasting of interest rates, they studied 158,022 4- and 13-month rate predictions across 12 countries only to find that over 98% of the forecasts better reflected rates at the time of making the forecast than at the future date. Hence the name of their paper, Trapped in the Here and Now – New Insights into Financial Market Analyst Behavior. In short, there was no noticeable evidence of investment foresight present.

Separating forecasting skill from luck

So how does one determine if an expert’s forecast might suggest a degree of foresight rather than being just a product of luck? You certainly wouldn’t want to ask for examples of his or her forecasting track-record. Why? Because if someone makes enough forecasts, some of them are bound to be proved right. These correct ‘calls’ can then be used as proof of foresight, while the unsuccessful ones go unmentioned in the hope of a quick burial without the possibility of exhumation and further analysis.

Just as a broken clock can still be right twice a day, it can be difficult to know where forecasting skill ends, and luck begins. Without a way of separating the two we’ll never know if a forecaster is lucky but without skill or skilful but unlucky.

Thankfully one such way does exist, and it is remarkably low tech. It involves committing a forecast to paper in an investment diary. But, and this is key, the forecaster must provide both the forecast and an explanation as to why it will eventuate. In this way the forecaster commits to providing a prediction of both cause and effect.

As simple and effective as this technique is, it is roundly ignored by the investment industry. Few investment manager(s) or financial planners are prepared to back their forecasts in such a manner. Fewer clients are prepared to demand they do. That’s a pity as keeping an investment diary is one of the most powerful ways to determine if one is right for the wrong reasons (lucky rather than skilful) or wrong but for the right reasons (skilful but without luck).

If it all sounds a little pedestrian and something that an investment manager or adviser would deem to be beneath them, consider this. One of the world’s most astute investors, hedge fund billionaire George Soros, recalls a period when he recorded all his investment decisions and the reasons behind them in an investment diary. In his words: “I kept a diary in which I recorded the thoughts that went into my investment decisions on a real-time basis. …The experiment was a roaring success in financial terms – my fund never did better. It also produced a surprising result: I came out of the experiment with quite different expectations about the future.”

Learning to sit with irreducible uncertainty

Danish physicist and Nobel prize-winner Niels Bohr is reputed to have once said “Prediction is very difficult, especially if it’s about the future.” What holds true in the sub-atomic world of matter holds doubly true in the world of investing, where the unpredictability of human behaviour, unlike the predictable laws of quantum mechanics, have an outsized effect on outcomes.

View the forecasts of investment gurus and talking heads for what they are, guesstimates. Undoubtedly intelligent and well informed, but guesstimates of an essentially unknown and unknowable future all the same. T’was ever thus.

 

Post-script: Those interested in delving further may wish to avail themselves of a copy of Philip Tetlock and Dan Gardner’s “Superforecasting: The Art and Science of Prediction” Crown Publishers (New York), 2015.

 

Harry Chemay has more than two decades of experience across both wealth management and institutional asset consulting. An active participant within the wealth and superannuation space, Harry is a regular contributor in Australia and overseas, writing on topics across investing, retirement planning and the provision of financial advice.

Harry was a co-founder in one of Australia’s earliest digital advice services, Clover.com.au, and has more recently been appointed an Australian Ambassador to the Transparency Task Force, a UK-led initiative to bring greater transparency and accountability to financial services.

 

RELATED ARTICLES

Smart beta funds complement active without key person risk

At 98-years-old, Charlie Munger still delivers the one-liners

10 key investment themes for 2022

banner

Most viewed in recent weeks

Lessons when a fund manager of the year is down 25%

Every successful fund manager suffers periods of underperformance, and investors who jump from fund to fund chasing results are likely to do badly. Selecting a manager is a long-term decision but what else?

2022 election survey results: disillusion and disappointment

In almost 1,000 responses, our readers differ in voting intentions versus polling of the general population, but they have little doubt who will win and there is widespread disappointment with our politics.

Welcome to Firstlinks Election Edition 458

At around 10.30pm on Saturday night, Scott Morrison called Anthony Albanese to concede defeat in the 2022 election. As voting continued the next day, it became likely that Labor would reach the magic number of 76 seats to form a majority government.   

  • 19 May 2022

Betting markets as election predictors

Believe it or not, betting agencies are in the business of making money, not predicting outcomes. Is there anything we can learn from the current odds on the election results?

Keep mandatory super pension drawdowns halved

The Transfer Balance Cap limits the tax concessions available in super pension funds, removing the need for large, compulsory drawdowns. Plus there are no requirements to draw money out of an accumulation fund.

Welcome to Firstlinks Edition 455 with weekend update

The resolve of many investors to focus on the long term with their share portfolios is increasingly tested as the list of negatives lengthens. There is a lack of visionary policies during an election campaign and stimulatory spending is contradicting the aims of tighter monetary policy.

  • 28 April 2022

Latest Updates

In praise of our unique democracy and its sausage

For all the shortcomings of our political campaigns, our election process is the best. We are blessed with honest administrators and procedures that we all trust to hand over power peacefully, with a big snag. 

Investment strategies

Is the investing landscape really different this time?

Many market analysts argue that the pandemic has changed everything but we must judge whether the circumstances are as drastic as billed. A quick review of four major events helps decide if this time is different.

Economy

Comparing generations and the nine dimensions of our well-being

Using the nine dimensions of well-being used by the OECD, and dividing Australians into Baby Boomers, Generation Xers or Millennials, it is surprisingly easy to identify the winners and losers for most dimensions.

Retirement

When will I retire? Economic impact of an ageing population

About 39% of the labour force is aged over 45. Intergenerational reports highlight the challenges of an ageing population and the impacts on consumption patterns, dependencies, public finances and economic growth.

The real story behind the crypto crash

The recent sell-off in the crypto market and its trigger - the collapse of the Terra UST coin - has affected many institutions either holding or trading crypto assets, including crypto fund managers.

Investment strategies

Cash is the nightingale, the bird in the hand

The bird in the hand is worth two in the bush, and it's an apt metaphor for investment choices. In 2021, as investors hunted in the bush for decent returns, demand overwhelmed supply. Cash is the bird in the hand.

Strategy

Book review of 'Putin’s People' and his motivation for war

Author Catherine Belton argues Putin’s sole ambition is to hold onto power. Her book seeks to understand why Putin invaded Ukraine after he became isolated and out of touch with reality during the pandemic.

Sponsors

Alliances

© 2022 Morningstar, Inc. All rights reserved.

Disclaimer
The data, research and opinions provided here are for information purposes; are not an offer to buy or sell a security; and are not warranted to be correct, complete or accurate. Morningstar, its affiliates, and third-party content providers are not responsible for any investment decisions, damages or losses resulting from, or related to, the data and analyses or their use. Any general advice or ‘regulated financial advice’ under New Zealand law has been prepared by Morningstar Australasia Pty Ltd (ABN: 95 090 665 544, AFSL: 240892) and/or Morningstar Research Ltd, subsidiaries of Morningstar, Inc, without reference to your objectives, financial situation or needs. For more information refer to our Financial Services Guide (AU) and Financial Advice Provider Disclosure Statement (NZ). You should consider the advice in light of these matters and if applicable, the relevant Product Disclosure Statement before making any decision to invest. Past performance does not necessarily indicate a financial product’s future performance. To obtain advice tailored to your situation, contact a professional financial adviser. Articles are current as at date of publication.
This website contains information and opinions provided by third parties. Inclusion of this information does not necessarily represent Morningstar’s positions, strategies or opinions and should not be considered an endorsement by Morningstar.

Website Development by Master Publisher.