Register For Our Mailing List

Register to receive our free weekly newsletter including editorials.

Home / 283

4 reasons why investment performance comparisons are flawed

Over the course of 2018, the focus on peer relative comparison of superannuation fund investment returns has increased, fuelled by the usual end of financial year comparisons, and this year compounded by the Productivity Commission and Royal Commission reviews.

While it is right for fund returns to come under close scrutiny - after all, the impact of a lower return on a member's balance over the long term is significant - there are many aspects of these comparisons that are deeply flawed.

1. Excessive focus on the short term

Anyone who builds a multi-sector investment portfolio knows that they are designed to deliver over the long term. The focus should be on five years or more for most 'growth' or 'balanced' funds in the performance surveys, and even better seven or 10 years. The media and the survey providers grab on one year is largely meaningless.

2. Ignorance of investment objectives

The stated investment objective of most balanced superannuation funds is usually stated as a 'CPI plus' return over a specified time frame. For example, a 75% growth asset fund would typically have an objective of CPI + 3.5% over five years.

It was notable that during the Royal Commission hearings, the focus was almost exclusively on peer relative performance measures rather than performance against the investment objective. The Commission examined which funds had outperformed others, and more often than not industry funds versus retail funds. Yet even the bottom quartile fund in the SuperRatings survey has delivered 7.8% pa over five years and 5.7% pa over 10 years to June 2018 (the latter is lower as it still includes the impact of the GFC), against an investment objective of around 5.5% (based on CPI + 3.5%). The fact that almost all funds achieved their stated investment objective, even including the GFC, has been completely ignored. These funds have achieved what they had promised to deliver to members over the long term.

3. Major differences in asset allocation within same category

For reasons of practicality, comparison surveys include funds with a wide range of growth-defensive mixes in each bracket. For example, for the most-watched growth-oriented survey categories, SuperRatings covers 60-76% growth assets, while Chant West has a range of 61-80%. This is a very wide range. During rising equity markets, a fund with 60-70% growth assets will of course perform worse than funds in the 70-80% range.

A trend line of fund returns against growth asset levels suggests that a 10% increase in growth assets (from 65% to 75%) produced a 1% higher return over five years, and a 0.5% higher return over 10 years. This is enough to move a fund from 1st quartile to 3rd quartile over both time periods, a massive difference in performance ranking.

In this age of quantitative analysis, survey providers should provide a regression fit showing the best fit line for the results, which then allows a comparison of an individual fund's performance at the comparable growth asset allocation, as shown in the chart below. Funds could then be compared against what they should have been expected to return. A fund above the trend line has outperformed at its level of growth assets, and equivalently for those funds below the trend. This would then focus attention on funds relative to their own growth asset positioning.

After all, a fund with 76% growth assets could make bad decisions and underperform relative to what it should achieve, just as a fund with 65% growth assets can. The higher equity exposure should not disguise the real result.

A resultant impact of the focus on peer relative performance is that funds have started to push themselves towards the top end of the survey brackets, so there is a cluster of funds with growth asset allocations towards the top end of the bracket (as can be seen in the above charts, for the SuperRatings survey).

Of course, targeting higher return also comes with higher risk. This is not necessarily driven by what is the best investment structure for their members, but by the desire to outperform competitors.

4. The growth versus defensive asset definition game

The assessment is made even more cloudy because there is no industry-wide standard for defining growth and defensive assets. While some assets are easily defined as 100% growth (listed equities, private equity) or 100% defensive (cash, sovereign and investment grade corporate bonds, inflation-linked bonds), there are many assets that exhibit both growth and defensive qualities, such as unlisted property and infrastructure assets, high yield bonds, alternatives.

Rather than having a standard accepted definition, funds are allowed to make their own choice. Inevitably, some funds have been aggressive in saying some growth assets are defensive, allowing them to load up on other growth assets to the point where they should not be in the survey bracket they are allocated.

Guidance for allocating between growth and defensive

Applying some simple metrics such as the ones below would provide guidance for how to allocate assets on the growth-defensive range, especially for unlisted assets:

  • Volatility (standard deviation) of the asset class (higher volatility = higher growth allocation)
  • Correlation of the asset class returns with listed equities (higher correlation = higher growth allocation)
  • The largest historical drawdown of the asset class over the last 30 years (bigger drawdown = higher growth allocation)
  • The breakdown of the asset class return into its capital and income components (greater % in capital return = higher growth allocation, and vice versa) and
  • The level of leverage of underlying investments within a fund (higher leverage = higher growth allocation).

Rightly or wrongly, survey providers have argued it is not their role to dictate to funds on this question. While that in itself is debateable – some leadership on this issue would actually be in their interests - what is needed is an industry-wide agreement (preferably sponsored by an industry body) on some parameters to decide the correct growth-defensive allocation.

As some unlisted property and infrastructure funds include a variety of types of assets, this could include requiring investment managers to provide an assessment of growth-defensive qualities of their own funds. For example, an unlisted property manager could assess each property on its capital and income components, historical volatility and the like, and conclude its fund on average should be classified as 50% growth and 50% defensive. A superannuation fund would then use these metrics to calculate a fund-wide breakdown of its product (as the sum product of the asset allocation and the growth % allocation).

While it may be too much expect the media to focus on long-term returns (both absolute and relative to peers) and performance against investment objectives, these relatively easy measures would markedly improve peer relative performance comparisons, and provide a more like-with-like comparison of fund returns. It would also remove the gaming currently prevalent in the system, and focus attention on the real story – generating a return net of fees and taxes that will meet the retirement needs of members.

 

Phil Graham is an independent investment committee member. Until recently he was Deputy Chief Investment Officer with Mercer.

6 Comments
Sean Henaghan
December 12, 2018

One obvious requirement for an asset to be classified as defensive is liquidity. As any member can withdraw their money with a day’s notice - how can liquidity be ignored??

Alexander Austin
December 07, 2018

Great article Phil

T Kennett
December 06, 2018

A very important topic for the purchasers of investment exposures - thanks Phil. Sadly fund sponsors and their advisors continue to let consumers down, as outlined in the article. Given the incentives and conflicts, agreement within the fund sponsor sector on meaningful definitions is unlikely. Consumers of investment products might therefore be best serviced with one relevant statistic for each product - the allocation to high quality defensive assets, defined as investment grade cash and sovereign debt securities. Investors at least will know how much of the portfolio can be considered capital secure, the dominant consideration for late stage accumulation and most pension stage investors. Not perfect but a vast improvement on the current virtually meaningless descriptors provided by funds like Hostplus cited in the article (and others) ?

Andrew Howse
December 06, 2018

I vote for a Fund Manager of the Decade. Prestigious and well earned...over a long period.

Richard Brannelly
December 06, 2018

Thanks for your well written article Phil. This is an issue many advisers have been ranting about for years now and concerted action by regulators needs to occur to prevent the gaming and blatant misrepresentation that is growing and becoming widespread. Ratings and research houses should also be a lot more diligent and call out some of the excessive abuses in this area for the benefit of those investors without the knowledge, time, or desire to undertake proper comparisons. The HostPlus "Balanced" fund is a classic example of this given they communicate a 25% allocation to defensive assets and sit in the upper range of the 61-80% growth category. A closer inspection of their self-labelled 25% weighting to "defensive" assets shows this is presently made up of 6% infrastructure 9% property 5% credit and 5% loosely labelled as alternative. A case could be made to say the funds actual allocation is 95% growth and 5% defensive and should rightly be called the HostPlus "High Growth" fund? Surely this warrants calling out and highlights the risks posed by "best of breed" comparisons and simple league ladder type analysis. HostPlus is not alone on this front and investors and superannuation members deserve better.

Jerome Lander
December 06, 2018

This is testament to the power of incentives, in this case the career need of those operating in this environment for their returns to be better than peers. This has the predictable result of pushing up allocations to equities to the highest possible level. Without a considered focus on investment risk in addition to return, the regulator and government may simply be exacerbating the already excessive reliance of these funds on simple equity risk. Effectively, these funds' businesses may then simply succeed or otherwise based on whether equities work or not - which is a binary bet in the current world. How well equities work largely determines the relative results of funds, and what is then considered a "superior" fund! Quite sad when clients may expect and assume they are in prudently managed and diversified portfolios....
How is this aligned with acting in clients' best interests and being outcome focussed? Sadly, it isn't! Caveat emptor!

 

Leave a Comment:

     
banner

Most viewed in recent weeks

Pros and cons of Labor's home batteries scheme

Labor has announced a $2.3 billion Cheaper Home Batteries Program, aimed at slashing the cost of home batteries. The goal is to turbocharge battery uptake, though practical difficulties may prevent that happening.

Welcome to Firstlinks Edition 605 with weekend update

Trump's tariffs and China's retaliatory strike have sent the Nasdaq into a bear market with the S&P 500 not far behind. What are the implications for the economy and markets, and what should investors do now? 

  • 3 April 2025

Howard Marks: the investing game has changed

The famed investor says the rapid switch from globalisation to trade wars is the biggest upheaval in the investing environment since World War Two. And a new world requires a different investment approach.

4 ways to take advantage of the market turmoil

Every crisis throws up opportunities. Here are ideas to capitalise on this one, including ‘overbalancing’ your portfolio in stocks, buying heavily discounted LICs, and cherry picking bombed out sectors like oil and gas.

World's largest asset manager wants to revolutionise your portfolio

Larry Fink is one of the smartest people in the finance industry. In his latest shareholder letter, the Blackrock CEO outlines his quest to become the biggest player in private assets and upend investor portfolios.

Welcome to Firstlinks Edition 606 with weekend update

The boss of Australia’s fourth largest super fund by assets, UniSuper’s John Pearce, says Trump has declared an economic war and he’ll be reducing his US stock exposure over time. Should you follow suit?

  • 10 April 2025

Latest Updates

Economics

Does Buffett’s farewell represent peak America?

Buffett's surprise decision to step down as Berkshire Hathaway's CEO sparked reflection on his legendary legacy and concern for America’s future, as he warned of unsustainable deficits and possible cracks in U.S. exceptionalism.

Taxation

Labor should focus on cutting Government spending

Reining in the Government's appetite for spending wouldn't just ease the country's fiscal burden. It would also clear the way for the meaningful tax reforms that are needed to boost Australia's ailing productivity.

Economy

The Liberals need to return to Menzies’ values

The former Liberal Minister and Chief of Staff to John Howard gives a blunt assessment of the election defeat and how the party needs to get back to its roots and merge its values with the needs of the community.

Gold

Gold $5,000?

Following the gold price's recent surge, headlines have popped up with increasingly bold predictions - US$5,000, even US$20,000 an ounce? This looks at the fundamentals and the credibility of these bullish predictions.

Economy

Are pension rules impacting fertility?

Australia’s push to delay retirement has boosted workforce participation - but at a cost. New research shows the measures have unintentionally impacted fertility rates, and the trend will be hard to reverse.

Investment strategies

Profiting from panic: inside the mind of a contrarian investor

Recent years have been challenging for contrarian investors, though 2025 has brought wild market swings, and with it, more opportunity. MFS' Zahid Kassam discusses contrarianism and his favourite global stocks.

Economics

America's green transition is taking a beating

The green transition in the US has made great progress in recent years, but the wheels are falling off. This is largely due to economic pressures, lack of financing, and the new tariffs instituted by Trump.

Sponsors

Alliances

© 2025 Morningstar, Inc. All rights reserved.

Disclaimer
The data, research and opinions provided here are for information purposes; are not an offer to buy or sell a security; and are not warranted to be correct, complete or accurate. Morningstar, its affiliates, and third-party content providers are not responsible for any investment decisions, damages or losses resulting from, or related to, the data and analyses or their use. To the extent any content is general advice, it has been prepared for clients of Morningstar Australasia Pty Ltd (ABN: 95 090 665 544, AFSL: 240892), without reference to your financial objectives, situation or needs. For more information refer to our Financial Services Guide. You should consider the advice in light of these matters and if applicable, the relevant Product Disclosure Statement before making any decision to invest. Past performance does not necessarily indicate a financial product’s future performance. To obtain advice tailored to your situation, contact a professional financial adviser. Articles are current as at date of publication.
This website contains information and opinions provided by third parties. Inclusion of this information does not necessarily represent Morningstar’s positions, strategies or opinions and should not be considered an endorsement by Morningstar.