Register For Our Mailing List

Register to receive our free weekly newsletter including editorials.

Home / 283

4 reasons why investment performance comparisons are flawed

Over the course of 2018, the focus on peer relative comparison of superannuation fund investment returns has increased, fuelled by the usual end of financial year comparisons, and this year compounded by the Productivity Commission and Royal Commission reviews.

While it is right for fund returns to come under close scrutiny - after all, the impact of a lower return on a member's balance over the long term is significant - there are many aspects of these comparisons that are deeply flawed.

1. Excessive focus on the short term

Anyone who builds a multi-sector investment portfolio knows that they are designed to deliver over the long term. The focus should be on five years or more for most 'growth' or 'balanced' funds in the performance surveys, and even better seven or 10 years. The media and the survey providers grab on one year is largely meaningless.

2. Ignorance of investment objectives

The stated investment objective of most balanced superannuation funds is usually stated as a 'CPI plus' return over a specified time frame. For example, a 75% growth asset fund would typically have an objective of CPI + 3.5% over five years.

It was notable that during the Royal Commission hearings, the focus was almost exclusively on peer relative performance measures rather than performance against the investment objective. The Commission examined which funds had outperformed others, and more often than not industry funds versus retail funds. Yet even the bottom quartile fund in the SuperRatings survey has delivered 7.8% pa over five years and 5.7% pa over 10 years to June 2018 (the latter is lower as it still includes the impact of the GFC), against an investment objective of around 5.5% (based on CPI + 3.5%). The fact that almost all funds achieved their stated investment objective, even including the GFC, has been completely ignored. These funds have achieved what they had promised to deliver to members over the long term.

3. Major differences in asset allocation within same category

For reasons of practicality, comparison surveys include funds with a wide range of growth-defensive mixes in each bracket. For example, for the most-watched growth-oriented survey categories, SuperRatings covers 60-76% growth assets, while Chant West has a range of 61-80%. This is a very wide range. During rising equity markets, a fund with 60-70% growth assets will of course perform worse than funds in the 70-80% range.

A trend line of fund returns against growth asset levels suggests that a 10% increase in growth assets (from 65% to 75%) produced a 1% higher return over five years, and a 0.5% higher return over 10 years. This is enough to move a fund from 1st quartile to 3rd quartile over both time periods, a massive difference in performance ranking.

In this age of quantitative analysis, survey providers should provide a regression fit showing the best fit line for the results, which then allows a comparison of an individual fund's performance at the comparable growth asset allocation, as shown in the chart below. Funds could then be compared against what they should have been expected to return. A fund above the trend line has outperformed at its level of growth assets, and equivalently for those funds below the trend. This would then focus attention on funds relative to their own growth asset positioning.

After all, a fund with 76% growth assets could make bad decisions and underperform relative to what it should achieve, just as a fund with 65% growth assets can. The higher equity exposure should not disguise the real result.

A resultant impact of the focus on peer relative performance is that funds have started to push themselves towards the top end of the survey brackets, so there is a cluster of funds with growth asset allocations towards the top end of the bracket (as can be seen in the above charts, for the SuperRatings survey).

Of course, targeting higher return also comes with higher risk. This is not necessarily driven by what is the best investment structure for their members, but by the desire to outperform competitors.

4. The growth versus defensive asset definition game

The assessment is made even more cloudy because there is no industry-wide standard for defining growth and defensive assets. While some assets are easily defined as 100% growth (listed equities, private equity) or 100% defensive (cash, sovereign and investment grade corporate bonds, inflation-linked bonds), there are many assets that exhibit both growth and defensive qualities, such as unlisted property and infrastructure assets, high yield bonds, alternatives.

Rather than having a standard accepted definition, funds are allowed to make their own choice. Inevitably, some funds have been aggressive in saying some growth assets are defensive, allowing them to load up on other growth assets to the point where they should not be in the survey bracket they are allocated.

Guidance for allocating between growth and defensive

Applying some simple metrics such as the ones below would provide guidance for how to allocate assets on the growth-defensive range, especially for unlisted assets:

  • Volatility (standard deviation) of the asset class (higher volatility = higher growth allocation)
  • Correlation of the asset class returns with listed equities (higher correlation = higher growth allocation)
  • The largest historical drawdown of the asset class over the last 30 years (bigger drawdown = higher growth allocation)
  • The breakdown of the asset class return into its capital and income components (greater % in capital return = higher growth allocation, and vice versa) and
  • The level of leverage of underlying investments within a fund (higher leverage = higher growth allocation).

Rightly or wrongly, survey providers have argued it is not their role to dictate to funds on this question. While that in itself is debateable – some leadership on this issue would actually be in their interests - what is needed is an industry-wide agreement (preferably sponsored by an industry body) on some parameters to decide the correct growth-defensive allocation.

As some unlisted property and infrastructure funds include a variety of types of assets, this could include requiring investment managers to provide an assessment of growth-defensive qualities of their own funds. For example, an unlisted property manager could assess each property on its capital and income components, historical volatility and the like, and conclude its fund on average should be classified as 50% growth and 50% defensive. A superannuation fund would then use these metrics to calculate a fund-wide breakdown of its product (as the sum product of the asset allocation and the growth % allocation).

While it may be too much expect the media to focus on long-term returns (both absolute and relative to peers) and performance against investment objectives, these relatively easy measures would markedly improve peer relative performance comparisons, and provide a more like-with-like comparison of fund returns. It would also remove the gaming currently prevalent in the system, and focus attention on the real story – generating a return net of fees and taxes that will meet the retirement needs of members.

 

Phil Graham is an independent investment committee member. Until recently he was Deputy Chief Investment Officer with Mercer.

  •   5 December 2018
  • 6
  •      
  •   
6 Comments
Jerome Lander
December 06, 2018

This is testament to the power of incentives, in this case the career need of those operating in this environment for their returns to be better than peers. This has the predictable result of pushing up allocations to equities to the highest possible level. Without a considered focus on investment risk in addition to return, the regulator and government may simply be exacerbating the already excessive reliance of these funds on simple equity risk. Effectively, these funds' businesses may then simply succeed or otherwise based on whether equities work or not - which is a binary bet in the current world. How well equities work largely determines the relative results of funds, and what is then considered a "superior" fund! Quite sad when clients may expect and assume they are in prudently managed and diversified portfolios....
How is this aligned with acting in clients' best interests and being outcome focussed? Sadly, it isn't! Caveat emptor!

Richard Brannelly
December 06, 2018

Thanks for your well written article Phil. This is an issue many advisers have been ranting about for years now and concerted action by regulators needs to occur to prevent the gaming and blatant misrepresentation that is growing and becoming widespread. Ratings and research houses should also be a lot more diligent and call out some of the excessive abuses in this area for the benefit of those investors without the knowledge, time, or desire to undertake proper comparisons. The HostPlus "Balanced" fund is a classic example of this given they communicate a 25% allocation to defensive assets and sit in the upper range of the 61-80% growth category. A closer inspection of their self-labelled 25% weighting to "defensive" assets shows this is presently made up of 6% infrastructure 9% property 5% credit and 5% loosely labelled as alternative. A case could be made to say the funds actual allocation is 95% growth and 5% defensive and should rightly be called the HostPlus "High Growth" fund? Surely this warrants calling out and highlights the risks posed by "best of breed" comparisons and simple league ladder type analysis. HostPlus is not alone on this front and investors and superannuation members deserve better.

Andrew Howse
December 06, 2018

I vote for a Fund Manager of the Decade. Prestigious and well earned...over a long period.

T Kennett
December 06, 2018

A very important topic for the purchasers of investment exposures - thanks Phil. Sadly fund sponsors and their advisors continue to let consumers down, as outlined in the article. Given the incentives and conflicts, agreement within the fund sponsor sector on meaningful definitions is unlikely. Consumers of investment products might therefore be best serviced with one relevant statistic for each product - the allocation to high quality defensive assets, defined as investment grade cash and sovereign debt securities. Investors at least will know how much of the portfolio can be considered capital secure, the dominant consideration for late stage accumulation and most pension stage investors. Not perfect but a vast improvement on the current virtually meaningless descriptors provided by funds like Hostplus cited in the article (and others) ?

Alexander Austin
December 07, 2018

Great article Phil

Sean Henaghan
December 12, 2018

One obvious requirement for an asset to be classified as defensive is liquidity. As any member can withdraw their money with a day’s notice - how can liquidity be ignored??

 

Leave a Comment:

banner

Most viewed in recent weeks

Australian stocks will crush housing over the next decade, 2025 edition

Two years ago, I wrote an article suggesting that the odds favoured ASX shares easily outperforming residential property over the next decade. Here’s an update on where things stand today.

Australia's retirement system works brilliantly for some - but not all

The superannuation system has succeeded brilliantly at what it was designed to do: accumulate wealth during working lives. The next challenge is meeting members’ diverse needs in retirement. 

Get set for a bumpy 2026

At this time last year, I forecast that 2025 would likely be a positive year given strong economic prospects and disinflation. The outlook for this year is less clear cut and here is what investors should do.

Meg on SMSFs: First glimpse of revised Division 296 tax

Treasury has released draft legislation for a new version of the controversial $3 million super tax. It's a significant improvement on the original proposal but there are some stings in the tail.

Building a lazy ETF portfolio in 2026

What are the best ways to build a simple portfolio from scratch? I’ve addressed this issue before but think it’s worth revisiting given markets and the world have since changed, throwing up new challenges and things to consider.

The 3 biggest residential property myths

I am a professional real estate investor who hears a lot of opinions rather than facts from so-called experts on the topic of property. Here are the largest myths when it comes to Australia’s biggest asset class.

Latest Updates

Investment strategies

Building a lazy ETF portfolio in 2026

What are the best ways to build a simple portfolio from scratch? I’ve addressed this issue before but think it’s worth revisiting given markets and the world have since changed, throwing up new challenges and things to consider.

Investment strategies

21 reasons we’re nearing the end of a secular bull market

Nearly all the indicators an investor would look for suggest that this secular bull market is approaching its end. My models forecast that the US is set for 0% annual returns over the next decade.

Property

13 million spare bedrooms: Rethinking Australia’s housing shortfall

We don’t have a housing shortage; we have housing misallocation. This explores why so many bedrooms go unused, what’s been tried before, and five things to unlock housing capacity – no new building required.

Investment strategies

Market entry – dip your toe or jump in all at once?

Lump sum investing usually wins, but it can hurt if markets fall. Using 50 years of Australian data, we reveal when staging your entry protects you, and when it drags on returns. 

Investment strategies

The US$21 trillion question: is AI an opportunity or excess?

It has been years since the US stock market has been so focused on a single driving theme, and AI is unquestionably that theme. This explores what it means for US and global markets in 2026.

Economy

US energy strategy holds lessons for Australia

The US has elevated energy to a national security priority, tying cheap, reliable power to economic strength, AI leadership, and sovereignty. This analyses the new framework and its implications for Australia.

Strategy

Venezuela’s democratic roots are deeper than Trump knows

Most people know Maduro was a dictator and Venezuela has oil. Few grasp the depth of suffering or the country’s democratic history - essential context as the US ousts Maduro and charts Venezuela’s future. 

Sponsors

Alliances

© 2026 Morningstar, Inc. All rights reserved.

Disclaimer
The data, research and opinions provided here are for information purposes; are not an offer to buy or sell a security; and are not warranted to be correct, complete or accurate. Morningstar, its affiliates, and third-party content providers are not responsible for any investment decisions, damages or losses resulting from, or related to, the data and analyses or their use. To the extent any content is general advice, it has been prepared for clients of Morningstar Australasia Pty Ltd (ABN: 95 090 665 544, AFSL: 240892), without reference to your financial objectives, situation or needs. For more information refer to our Financial Services Guide. You should consider the advice in light of these matters and if applicable, the relevant Product Disclosure Statement before making any decision to invest. Past performance does not necessarily indicate a financial product’s future performance. To obtain advice tailored to your situation, contact a professional financial adviser. Articles are current as at date of publication.
This website contains information and opinions provided by third parties. Inclusion of this information does not necessarily represent Morningstar’s positions, strategies or opinions and should not be considered an endorsement by Morningstar.