Register For Our Mailing List

Register to receive our free weekly newsletter including editorials.

Home / 283

4 reasons why investment performance comparisons are flawed

Over the course of 2018, the focus on peer relative comparison of superannuation fund investment returns has increased, fuelled by the usual end of financial year comparisons, and this year compounded by the Productivity Commission and Royal Commission reviews.

While it is right for fund returns to come under close scrutiny - after all, the impact of a lower return on a member's balance over the long term is significant - there are many aspects of these comparisons that are deeply flawed.

1. Excessive focus on the short term

Anyone who builds a multi-sector investment portfolio knows that they are designed to deliver over the long term. The focus should be on five years or more for most 'growth' or 'balanced' funds in the performance surveys, and even better seven or 10 years. The media and the survey providers grab on one year is largely meaningless.

2. Ignorance of investment objectives

The stated investment objective of most balanced superannuation funds is usually stated as a 'CPI plus' return over a specified time frame. For example, a 75% growth asset fund would typically have an objective of CPI + 3.5% over five years.

It was notable that during the Royal Commission hearings, the focus was almost exclusively on peer relative performance measures rather than performance against the investment objective. The Commission examined which funds had outperformed others, and more often than not industry funds versus retail funds. Yet even the bottom quartile fund in the SuperRatings survey has delivered 7.8% pa over five years and 5.7% pa over 10 years to June 2018 (the latter is lower as it still includes the impact of the GFC), against an investment objective of around 5.5% (based on CPI + 3.5%). The fact that almost all funds achieved their stated investment objective, even including the GFC, has been completely ignored. These funds have achieved what they had promised to deliver to members over the long term.

3. Major differences in asset allocation within same category

For reasons of practicality, comparison surveys include funds with a wide range of growth-defensive mixes in each bracket. For example, for the most-watched growth-oriented survey categories, SuperRatings covers 60-76% growth assets, while Chant West has a range of 61-80%. This is a very wide range. During rising equity markets, a fund with 60-70% growth assets will of course perform worse than funds in the 70-80% range.

A trend line of fund returns against growth asset levels suggests that a 10% increase in growth assets (from 65% to 75%) produced a 1% higher return over five years, and a 0.5% higher return over 10 years. This is enough to move a fund from 1st quartile to 3rd quartile over both time periods, a massive difference in performance ranking.

In this age of quantitative analysis, survey providers should provide a regression fit showing the best fit line for the results, which then allows a comparison of an individual fund's performance at the comparable growth asset allocation, as shown in the chart below. Funds could then be compared against what they should have been expected to return. A fund above the trend line has outperformed at its level of growth assets, and equivalently for those funds below the trend. This would then focus attention on funds relative to their own growth asset positioning.

After all, a fund with 76% growth assets could make bad decisions and underperform relative to what it should achieve, just as a fund with 65% growth assets can. The higher equity exposure should not disguise the real result.

A resultant impact of the focus on peer relative performance is that funds have started to push themselves towards the top end of the survey brackets, so there is a cluster of funds with growth asset allocations towards the top end of the bracket (as can be seen in the above charts, for the SuperRatings survey).

Of course, targeting higher return also comes with higher risk. This is not necessarily driven by what is the best investment structure for their members, but by the desire to outperform competitors.

4. The growth versus defensive asset definition game

The assessment is made even more cloudy because there is no industry-wide standard for defining growth and defensive assets. While some assets are easily defined as 100% growth (listed equities, private equity) or 100% defensive (cash, sovereign and investment grade corporate bonds, inflation-linked bonds), there are many assets that exhibit both growth and defensive qualities, such as unlisted property and infrastructure assets, high yield bonds, alternatives.

Rather than having a standard accepted definition, funds are allowed to make their own choice. Inevitably, some funds have been aggressive in saying some growth assets are defensive, allowing them to load up on other growth assets to the point where they should not be in the survey bracket they are allocated.

Guidance for allocating between growth and defensive

Applying some simple metrics such as the ones below would provide guidance for how to allocate assets on the growth-defensive range, especially for unlisted assets:

  • Volatility (standard deviation) of the asset class (higher volatility = higher growth allocation)
  • Correlation of the asset class returns with listed equities (higher correlation = higher growth allocation)
  • The largest historical drawdown of the asset class over the last 30 years (bigger drawdown = higher growth allocation)
  • The breakdown of the asset class return into its capital and income components (greater % in capital return = higher growth allocation, and vice versa) and
  • The level of leverage of underlying investments within a fund (higher leverage = higher growth allocation).

Rightly or wrongly, survey providers have argued it is not their role to dictate to funds on this question. While that in itself is debateable – some leadership on this issue would actually be in their interests - what is needed is an industry-wide agreement (preferably sponsored by an industry body) on some parameters to decide the correct growth-defensive allocation.

As some unlisted property and infrastructure funds include a variety of types of assets, this could include requiring investment managers to provide an assessment of growth-defensive qualities of their own funds. For example, an unlisted property manager could assess each property on its capital and income components, historical volatility and the like, and conclude its fund on average should be classified as 50% growth and 50% defensive. A superannuation fund would then use these metrics to calculate a fund-wide breakdown of its product (as the sum product of the asset allocation and the growth % allocation).

While it may be too much expect the media to focus on long-term returns (both absolute and relative to peers) and performance against investment objectives, these relatively easy measures would markedly improve peer relative performance comparisons, and provide a more like-with-like comparison of fund returns. It would also remove the gaming currently prevalent in the system, and focus attention on the real story – generating a return net of fees and taxes that will meet the retirement needs of members.


Phil Graham is an independent investment committee member. Until recently he was Deputy Chief Investment Officer with Mercer.

Sean Henaghan
December 13, 2018

One obvious requirement for an asset to be classified as defensive is liquidity. As any member can withdraw their money with a day’s notice - how can liquidity be ignored??

Alexander Austin
December 08, 2018

Great article Phil

T Kennett
December 07, 2018

A very important topic for the purchasers of investment exposures - thanks Phil. Sadly fund sponsors and their advisors continue to let consumers down, as outlined in the article. Given the incentives and conflicts, agreement within the fund sponsor sector on meaningful definitions is unlikely. Consumers of investment products might therefore be best serviced with one relevant statistic for each product - the allocation to high quality defensive assets, defined as investment grade cash and sovereign debt securities. Investors at least will know how much of the portfolio can be considered capital secure, the dominant consideration for late stage accumulation and most pension stage investors. Not perfect but a vast improvement on the current virtually meaningless descriptors provided by funds like Hostplus cited in the article (and others) ?

Andrew Howse
December 06, 2018

I vote for a Fund Manager of the Decade. Prestigious and well earned...over a long period.

Richard Brannelly
December 06, 2018

Thanks for your well written article Phil. This is an issue many advisers have been ranting about for years now and concerted action by regulators needs to occur to prevent the gaming and blatant misrepresentation that is growing and becoming widespread. Ratings and research houses should also be a lot more diligent and call out some of the excessive abuses in this area for the benefit of those investors without the knowledge, time, or desire to undertake proper comparisons. The HostPlus "Balanced" fund is a classic example of this given they communicate a 25% allocation to defensive assets and sit in the upper range of the 61-80% growth category. A closer inspection of their self-labelled 25% weighting to "defensive" assets shows this is presently made up of 6% infrastructure 9% property 5% credit and 5% loosely labelled as alternative. A case could be made to say the funds actual allocation is 95% growth and 5% defensive and should rightly be called the HostPlus "High Growth" fund? Surely this warrants calling out and highlights the risks posed by "best of breed" comparisons and simple league ladder type analysis. HostPlus is not alone on this front and investors and superannuation members deserve better.

Jerome Lander
December 06, 2018

This is testament to the power of incentives, in this case the career need of those operating in this environment for their returns to be better than peers. This has the predictable result of pushing up allocations to equities to the highest possible level. Without a considered focus on investment risk in addition to return, the regulator and government may simply be exacerbating the already excessive reliance of these funds on simple equity risk. Effectively, these funds' businesses may then simply succeed or otherwise based on whether equities work or not - which is a binary bet in the current world. How well equities work largely determines the relative results of funds, and what is then considered a "superior" fund! Quite sad when clients may expect and assume they are in prudently managed and diversified portfolios....
How is this aligned with acting in clients' best interests and being outcome focussed? Sadly, it isn't! Caveat emptor!


Leave a Comment:


Most viewed in recent weeks

House prices surge but falls are common and coming

We tend to forget that house prices often fall. Direct lending controls are more effective than rate rises because macroprudential limits affect the volume of money for housing leaving business rates untouched.

Survey responses on pension eligibility for wealthy homeowners

The survey drew a fantastic 2,000 responses with over 1,000 comments and polar opposite views on what is good policy. Do most people believe the home should be in the age pension asset test, and what do they say?

100 Aussies: five charts on who earns, pays and owns

Any policy decision needs to recognise who is affected by a change. It pays to check the data on who pays taxes, who owns assets and who earns the income to ensure an equitable and efficient outcome.

Three good comments from the pension asset test article

With articles on the pensions assets test read about 40,000 times, 3,500 survey responses and thousands of comments, there was a lot of great reader participation. A few comments added extra insights.

The sorry saga of housing affordability and ownership

It is hard to think of any area of widespread public concern where the same policies have been pursued for so long, in the face of such incontrovertible evidence that they have failed to achieve their objectives.

Two strong themes and companies that will benefit

There are reasons to believe inflation will stay under control, and although we may see a slowing in the global economy, two companies should benefit from the themes of 'Stable Compounders' and 'Structural Winners'.

Latest Updates


Stop treating the family home as a retirement sacred cow

The way home ownership relates to retirement income is rated a 'D', as in Distortion, Decumulation and Denial. For many, their home is their largest asset but it's least likely to be used for retirement income.


Hey boomer, first home buyers and all the fuss

What is APRA worried about? Most mortgagees can easily absorb increases in interest rates without posing a systemic threat to the banking system. Housing lending is a relatively risk-free activity for banks.


Residential Property Survey Q3 2021

Housing market sentiment has eased from record highs and confidence has ticked down as house price rises slow. Construction costs overtook lack of development sites as the biggest impediment for new housing.

Investment strategies

Personal finance is 80% personal and 20% finance

Understanding your own biases and behaviours is even more important than learning about markets. Overcome four major cognitive biases that may be sabotaging your investing and recognise them in others.

Where do stockmarket returns come from over time?

Cash flow statements differ from income statements and balance sheets, and every company must balance payments to investors versus investing into the business. Cash flows drive the value of the business.

Fixed interest

How to invest in the ‘reopening of Australia’ in bonds

As Sydney and Melbourne emerge from lockdown, there are some reopening trades in the Australian credit market which 'sophisticated' investors should consider as part of their fixed income portfolios.


10 trends reshaping the future of emerging markets

Demand for air travel, China’s growing middle-class population, Brazil’s digital payments take-up, Indian IPOs, and increased urbanisation are just some of the trends being seen in emerging economies.



© 2021 Morningstar, Inc. All rights reserved.

The data, research and opinions provided here are for information purposes; are not an offer to buy or sell a security; and are not warranted to be correct, complete or accurate. Morningstar, its affiliates, and third-party content providers are not responsible for any investment decisions, damages or losses resulting from, or related to, the data and analyses or their use. Any general advice or ‘regulated financial advice’ under New Zealand law has been prepared by Morningstar Australasia Pty Ltd (ABN: 95 090 665 544, AFSL: 240892) and/or Morningstar Research Ltd, subsidiaries of Morningstar, Inc, without reference to your objectives, financial situation or needs. For more information refer to our Financial Services Guide (AU) and Financial Advice Provider Disclosure Statement (NZ). You should consider the advice in light of these matters and if applicable, the relevant Product Disclosure Statement before making any decision to invest. Past performance does not necessarily indicate a financial product’s future performance. To obtain advice tailored to your situation, contact a professional financial adviser. Articles are current as at date of publication.
This website contains information and opinions provided by third parties. Inclusion of this information does not necessarily represent Morningstar’s positions, strategies or opinions and should not be considered an endorsement by Morningstar.

Website Development by Master Publisher.