Register For Our Mailing List

Register to receive our free weekly newsletter including editorials.

Home / 402

Consumers need an effective super performance test

The Your Future, Your Super (YFYS) reforms are designed to improve outcomes for superannuants, which is nearly all of us. The reform package is undoubtedly well-intended. Therefore it is critical that it achieves its intended purpose. This has been our focus when we have reviewed one of the most important reform measures, an investment performance test.

Unfortunately, our research (open to anyone, available here) finds that the performance test will not effectively achieve its intentions and will generate some undesirable outcomes. Statistically, the performance test will struggle to distinguish ‘good’ funds from ‘bad’. Further, the performance test will significantly constrain the investment strategies of super funds, to such a degree that the opportunity cost of the constraints may exceed the projected benefits of the YFYS reforms.

The YFYS performance test explained

The YFYS performance test assesses past investment performance. For background, super funds have two primary functions when managing portfolios:

  1. They choose the mix of assets (we call this asset allocation); and
  2. They implement their asset allocation (implementation), sometimes by investing directly and sometimes via external asset managers, who charge fees.

The YFYS performance test ignores asset allocation (which has a large impact on performance) and only assesses implementation performance. It does this by mapping portfolio exposures to a limited set of public market indices.

The example below places context around the total performance outcome. Fund A outperforms Fund B because it chose a better performing asset allocation, which more than offsets its weaker implementation performance. Yet Fund A will fail the YFYS performance test.

Performance component

Fund A

Fund B

Asset allocation

7.5%

6.5%

Implementation

-0.5% pa

0% pa

Total performance

7.0% pa

6.5% pa

Will the test be able to effectively distinguish between ‘good’ and ‘bad’ performers?

Performance varies over time. A fund may have strong capability and is expected to perform well over time, but variability exists and there is a chance they will fail the performance test at some point in time. Similarly there is a chance, again due to variability, that a fund with poor processes will pass a performance test. Greater variability takes the likelihood of failure towards 50%, akin to a coin toss. Longer timeframes smooth out the impact of variability.

The statistically-minded may recognise these scenarios as type I (identifying a ‘good’ fund as poor) and type II (identifying a ‘poor’ fund as good) errors. These essentially reflect the statistical effectiveness of the test. An effective test will have low likelihoods of both errors occurring.

We found that two design characteristics of the YFYS performance impair its effectiveness.

The first, as previously explained, is that the test ignores asset allocation performance, which can create large variability in fund performance.

The second is the benchmarking approach. There are many assets which are not benchmarked accurately, most notably private equity, unlisted property, unlisted infrastructure, all forms of credit, inflation-linked bonds, and the entire universe of alternative assets. This creates significant variability in the performance test results.

The good news is that for funds with extremely poor implementation performance the YFYS performance test will be quite effective. The bad news is that in less extreme situations, the ones more likely to be faced in the future, the test won’t work well.

Calibrated to realistic future scenarios our research revealed that the likelihood of the YFYS performance test mistakenly identifying a ‘good’ fund as poor was 35%, and the likelihood of mistakenly identifying a ‘poor’ fund as good was 42% (full results here).

Consumers deserve an effective performance test and industry deserves a fair assessment. As it stands the YFYS performance test won’t provide either.

Will the test constrain super funds from achieving best outcomes?

For super funds, the penalties of failing the performance test are severe. Accordingly, we expect them to actively manage their portfolios to ensure a high likelihood of passing the test.

This means reducing variability to the performance benchmark (this variability is known in industry as 'tracking error'). In turn this means limiting exposure to all those above-mentioned assets which the test doesn’t benchmark accurately (we found it would take over 50 indices to create a reasonably effective implementation test).

If present investment strategies are maintained, funds may find they have to frequently adjust their portfolios in reaction to short-term underperformance, which could incur sizable transaction costs.

In future, super funds will seek a stable investment strategy which provides a high likelihood of passing the performance test and low likelihood of having to frequently alter their portfolios.

How much would portfolios have to be shifted from current state, which is focused on member best outcomes, to future state, where they need to account for the performance test? This effectively represents the constraints imposed by the performance test. The diagram below presents the conflict faced by super funds.

Using conservative estimates (here) we calculated the opportunity cost of the portfolio constraints implied by the YFYS performance test. In aggregate we estimate these will exceed $3 billion per annum, greater than the projected benefits of the YFYS reforms in total ($17.9 billion over 10 years).

Can we design a better YFYS performance test?

A well-designed performance test can benefit consumers. Our research, which combined academic techniques with industry experience, has identified flaws in the performance test which will cost consumers. We believe the test can be modified in a simple manner by including an additional metric which focuses on risk-adjusted returns. This would remove many of the shortcomings and provide consumers the protection they need and deserve.

 

David Bell is Executive Director of The Conexus Institute, a not-for-profit research institution focused on improving retirement outcomes for Australians. This article does not constitute financial advice.

 

6 Comments
David Bell
May 03, 2021

On Wednesday 28 April the Government announced two important changes to the performance test. One was the inclusion of administration fees (for further detail, see response to John’s question below). The other was the inclusion of three additional indices to benchmark unlisted property and infrastructure. This change removes a lot of the noise from the benchmarking process, to the extent that the concerns raised in the second section of this article (including the diagram) become far less significant.

Great to see Government and Treasury taking feedback on board.

David

john
April 30, 2021

A simple quick question. Do the performance tests include retail for profit funds as well as industry super funds ?? And of course final result for the client, that is after fees etc ??

David Bell
May 03, 2021

Hi John,
Thanks for your question, it is quite timely! On Wednesday 28 April the Government announced some changes to the design of the performance test. One change is to incorporate administration fees. This means that all sources of fees are included in the performance test, meaning it now captures any margin charged by retail funds. We think this is a good improvement but be aware that funds provide different service levels.
Cheers, David

Trevor
April 09, 2021

I just WISH that "they" ...the "know it all experts"......would just BACK OFF and leave the system alone !
By the time "one" adjusts to the "new , improved scheme" [ which is always retrograde or adverse IMO ]
"they" have another "new , improved scheme" on the slip-way ready to be launched !
So , instead of being able to RETIRE and RELAX in retirement , "one" is constantly "alarmed and alert" ,
the very opposite to what had been assumed before "one" retired , accepted redundancy or became equally removed and unable to repair any financial miscalculations.
IF "they" MUST TINKER ..... then do it with THE NEW COHORT.....and leave the REST OF US ALONE to rest !

.

David Bell
April 08, 2021

Hi John,

Thanks for sharing your thoughtful insights.

Our starting point was that the Government is intent on implementing the performance test, so the question became “what is one relatively simple change we would recommend which offsets many of the shortcomings?”
Your first point is a good one. YFYS is agnostic to how much risk – it remains one of a number of remaining “lottery effects” which will create significant dispersion in outcomes between members of different funds. Unfortunately, I don’t think we can address this issue in this round of reforms.

However, this doesn’t mean we need to ignore the risk efficiency of funds. Consider a future where the performance test is applied to lower risk choice products and retirement solutions. There are many ways to achieve a targeted level of risk and diversification can play a big role in the risk outcomes. That is why we advocate for a risk-adjusted metric. And it is far from a free ride either – our suggested metric compares outcomes against a portfolio of stocks and bonds delivering the same realised risk outcome – so there is effectively a benchmark diversification outcome embedded. Why bother? Well, many of the diversifying assets are the ones most heavily penalised in the proposed test.

Your second point is also well made. Whether, and the degree to which, the risk of unlisted assets is understated is the source of much debate. We have done work which details the option of incorporating a crude volatility adjustment to account for unlisted assets.

Overall, our biggest concerns with the performance test are that it ignores asset allocation decisions, has a large range of benchmarking issues, and ignores diversification benefits. This metric addresses these issues but is far from perfect. Fail both and you are out!

Cheers, David

John De Ravin
April 08, 2021

Thank you for your interesting and well reasoned article about the YFYS performance tests David. I agree with you (and much of the industry) that the tests need tweaking in some way. However I have two reservations about whether simply adding a “risk-adjusted” metric will resolve the issues.

Firstly isn’t the “risk-adjusted” return partly subject, for unlisted assets, to the valuation approaches adopted by the funds?

And secondly, assuming that “risk-adjusted” means that short-term volatility is taken into account (Sharpe ratios etc), I would query whether short-term volatility is of very crucial interest to a very long-term investor. What does it matter to a 20-year old, whose funds will be inaccessible for 40 years, that the single-year standard deviation of returns is higher in Fund X than in Fund Y, when really it’s the 40-year-averaged standard deviation that is really relevant to this member’s outcome? Put another way, the “risk vs return” trade off seems to me to be different for fund members with different time horizons.

 

Leave a Comment:

     

RELATED ARTICLES

Three reasons why super performance test fails

Super funds must earn the right to higher contributions

Checking the temperature of the APRA heatmap

banner

Most viewed in recent weeks

Super changes, the Budget and 2021 versus 2022

Josh Frydenberg's third budget contained changes to superannuation and other rules but their effective date is expected to be 1 July 2022. Take care not to confuse them with changes due on 1 July 2021.

Noel's share winners and loser plus budget reality check

Among the share success stories is a poor personal experience as Telstra's service needs improving. Plus why the new budget announcements on downsizing and buying a home don't deserve the super hype.

Grantham interview on the coming day of reckoning

Jeremy Grantham has seen it all before, with bubbles every 15 years or so. The higher you go, the longer and greater the fall. You can have a high-priced asset or a high-yielding asset, but not both at the same time.

Whoyagonnacall? 10 unspoken risks buying off-the-plan

All new apartment buildings have defects, and inexperienced owners assume someone else will fix them. But developers and builders will not volunteer to spend time and money unless someone fights them. Part 1

BHP v Rio v Fortescue: it's all about the iron ore price

Don’t look at an earnings forecast or a DCF valuation or a broker target price for a mining company. Share price forecasts are only as good as the commodity price assumptions they are based on, and they are a guess.

Should investors brace for uncomfortably high inflation?

The global recession came quickly and deeply but it has given way to a strong rebound. What are the lessons for investors, how should a portfolio change and what role will inflation play?

Latest Updates

Shares

Five stock recoveries not hanging on COVID predictions

The focus on predicting the recovery from the pandemic is the wrong emphasis. Better to identify great companies benefitting from market changes over a three- to five-year horizon with or without COVID.

Exchange traded products

Peak to peak, which LIC managers performed during COVID?

A comprehensive review of dozens of LICs shows how they performed in the crucial 'peak to peak' of COVID. This 14 months tested the mettle and strategies of a sector often under fire, with many strong results.

Property

Blink and you missed a seismic shift in these stocks

Blink and it happened. If announcements in this sector were made by a producer of iron ore, gas, copper or some new tech, the news would have been splashed across the front pages. Have we witnessed a major change?

Worries over the planned proxy rule changes in Australia

We do not agree with Treasury’s suggestion that institutional investors are overly influenced by the research provided by proxy advisors. Here's how active ownership works to serve the client's best interests.

Economy

How to invest as inflation fears fade

There are many reasons why the worries about inflation are overstated and investors should protect their portfolios against falling inflation rather than rising. The economy is completely different to the 1970s.

Economy

A tale of the inflation genie, the Fed and the RBA

The inflation genie is still in the bottle. While wage growth remains low and the US Fed maintains current settings, we should expect the RBA's accommodatory approach to continue.

Strategy

Not so plastic fantastic: solving the single-use pandemic

At least 8 million tonnes of plastics leak into the ocean each year, equivalent to one garbage truck every minute. This is expected to double by 2030. Such pollution brings risks and opportunities for many companies.

Sponsors

Alliances

© 2021 Morningstar, Inc. All rights reserved.

Disclaimer
The data, research and opinions provided here are for information purposes; are not an offer to buy or sell a security; and are not warranted to be correct, complete or accurate. Morningstar, its affiliates, and third-party content providers are not responsible for any investment decisions, damages or losses resulting from, or related to, the data and analyses or their use. Any general advice or ‘regulated financial advice’ under New Zealand law has been prepared by Morningstar Australasia Pty Ltd (ABN: 95 090 665 544, AFSL: 240892) and/or Morningstar Research Ltd, subsidiaries of Morningstar, Inc, without reference to your objectives, financial situation or needs. For more information refer to our Financial Services Guide (AU) and Financial Advice Provider Disclosure Statement (NZ). You should consider the advice in light of these matters and if applicable, the relevant Product Disclosure Statement before making any decision to invest. Past performance does not necessarily indicate a financial product’s future performance. To obtain advice tailored to your situation, contact a professional financial adviser. Articles are current as at date of publication.
This website contains information and opinions provided by third parties. Inclusion of this information does not necessarily represent Morningstar’s positions, strategies or opinions and should not be considered an endorsement by Morningstar.

Website Development by Master Publisher.