Register For Our Mailing List

Register to receive our free weekly newsletter including editorials.

Home / 240

AI and an intelligent active manager’s odyssey

In spite of Artificial Intelligence's (AI) transformative potential, the investment management industry has been slow to invest in and use AI compared with other developed industries. This paper explores the journey of AI, a threat to active management that comes quickly behind the current shift to passive investment strategies.

Active management and the demand for hope

Much ink and some blood has been spilt over passive Exchange Traded Fund’s (ETF) supposed existential threat to the active management of securities and assets. While roughly one-third of all global equity management is now passive, the threat itself is overstated. Active’s survival, though in a much reduced form, is assured by the eternal demand for hope – hope of beating the market, hope of being above average, hope of not missing out. Supply to meet that demand flows willingly from active managers’ engaging and sometimes insightful narratives about exciting stocks, often hyped by new technologies.

That said, active is exposed to a deeper and longer-term threat, one that might just ‘sweep it away’. The Greek C P Cafavy’s poem Things Ended highlights how easily we miss more damaging threats:

Engulfed by fear and suspicion,

mind agitated, eyes alarmed

we try desperately to invent ways out,

plan how to avoid the obvious danger

that threatens us so terribly.

Yet we’re mistaken, that’s not the danger ahead:

the news was wrong

(or we didn’t hear it, or didn’t get it right).

Another disaster, one we never imagined,

suddenly, violently descends upon us,

and finding us unprepared – there’s no time now –

sweeps us away.

The opening gambit is Blackrock’s intention to replace all or many or some traditional active equity processes (of which Blackrock has $300 billion in assets under management) with quantitative active processes ostensibly because quant can generate alpha as successfully as traditional and at far lower cost. For many this is an old story. Most traditional managers rely on some form of computer-driven quant processes in portfolio construction and trading. Since 2010, the assets of quant hedge funds has doubled to nearly US$1 trillion, while according to JPMorgan, orders placed by computers now account for 60% of US trading volume, double the figure from a decade earlier. However, scale and market presence threaten to transform Blackrock’s initiative into an imperative for traditional managers.

A more substantial threat is lurking: Artificial Intelligence

But ‘going quant’ will provide only short-term solace. Lurking under the rubric ‘quant’ lies the more substantial threat of Artificial Intelligence (AI) or Deep Machine Learning.

The threat of AI to routine process-driven jobs is manifest even after discounting the considerable hype. But AI also threatens the jobs of lawyers, radiologists and others demanding advanced cognitive skills with its ability to recognise patterns and images, to learn, to improve its own algorithms.

In the investment management industry, both back and front offices are threatened. Eventually, AI will probably be capable of ‘thinking’ about, crafting, writing and even delivering engaging, insightful and empathetic narratives. Some AI programs already pass Turing’s Test in which interlocutors fail to distinguish between answers from a human and a computer.

Then AI too will sell hope.

Is this scenario, the ultimate disruptive one where machines make (almost) all investment and commercial decisions, pitch for business and report to clients? Or does it belong in the SciFi fantasy world? Doubtless some is fantasy, but less than we might hope for.

We tend to overestimate the short-term effects of new technology while underestimating the long-term effects. Campbell Harvey, a respected finance professor predicts that “in the end it will be a good thing for investors” if human judgement is usurped by machine judgement. When Amazon enters investment management that harsh reality may well emerge from picturesque fantasy. Indeed, Autonomous Learning Investment Strategies (ALIS) have been with us for some time though as yet they are not capable of crafting new insights or of selling hope.

AI’s co-existence with active managers

The history of technology suggests that some form of traditional active management will survive the rise of machines. The new often co-exists with the old rather than fully replacing it … quills and slide-rules notwithstanding. Co-existence will advance through human-machine interaction where human and machine in turn leverage off the other’s insights in a process of continual improvement. To thrive in that world active managers will need as yet unknown skills.

For a while at least, a traditional active approach should thrive. Traditional is likely to outperform machines in managing highly-concentrated portfolios and alternative assets, especially in heterogeneous domains where idiosyncratic risk is high and tacit security-specific knowledge is critical. To the extent that AI learns through data-mining, the relative scarcity of data in those domains favours humans.

Further, much alternative investing lacks robust, predictive theories which again favours human minds. However, both advantages will likely fade as AI overtakes the human ability to develop intuitive knowledge and insights without much data and without theories. When machines can formulate and test their own explanatory hypotheses traditional active management will raise the white flag. That fearful scenario lies ahead, as currently AI/Deep Machine Learning is poor at generalising specific information and can’t provide explanations or reasons to justify or explain its decisions (see ‘The dark secret at the heart of AI, MIT Technology Review, May/June 2017).

Currently it is a very black black-box and even blacker than the black-box inside active managers’ heads. The world chess champion Alpha Zero, given only the rules and aim of the game, learns to play chess by playing against itself many times, but can’t explain or justify its moves and tactics.

Investment management slow to invest in AI

In spite of AI’s transformative potential, the investment management industry has been slow to invest in the necessary R&D, and even slower to use AI compared with other developed industries. Investing fails to rate a mention in Stanford University’s AI Index. Failure is likely explained by the comfort induced by persistently high margins, by the industry’s capital-light structure which inhibits capital-intensive R&D, and by its much-vaunted essence as a human relationship-driven business. If Blackrock’s initiative drives lower margins, it may encourage the development of AI in active investment management. Further, the rules under MiFID II may cause an easy target as sell-side analysts become ‘AI’d’.).

Embracing the opportunity

Unsurprisingly, some hedge funds with their greater institutional and intellectual freedom have been early adopters of AI and not just to uncover previously hidden factors in capital markets but also to improve human insights and decisions. The CFA has taken a positive step by offering teaching modules in AI and Big Data. Perhaps that’s a straw in the wind. Perhaps the investment industry will sacrifice its long-protected comfort and embrace the opportunity and risks afforded by on-going advances in Artificial Intelligence and Deep Machine Learning.


Jack Gray is a Special Advisor and Director of Brookvine. Jack has been voted one of the Top 10 most influential academics (in his previous life as an academic) in the world for institutional investing.


Most viewed in recent weeks

Are you caught in the ‘retirement trap’?

Our retirement savings system is supposed to encourage financial independence but there is a ‘Retirement Trap’ due to the reduction of age pension entitlements as assets and income rise.

The power of letting winners run

Handling extreme winners is a complex task. Conventional wisdom such as “you never go broke taking a profit” often leaves a lot of money on the table as strong growth stocks continue to run.

Tony Togher on why cash isn’t just cash

An active manager of cash and fixed interest funds can achieve higher returns than the cash rate through a selection of other securities while managing both liquidity and income for clients.

NAB hybrid: one says buy, one says sell, you decide

Differences of opinion make a market, and hybrid specialists disagree on the likelihood that NAB will call one of its hybrids early. It makes a major difference to the expected return on NABHA.

Watch your SMSF’s annual return this year

The best way to preserve your SMSF’s favoured status is to make sure the fund’s annual return reaches the ATO on time. There are new rules this year that every SMSF trustee should know.

Worshipping at the altar of alternative assets

Investors worried about an overvalued sharemarket and low interest rates on term deposits and bonds are focusing on alternatives. What are they and how are they used by leading asset allocators?

Latest Updates


Kunal Kapoor on different paths to investor success

The Morningstar CEO on democratising investing, why saving in your youth is crucial, and why most investors care more about paying off their debts than comparing their results against benchmarks.

Investment strategies

Do sin stocks really give your portfolio the edge?

Should sin stocks, those companies who engage in activities that are considered unethical or immoral, be excluded from a portfolio, or would this compromise potential performance?


What is the likely effect of COVID-19 on the Australian economy?

Our close links to China mean the impact of the virus could tip the local economy into recession and certain sectors such as resources, education and travel will be harder hit than others.


Poor pricing of life insurance products and the impact on Australians

The use of discounted pricing by insurers to attract new business is unsustainable and leaves existing policyholders on higher premiums for what is essentially the same product.


Spotting signs of trouble in a retirement portfolio

Do you risk paying a lot of tax in accumulation phase? Or, if you're in retirement phase, do you face the risk of outliving your asset pool? Two key things to consider in the low-rate world of today.