Register For Our Mailing List

Register to receive our free weekly newsletter including editorials.

Home / 365

Six types of big data are unlocking real insights

The use of big data in investment management has been revolutionary, but harnessing its potential is the next big challenge for the active asset management industry. Big data is the residue of information that we all leave behind as we buy things, sell things, browse the internet, use our smartphones and generally live our lives. Alpha, or excess returns, is not in the data itself, it is in how data is processed and creatively interrogated. Big data without data science lacks any power in uncovering insights that can deliver real alpha.

It all depends how the data is used

Despite the buzz that big data is generating within the research-driven world of finance and investment, achieving an integrated approach to using it is far from easy. Alternative data can be opaque or even misleading. Amid the hype, many will forget that big data is of little use without the combined insights of experienced data scientists and investment professionals.

So-called ‘big data’ is proliferating. At the same time, advances in cloud computing, machine learning and artificial intelligence allow extraction of coherent, strategic insights from these digital residues. Combined, as data science, they have the potential to be a richly-enhanced source of information about our world. It is information that is deeper and more detailed than we have ever had before, and yet also broader and more comprehensive.

In simple terms, data science potentially brings unique insights into the inner workings of a company under diligence. Most investors wait for quarterly earnings updates or an occasional meeting with an executive. Data science now enables tracking in near real-time the sales of a company and its competitors, the morale of its employees and their view of the CEO, how a new product launch is being received in a given market, research and development budgets, as well as numerous other key performance indicators.

These insights, sometimes unknown even to the company itself, give an advantage over the competition as they allow for a differentiated view of the company’s earnings power, or at the very least minimise impairment risk. Data science often provides insight into the operation of a business at a deeper level than is communicated more broadly, and in public reports.

Examples of big data opportunities

For example, credit card data is a popular form of alternative data but often it is used to infer total top line revenue in a quarter. This can contain significant bias and errors. Data science provides methods to detect and correct bias. In addition, statistical methods can be used to reveal demographics and psychographics in the data. Classifications of the data panel members by gender, age, urban density, income band, and buying preferences, etc. can be revealing about the cohorts and composition of the customer base and growth areas of a business. When evaluating a company it is important to know if the growth is from more customers, or from more loyalty spend by the same customers.

Online activity is another source of data science insight. Searching for something that a customer intends to buy is a leading indicator of the actual purchase. This leading indicator is particularly useful for higher cost items that are often considered for weeks before a purchase. Online transactions also provide insight into the competitive environment that the company of interest operates in, as well as a measure of the advertising spend in various channels.

Job listings provide a wealth of insight into the way that companies are growing, but this involves the use of data science methods to analyze the text of the job description. The descriptions show the areas and geographies where the company is growing, and within the text the company often signals the products from other business that they prefer to use.

Six categories of opportunities

Overall, many of the data science research hypotheses fall into one of the following six analytical categories:

Three years ago, we added a data science capability to its team of nearly 650 investment professionals. While many in the firm have come to quickly embrace data science, the recently-launched Global Equities Data-science Integrated strategy (or ‘GEDI’ for short) is the first to fully integrate data science with fundamental research and ESG engagement.

Of course, different strategists working to different time horizons will make different buy and sell decisions, but whatever they do, they will now be informed, to a greater or lesser extent, by the additional depth and breadth that these data science insights bring.

State Super’s senior investment manager, Andrew Huang, said of these new data-based techniques:

“To us, Neuberger Berman appears to be meaningfully ahead of the curve in building and implementing this approach. We believe that supporting fundamental research with a solid data-science and ESG discipline will be a growing advantage over time”.

Data science is not a replacement for traditional investment research, but a complement that brings a fresh and sometimes counter-intuitive perspective. It is not a technology support function for investment professionals but an extension of what they already do. For the same reasons, simply hiring a team of data scientists and setting them to work is not necessarily going to enhance an investment manager’s search for alpha. Finding a common language with which to integrate that team into the existing research flow that investment teams generate is critical.

Ultimately, we believe those who engage with big data seriously and ethically will find it transformative.

 

Michael Recce is Chief Data Scientist at Neuberger Berman, a sponsor of Firstlinks. This material is provided for information purposes only and nothing herein constitutes investment, legal, accounting or tax advice, or a recommendation to buy, sell or hold a security. It does not consider the circumstances of any investor.

For more articles and papers by Neuberger Berman, please click here.

 

RELATED ARTICLES

Charlie Munger on Buffett, gambling, Apple, and China

Five steps to become a better investor

Five reasons fund managers don't talk about skill

banner

Most viewed in recent weeks

Howard Marks: the investing game has changed

The famed investor says the rapid switch from globalisation to trade wars is the biggest upheaval in the investing environment since World War Two. And a new world requires a different investment approach.

Welcome to Firstlinks Edition 605 with weekend update

Trump's tariffs and China's retaliatory strike have sent the Nasdaq into a bear market with the S&P 500 not far behind. What are the implications for the economy and markets, and what should investors do now? 

  • 3 April 2025

Pros and cons of Labor's home batteries scheme

Labor has announced a $2.3 billion Cheaper Home Batteries Program, aimed at slashing the cost of home batteries. The goal is to turbocharge battery uptake, though practical difficulties may prevent that happening.

Designing a life, with money to spare

Are you living your life by default or by design? It strikes me that many people are doing the former and living according to others’ expectations of them, leading to poor choices including with their finances.

World's largest asset manager wants to revolutionise your portfolio

Larry Fink is one of the smartest people in the finance industry. In his latest shareholder letter, the Blackrock CEO outlines his quest to become the biggest player in private assets and upend investor portfolios.

4 ways to take advantage of the market turmoil

Every crisis throws up opportunities. Here are ideas to capitalise on this one, including ‘overbalancing’ your portfolio in stocks, buying heavily discounted LICs, and cherry picking bombed out sectors like oil and gas.

Latest Updates

Investment strategies

An enlightened dividend path

While many chase high yields, true investment power lies in companies that steadily grow dividends. This strategy, rooted in patience and discipline, quietly compounds wealth and anchors investors through market turbulence.

Investment strategies

Don't let Trump derail your wealth creation plans

If you want to build wealth over the long-term, trying to guess the stock market's next move is generally a bad idea. In a month where this might be more tempting than ever, here is what you should focus on instead.

Economics

Pros and cons of Labor's home batteries scheme

Labor has announced a $2.3 billion Cheaper Home Batteries Program, aimed at slashing the cost of home batteries. The goal is to turbocharge battery uptake, though practical difficulties may prevent that happening.

Investment strategies

Will China's EV boom end in tears?

China's EV dominance is reshaping global auto markets - but with soaring tariffs, overcapacity, and rising scrutiny, the industry’s meteoric rise may face a turbulent road ahead. Can China maintain its lead - or will it stall?

Investment strategies

REITs: a haven in a Trumpian world?

Equity markets have been lashed by Trump's tariff policies, yet REITs have outperformed. Not only are they largely unaffected by tariffs, but they offer a unique combination of growth, sound fundamentals, and value.

Shares

Why Europe is back on the global investor map

European equities are surging ahead of the U.S this year, driven by strong earnings, undervaluation, and fiscal stimulus. With quality founder-led firms and a strengthening Euro, Europe may be the next global investment hotspot.

Chalmers' disingenuous budget claims

The Treasurer often touts a $207 billion improvement in Australia's financial position. A deeper look at the numbers reveals something less impressive, caused far more by commodity price surprises than policy.

Fixed interest

Duration: Friend or foe in a defensive allocation?

Duration is back. After years in the doghouse, shifting markets and higher yields are restoring its role as a reliable diversifier and income source - offering defensive strength in today’s uncertain environment.

Sponsors

Alliances

© 2025 Morningstar, Inc. All rights reserved.

Disclaimer
The data, research and opinions provided here are for information purposes; are not an offer to buy or sell a security; and are not warranted to be correct, complete or accurate. Morningstar, its affiliates, and third-party content providers are not responsible for any investment decisions, damages or losses resulting from, or related to, the data and analyses or their use. To the extent any content is general advice, it has been prepared for clients of Morningstar Australasia Pty Ltd (ABN: 95 090 665 544, AFSL: 240892), without reference to your financial objectives, situation or needs. For more information refer to our Financial Services Guide. You should consider the advice in light of these matters and if applicable, the relevant Product Disclosure Statement before making any decision to invest. Past performance does not necessarily indicate a financial product’s future performance. To obtain advice tailored to your situation, contact a professional financial adviser. Articles are current as at date of publication.
This website contains information and opinions provided by third parties. Inclusion of this information does not necessarily represent Morningstar’s positions, strategies or opinions and should not be considered an endorsement by Morningstar.