Artificial intelligence enters hedge fund trading

Last week Hong Kong-based Aidyia turned on its new generation systematic trading system that uses artificial intelligence. Ben Goertzel, the firm's founder, claims the hedge fund is now fully automatic and, unlike others that use computer models, there is “no human intervention required”. Similar to Sentient Technologies, which has been trading private money with a similar system since last year, the technology uses deep learning to recognise changes in the market to identify longer term trades.

In recent years, however, funds have moved toward true machine learning, where artificially intelligent systems can analyze large amounts of data at speed and improve themselves through such analysis. The New York company Rebellion Research, founded by the grandson of baseball Hall of Famer Hank Greenberg, among others, relies upon a form of machine learning called Bayesian networks, using a handful of machines to predict market trends and pinpoint particular trades. Meanwhile, outfits such as Aidyia and Sentient are leaning on AI that runs across hundreds or even thousands of machines. This includes techniques such as evolutionary computation, which is inspired by genetics, and deep learning, a technology now used to recognize images, identify spoken words, and perform other tasks inside Internet companies like Google and Microsoft.

The hope is that such systems can automatically recognize changes in the market and adapt in ways that quant models can't. "They're trying to see things before they develop," says Ben Carlson, the author of A Wealth of Common Sense: Why Simplicity Trumps Complexity in Any Investment Plan, who spent a decade with an endowment fund that invested in a wide range of money managers.

This kind of AI-driven fund management shouldn't be confused with high-frequency trading. It isn't looking to front-run trades or otherwise make money from speed of action. It's looking for the best trades in the longer term---hours, days, weeks, even months into the future. And more to the point, machines---not humans---are choosing the strategy.

Evolving Intelligence

Though the company has not openly marketed its fund, Sentient CEO Antoine Blondeau says it has been making official trades since last year using money from private investors (after a longer period of test trades). According to a report from Bloomberg, the company has worked with the hedge fund business inside JP Morgan Chase in developing AI trading technology, but Blondeau declines to discuss its partnerships. He does say, however, that its fund operates entirely through artificial intelligence.

The whole idea is to do something no other human—and no other machine—is doing.

The system allows the company to adjust certain risk settings, says chief science officer Babak Hodjat, who was part of the team that built Siri before the digital assistant was acquired by Apple. But otherwise, it operates without human help. "It automatically authors a strategy, and it gives us commands," Hodjat says. "It says: 'Buy this much now, with this instrument, using this particular order type.' It also tells us when to exit, reduce exposure, and that kind of stuff."

According to Hodjat, the system grabs unused computer power from "millions" of computer processors inside data centers, Internet cafes, and computer gaming centers operated by various companies in Asia and elsewhere. Its software engine, meanwhile, is based on evolutionary computation---the same genetics-inspired technique that plays into Aidyia's system.

In the simplest terms, this means it creates a large and random collection of digital stock traders and tests their performance on historical stock data. After picking the best performers, it then uses their "genes" to create a new set of superior traders. And the process repeats. Eventually, the system homes in on a digital trader that can successfully operate on its own. "Over thousands of generations, trillions and trillions of 'beings' compete and thrive or die," Blondeau says, "and eventually, you get a population of smart traders you can actually deploy."

Deep Investing

Though evolutionary computation drives the system today, Hodjat also sees promise in deep learning algorithms---algorithms that have already proven enormously adept at identify images, recognizing spoken words, and even understanding the natural way we humans speak. Just as deep learning can pinpoint particular features that show up in a photo of a cat, he explains, it could identify particular features of a stock that can make you some money.

Goertzel---who also oversees the OpenCog Foundation, an effort to build an open source framework for general artificial intelligence---disagrees. This is partly because deep learning algorithms have become a commodity. "If everyone is using something, it's predictions will be priced into the market," he says. "You have to be doing something weird." He also points out that, although deep learning is suited to analyzing data defined by a very particular set of patterns, such as photos and words, these kinds of patterns don't necessarily show up in the financial markets. And if they do, they aren't that useful---again, because anyone can find them.

For Hodjat, however, the task is to improve on today's deep learning. And this may involve combining the technology with evolutionary computation. As he explains it, you could use evolutionary computation to build better deep learning algorithms. This is called neuroevolution. "You can evolve the weights that operate on the deep learner," Hodjat says. "But you can also evolve the architecture of the deep learner itself." Microsoft and other outfits are already building deep learning systems through a kind of natural selection, though they may not be using evolutionary computation per se.

Pricing in AI

Whatever methods are used, some question whether AI can really succeed on Wall Street. Even if one fund achieves success with AI, the risk is that others will duplicate the system and thus undermine its success. If a large portion of the market behaves in the same way, it changes the market. "I'm a bit skeptical that AI can truly figure this out," Carlson says. "If someone finds a trick that works, not only will other funds latch on to it but other investors will pour money into. It's really hard to envision a situation where it doesn't just get arbitraged away."

Goertzel sees this risk. That's why Aidyia is using not just evolutionary computation but a wide range of technologies. And if others imitate the company's methods, it will embrace other types of machine learning. The whole idea is to do something no other human---and no other machine---is doing. "Finance is a domain where you benefit not just from being smart," Goertzel says, "but from being smart in a different way from others."