The Guy Who Taught AI to ‘Remember’ Is Launching a Startup
Jürgen Schmidhuber, a key player in the development of recurrent neural nets (RNN), has founded a startup called Nnaisense. According to the company website, Nnaisense is building a large-scale neural network solution for "superhuman perception and intelligent automation, with the ultimate goal of marketing general-purpose neural network-based Artificial Intelligences."
Psychedelic Background Getty Images

At Google, a team of researchers recently demonstrated an artificially intelligent system that could reliably identify a mountain-unicycling video.

As another Google researcher put it: "Who knew mountain unicycling was a thing?" But the implications of this system extend well beyond the realm of obscure outdoor sports. Making use of a technology called recurrent neural nets, it pointed to a near future where our artificially intelligent machines include a kind of artificial short-term memory. Basically, the system could identify the mountain unicycling because it could "remember." As it examined each frame of a video, it could look back at frames it had seen in the past.

Recurrent neural nets, or RNNs, can not only recognize complex moving images, but automatically generate detailed captions for online photos and videos, improve online services that translate from one language to another, and more. They're pushing into companies like Facebook and Baidu as well as Google, and in recent weeks, this burgeoning technology received another shot in the arm with the arrival of a new startup called Nnaisense.

According to the company's website, Nnaisense was founded by Jürgen Schmidhuber, a key figure in the development of modern RNNs, and four researchers who work alongside him at the Swiss AI lab called IDSIA (Istituto Dalle Molle di Studi sull'Intelligenza Artificiale). The German-born Schmidhuber helped create a breed of recurrent neural net called LSTM, or Long Short Term Memory, and his work has influenced the latest AI research at the likes of Google, Microsoft, IBM, and others.

Neither Schmidhuber nor Nnaisense immediately responded to requests to discuss the company's aims. The company is still very new. It registered the nnaissense.com internet domain this spring, and in June, it filed a trademark application for the nnaisense name (a nod to "neural networks" and "artificial intelligence"). As it stands, the company's website says its mission is to "build large-scale neural network solutions for superhuman perception and intelligent automation, with the ultimate goal of marketing general-purpose neural network-based Artificial Intelligences."

In other words, it's trying to do pretty much what Google and Facebook and Baidu are trying to do. But it's notable that Schmidhuber is entering the arena. The leading internet companies are jockeying for top talent in the field of "deep learning," a form of artificial intelligence that includes recurrent neural nets, and even without a product, Nnaisense is a potential target.

In recent years, Google and Facebook snapped up two notable names in the field, Geoff Hinton and Yann LeCun. This month, IBM inked an agreement with another, University of Montreal professor Yoshua Bengio. And the others, like Twitter, have grabbed various researchers who studied under those Big Three.

Schmidhuber and his colleagues represent another talent pool. In fact, they may be looking for a place inside one of the giants of the net, which can provide not only the money that can fuel more advanced research in this field, but also the enormous amounts of digital data needed to drive deep learning services. "The trend is: researchers going towards industry," says Adam Gibson, the co-founder of a deep learning startup called Skymind. "These guys want to see their research applied."

Machines With Memory

Deep learning is an umbrella term used to describe the use of particularly complex neural networks---networks of machines that mimic the web of neurons in the human brain. Basically, if you feed these systems large amounts of data, they can "learn" to perform certain tasks. If you feed them cat photos, for instance, they can learn to identify a cat.

Using "convolutional neural nets," Facebook can now recognize faces in photos posted to its social network. Google uses "convnets" to recognize commands you speak into your Android phone. At Baidu, they help drive a kind of visual search engine.