With the buzzword 鈥渄ata-driven鈥� gaining traction as a hot topic within many disciplines today, researchers and students flocked to the Serre Lab鈥檚 workshop on deep learning and the field鈥檚 myriad applications last Saturday.
Deep learning is a set of algorithms that analyzes a large amount of data to improve specific processes under study. The workshop, 鈥淏eyond Deep Learning,鈥� is part of a lecture series that aims to bring together cognitive science and computer science to present new ways for approaching artificial intelligence and its plethora of applications.
Tom Griffiths, professor of psychology and cognitive science at Princeton, Dima Amso, associate professor of cognitive, linguistic and psychological sciences听 and David Heeger, professor of psychology and neural sciences at New York University, spoke Friday afternoon about recent advancements in mapping biological human intelligence to create computational models for artificial intelligence.
Heeger focuses on a few different fields: working memory from cognitive psychology, computer science algorithms and their听 overall connection to neurobiology.
鈥淲orking memory is a cognitive process that is responsible for both maintaining and manipulating information over time,鈥� Heeger said. Working memory requires combining information encountered in the present with past memory and experiences, he added.
On the other hand, computers do not have an unlimited amount of memory to store information, Heeger said. 鈥淭he concept is that you have a state that you update over time, and you carry forward some information and throw away some information and transform some information,鈥� he added. This constraint makes it difficult for researchers to model working memory, since working memory necessitates access to past experiences that computers may have overwritten.
In contrast to working memory, 鈥減sychologists use the term 鈥榮hort-term鈥� memory just to refer to maintenance of information over time鈥� but not the manipulation of such information, Heeger said.
In recent years, researchers have begun to use an algorithm called a Long-Short Term Memory network to manipulate information. Such manipulation more closely resembles the processes involved in working memory as opposed to short-term memory.
LSTMs are 鈥渟imple algorithms that can solve seemingly complicated tasks,鈥� Heeger said. Such tasks can include language modeling and eye movement tracking.
Essentially, eye movement requires that the brain manipulate information on a coordinate basis 鈥� a process that researchers now track with LSTM algorithms, Heeger said. 鈥淲orking memory and other kinds of executive function such as attention may depend on the same computational engine as motor preparation, motor control and sensory processing,鈥� he added.
Griffiths took the podium to discuss using computer science to create predictions about human behavior. Researchers hope to explain how we interpret information in the world from natural stimuli that are faced everyday and not just simplistic stimuli, he added.
Griffiths uses computer science to study an individual鈥檚 psychological visualization of an image rather than the activity of neurons.
The issue is that these representations 鈥渁re not really things you can see or touch. We have to rely on behavior to tell us about what some of those underlying representations might be,鈥� Griffiths said. While machine learning sheds light on behavior prediction, it raises the challenge of explaining that behavior, he added.
鈥淚n reality, there are a lot of complex stimuli that humans face, so it鈥檚 important for computers to be able to analyze this vast amount of information and model how humans classify their information in order to interpret it,鈥�
Griffiths said. Researchers can then model the behavior and decisions that people make and 鈥減redict peoples鈥� classification behavior very well,鈥� he added.
This empirical treatment of psychology is unusual because the subject is normally studied with theoretical models, Griffiths said. Now, researchers can look at inputs and data facilitated by computational methods in order to make predictions about behavior, he added.
鈥淲e sort of passed the threshold where hand-engineered models had more bias (than the deep learning models),鈥� Griffiths said.
While Griffiths鈥� work uses computational methods to understand human behavior, Amso鈥檚 research is focused on how we can use human behavior, especially in the case of infants, to inform computer science.
There is a high amount of complexity in human-infant interactions, not only in the baby鈥檚 actions, but also in the data the baby is receiving, Amso said. Information enters the system through the senses first and then enters the brain, she added. 鈥淭his gives me a framework (from which) to ask my questions so that I don鈥檛 ask my questions in a way that is inconsistent with the biology of the system,鈥� she said.
Researchers must take into account how the visual system is developed. To address this, researchers use eye trackers to monitor where a baby is looking in order to see if the baby is observing the whole image and actually understanding what is happening, she said.
But 鈥渢he data depend on the state of the visual system 鈥� and the full visual field is not sufficient鈥� to determine what the baby is actually understanding and viewing in the world. Tactile information is necessary for babies to actually get an idea of the 3-D shape of objects and the world around them.
鈥淚 think (this series) does a good job bringing together the psychology department at Brown, which has a strong computational history, and the strong computer science department,鈥� Harrison Ritz GS said.
鈥淚 always think it is pretty cool to see the intersection of neuroscience and computer science, as someone who works in machine learning,鈥� Dan Shiebler 鈥�15 said.
