Post: AI Helps Explain What the Brain Finds Memorable

Source: RosZie/Pixabay Why does the brain remember some images and not others? One of the fundamental questions of neuroscience is how perception impacts what we remember. Yale University researchers have published a new peer-reviewed neuroscience study in Nature Human Behaviour that uses artificial intelligence (AI) and behavioral science to help explain why some images make a lasting impact while others are filtered out by the brain.

The Yale researchers created a computational model to mimic in silico the memory -forming steps of the compression and reconstruction of visual signals. According to the scientists, their study illustrates the usefulness of model-driven psychophysics, the branch of psychology that studies the relationship between physical processes such as stimuli on the mental process of an organism.

“Much of what we remember is not because of intentional selection, but simply a by-product of perceiving,” wrote senior authors Ilker Yildirim, an Assistant Professor of Psychology and Lab Director at the Cognitive & Neural Computation Laboratory, and John Lafferty, an Associate Director of the Wu Tsai Institute, Director of the Center for Neurocomputation and Machine Intelligence , and John C. Malone Professor of Statistics and Data Science, along with co-first authors former Yale graduate students Qi Lin and Zifan Li. “This raises a foundational question about the architecture of the mind: How does perception interface with and influence memory?”

The Yale researchers created a sparse coding model (SPC) that was trained to reconstruct the activations in a given layer of an AI deep convolutional neural network (DCNN) trained for image classification. Sparse coding is an AI machine learning method that is often used for brain imaging, sound processing, image processing, and natural language processing. Sparse coding enables an efficient, more compact representation of complex data. For this study, the sparse coding model consists of an input layer, an intermediate layer for recoding the inputs, and a reconstruction layer for reproducing the input. Their sparse coding model was trained to reconstruct the AI deep convolutional neural network activations conjured by over 10,200 images of nature scenes with the goal of minimizing reconstruction errors. The reconstruction error was a predictor of […]

AI Helps Explain What the Brain Finds Memorable