Neurons subtract images and use the differences

Efficient reduction of data volumes

Researchers have hitherto assumed that information supplied by the sense of sight was transmitted almost in its entirety from its entry point to higher brain areas, across which visual sensation is generated. “It was therefore a surprise to discover that the data volumes are considerably reduced as early as in the primary visual cortex, the bottleneck leading to the cerebrum,” says PD Dr Dirk Jancke from the Institute for Neural Computation at the Ruhr-Universität. “We intuitively assume that our visual system generates a continuous stream of images, just like a video camera. However, we have now demonstrated that the visual cortex suppresses redundant information and saves energy by frequently forwarding image differences.”

Plus or minus: the brain’s two coding strategies

The researchers recorded the neurons’ responses to natural image sequences, for example vegetation landscapes or buildings. They created two versions of the images: a complete one and one in which they had systematically removed certain elements, specifically vertical or horizontal contours. If the time elapsing between the individual images was short, i.e. 30 milliseconds, the neurons represented complete image information. That changed when the time elapsing in the sequences was longer than 100 milliseconds. Now, the neurons represented only those elements that were new or missing, namely image differences. “When we analyse a scene, the eyes perform very fast miniature movements in order to register the fine details,” explains Nora Nortmann, postgraduate student at the Institute of Cognitive Science at the University of Osnabrück and the RUB work group Optical Imaging. The information regarding those details are forwarded completely and immediately by the primary visual cortex. “If, on the other hand, the time elapsing between the gaze changes is longer, the cortex codes only those aspects in the images that have changed,” continues Nora Nortmann. Thus, certain image sections stand out and interesting spots are easier to detect, as the researchers speculate.

“Our brain is permanently looking into the future”

This study illustrates how activities of visual neurons are influenced by past events. “The neurons build up a short-term memory that incorporates constant input,” explains Dirk Jancke. However, if something changes abruptly in the perceived image, the brain generates a kind of error message on the basis of the past images. Those signals do not reflect the current input, but the way the current input deviates from the expectations. Researchers have hitherto postulated that this so-called predictive coding only takes place in higher brain areas. “We demonstrated that the principle applies for earlier phases of cortical processing, too,” concludes Jancke. “Our brain is permanently looking into the future and comparing current input with the expectations that arose based on past situations.”

Observing brain activities in millisecond range

In order to monitor the dynamics of neuronal activities in the brain in the millisecond range, the scientists used voltage-dependent dyes. Those substances fluoresce when neurons receive electrical impulses and become active. Thanks to a high-resolution camera system and the subsequent computer-aided analysis, the neuronal activity can be measured across a surface of several square millimetres. The result is a temporally and spatially precise film of transmission processes within neuronal networks.

Bibliographic record

N. Nortmann, S. Rekauzke, S. Onat, P. König, D. Jancke (2013): Primary visual cortex represents the difference between past and present, Cerebral Cortex

Peering into living cells — without dye nor fluophore

In the world of microscopy, this advance is almost comparable to the leap from photography to live television. Two young EPFL researchers, Yann Cotte and Fatih Toy, have designed a device that combines holographic microscopy and computational image processing to observe living biological tissues at the nanoscale. Their research is being done under the supervision of Christian Depeursinge, head of the Microvision and Microdiagnostics Group in EPFL’s School of Engineering.

Using their setup, three-dimensional images of living cells can be obtained in just a few minutes – instantaneous operation is still in the works – at an incredibly precise resolution of less than 100 nanometers, 1000 times smaller than the diameter of a human hair. And because they’re able to do this without using contrast dyes or fluorescents, the experimental results don’t run the risk of being distorted by the presence of foreign substances.

Being able to capture a living cell from every angle like this lays the groundwork for a whole new field of investigation. “We can observe in real time the reaction of a cell that is subjected to any kind of stimulus,” explains Cotte. “This opens up all kinds of new opportunities, such as studying the effects of pharmaceutical substances at the scale of the individual cell, for example.”

Watching a neuron grow

This month in Nature Photonics the researchers demonstrate the potential of their method by developing, image by image, the film of a growing neuron and the birth of a synapse, caught over the course of an hour at a rate of one image per minute. This work, which was carried out in collaboration with the Neuroenergetics and cellular dynamics laboratory in EPFL’s Brain Mind Institute, directed by Pierre Magistretti, earned them an editorial in the prestigious journal. “Because we used a low-intensity laser, the influence of the light or heat on the cell is minimal,” continues Cotte. “Our technique thus allows us to observe a cell while still keeping it alive for a long period of time.”

As the laser scans the sample, numerous images extracted by holography are captured by a digital camera, assembled by a computer and “deconvoluted” in order to eliminate noise. To develop their algorithm, the young scientists designed and built a “calibration” system in the school’s clean rooms (CMI) using a thin layer of aluminum that they pierced with 70nm-diameter “nanoholes” spaced 70nm apart.

Finally, the assembled three-dimensional image of the cell, that looks as focused as a drawing in an encyclopedia, can be virtually “sliced” to expose its internal elements, such as the nucleus, genetic material and organelles.

Toy and Cotte, who have already obtained an EPFL Innogrant, have no intention of calling a halt to their research after such a promising beginning. In a company that’s in the process of being created and in collaboration with the startup Lyncée SA, they hope to develop a system that could deliver these kinds of observations in vivo, without the need for removing tissue, using portable devices. In parallel, they will continue to design laboratory material based on these principles. Even before its official launch, the start-up they’re creating has plenty of work to do - and plenty of ambition, as well.