Poпg is played by miпibraiпs made from moυse aпd hυmaп пeυroпs.

Researchers taught a synthetic neuron network to play the retro arcade game "Pong" by integrating the brain cells into an electrode array controlled by a computer program.

Researchers used electric signals to teach brain cells to play the retro video game “Pong.”

(opens in new tab)

A synthetic minibrain made out of human and mouse neurons has successfully learned to play the video game “Pong” after researchers hooked it up to a computer-controlled electrode array. It is the first time that brain cells isolated from an organism have completed a task like this, suggesting that such learning ability is not limited to fully intact brains locked inside animals’ skulls.

In the new study, researchers grew a synthetic neuron network on top of rows of electrodes housed inside a tiny container, which they called DishBrain. A computer program sent electrical signals that activated specific regions of neurons.  These signals told the neurons to “play” the retro video game “Pong,” which involves hitting a moving dot, or “ball”, with a small line, or “paddle,” in 2D. The researcher’s computer program then channeled performance data back to the neurons via electrical signals, which informed the cells of whether they had hit or missed the ball.

The researchers found that, within just five minutes, the neurons had already started altering the way they moved the paddle to increase how often they hit the ball. This is the first time that a man-made biological neural network has been taught to independently complete a goal-oriented task, the researchers wrote in a new paper published Oct. 12 in the journal Neuron.

The new study is the first to “explicitly seek, create, test and leverage synthetic biological intelligence,” study lead author Brett Kagan, chief scientific officer at Cortical Labs, a private company in Melbourne, Australia, told Live Science. The researchers hope their work could be the springboard for a whole new area of research. 

Minibrains

The DishBrain hardware, which was developed by Cortical Labs, consists of a small circular container, around 2 inches (5 centimeters) wide, that is lined with an array containing 1,024 active electrodes that can both send and receive electrical signals. Researchers introduced a mix of human and mouse neurons on top of these electrodes. The neurons were coaxed by researchers into growing new connections and pathways until they transformed into a complex web of brain cells that completely covered the electrodes.

The mouse cells were grown in culture from tiny neurons extracted from developing embryos. The human neurons were created using pluripotent stem cells — blank cells capable of turning into any other cell type — that were derived from blood and skin cells donated by volunteers.

A scanning electron microscope image of the hybrid network of neurons on top of the electrode array.

A scanning electron microscope image of the hybrid network of neurons on top of the electrode array. 

(opens in new tab)

In total, the neural network contained around 800,000 neurons, Kagan said. For context, this is around the same number of neurons as there are in a bee’s brain, he added. Although the synthetic neural network was similar in size to the brains of small invertebrates, its simple 2D structure is much more basic than living brains and therefore has slightly reduced computing power compared to living brains, Kagan said.

Playing the game

During the experiments, researchers used a novel computer program, known as DishServer, combined with the electrodes inside DishBrain to create a “virtual game world” that the neurons could play “Pong” within, Kagan said. This may sound high-tech, but in reality, it isn’t much different from playing a video game on a TV.

Using this analogy, the electrode array can be thought of like the TV screen, with each individual electrode representing a pixel on the screen; the computer program can be thought of like the game disk that provides the code to play the game; the neuron-electrode interface within DishBrain can be thought of like the game console and controllers that facilitate the game; and the neurons can be thought of as the person playing the game.

When the computer program activates a particular electrode, that electrode generates an electrical signal that the neurons can interpret, similar to how a pixel on a screen lights up and becomes visible to a person playing a game. By activating multiple electrodes in a pattern, the program can create a shape, in this case a ball, that moves across the array or “TV screen.”

An edited microscopy image of the DishbBrain system showing the numerous connections between human and mouse brain cells.

An edited microscopy image of the DishbBrain system showing the numerous connections between human and mouse brain cells.

A separate section of the array monitors the electrical signals given off by the neurons in response to the “ball” signals. These neuron signals can then be interpreted by the computer program and used to maneuver the paddle in the virtual game world. This region of the neuron-electrode interface can be thought of as the game controller.

If the neuronal signals mirror those that move the ball then the paddle will hit the ball. But if the signals do not match up it will miss. The computer program issues a second feedback signal to the controlling neurons to tell them if they have hit the ball or not.

Teaching neurons

The secondary feedback signal can be thought of as a reward system that the computer program uses to teach the neurons to get better at hitting the ball.

Without the reward system, it would be very hard to reinforce desirable behavior, such as hitting the ball, and discourage unfavorable behavior, like missing the ball. Left to their own devices, the neurons in DishBrain would randomly move the paddle without any consideration of where the ball is because it makes no difference to the neurons if they hit the ball or not.

Brett Kagan (center) and Cortical Labs CEO Hon Weng Chong (right) next to a DishBrain system in the laboratory.

Brett Kagan (center) and Cortical Labs CEO Hon Weng Chong (right) next to a DishBrain system in the laboratory.

To get around this problem the researchers turned to a theory known as the free energy principle, “which proposes that cells at this level try to minimize the unpredictability in their environment,” study co-author Karl Friston, a theoretical neuroscientist at University College London in the U.K., said in a statement. Friston was the first researcher to put forward the idea for the free energy principle in a 2009 paper published in the journal Trends in Cognitive Science.

In a sense, “the neurons are trying to create a predictable model of the world,” Kagan told Live Science. This is where the secondary feedback signal, which tells the neurons whether they have hit or missed the ball, comes into play.

When the neurons have successfully hit the ball, the feedback signal is delivered at a similar voltage and location to the signals used by the computer to move the ball. But when the neurons have missed the ball, the feedback signal strikes at a random voltage and multiple locations. Per the free energy principle, the neurons want to minimize the amount of random signals they are receiving, so they start to change how they move the “paddle” in relation to the “ball.”

Within five minutes of receiving this feedback, the neurons were increasing how often they hit the ball. After 20 minutes, the neurons were able string together short rallies where they continually hit the ball as it bounced off the “walls” in the game. You can see how quickly the neurons progressed in this online simulation.

Related Posts

48 Beaυtifυl Iпdoor Coυrtyard Gardeп Ideas

48 Beaυtifυl Iпdoor Coυrtyard Gardeп Ideas

Iпterior coυrtyards filled with iпdoor trees aпd greeпery create a traпqυil, peacefυl atmosphere. Iпterior coυrtyards are mostly foυпd iп homes iп warmer climates, where they help create a coппectioп…

Mυmmified Child Sacrifice | Natioпal Geographic

Mυmmified Child Sacrifice | Natioпal Geographic

She looks like she’s jυst sleepiпg aпd she’s goп N/A wake υp iп the пext miпυte, aпd yoυ jυst waпt to ask her qυestioп aпd is it…

Diпosaυr-Eatiпg Gallopiпg Crocodiles Oпce Existed iп the Sahara Desert

Diпosaυr-Eatiпg Gallopiпg Crocodiles Oпce Existed iп the Sahara Desert

Believe it or пot, bυt 100 millioп years ago the area of the preseпt-day scorchiпg hot Sahara Desert was a lυsh swamp home пot jυst to diпosaυrs, bυt also to several kiпds of prehistoric crocodiliaпs.

A Fossilised Skυll Has Revealed Wheп The Last 'Siberiaп Uпicorп' Lived oп Earth

A Fossilised Skυll Has Revealed Wheп The Last ‘Siberiaп Uпicorп’ Lived oп Earth

The υпicorп first emerged пearly 2.5 millioп years ago bυt is believed to have disappeared 350,000 years ago.

Petrified Tree Trυпk iп Αrizoпa is 225 Millioп Years Old

Petrified Tree Trυпk iп Αrizoпa is 225 Millioп Years Old

Αrizoпa is oпe of those Αmericaп states we teпd to associate with dry, high wiпds aпd desert, the kiпd of laпdscape that shrivels skiп aпd makes staпdiпg iп

Father discovered a medieval Eпglish gold coiп worth $875,000 oп the first day he tried oυt his пew metal detector

Father discovered a medieval Eпglish gold coiп worth $875,000 oп the first day he tried oυt his пew metal detector

Wheп his childreп were borп, Michael Leigh-Mallory gave υp his passioп for metal detectiпg. Now, 10 aпd 13, they eпcoυraged him to take υp the hobby agaiп. Oп

Leave a Reply

Your email address will not be published. Required fields are marked *