Researchers Use Video Game to Crack the 'Language Code'

May 18, 2011 -

Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda are using video game training with a mock "alien" language to replicate the challenges of learning languages as an infant. The research found that listeners were to quick recognize word-like units. The study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond.

To uncover how spoken sounds are decoded by the brain, the research team designed a video game narrated in deliberately distorted speech. The soundtrack (unintelligible babble in any language) was the only source of instruction for the 77 adult players in the study. After only two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that using video games is a promising new way to explore language learning.

"This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

The research has the potential to help researchers better understand and effectively treat a number of conditions including dyslexia and improving second language learning.

Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English.

"Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said

Holt, director of CMU's Speech Perception and Learning Laboratory, is interested in taking the study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid learning. The next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view real-time brain reactions to the video game.

Researchers will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

For more information on research at Carnegie Mellon, visit www.cmu.edu/research/brain.


Comments

Re: Researchers Use Video Game to Crack the 'Language Code'

I love this stuff.  I majored in CS and minored in linguistics; Watson's performance on Jeopardy was one of the most fascinating things I've ever seen.

Re: Researchers Use Video Game to Crack the 'Language Code'

That is just too cool 

Re: Researchers Use Video Game to Crack the 'Language Code'

This is really cool. Like really cool. I want to try doing that, play an unfamiliar game in an unfamiliar language, too bad imports won't work on my consoles.

-Austin from Oregon

Feel free to check out my blog.

 
Forgot your password?
Username :
Password :

Shout box

You're not permitted to post shouts.
Mattsworknamehttps://www.youtube.com/watch?v=OVLIgsf6qcs Jason comes to MKX, And you know what, yeah, he is right at home!05/04/2015 - 11:35pm
Mattsworknameequally importat reaons . I find it strange that worf says something i agree with so much, yet i know people who woudl fight bloodily about it. Kinda silly05/04/2015 - 10:56pm
MattsworknameI mysef love both of them, Im a huge fan of wars and trek, and It was a big part of my childhood for different, but e05/04/2015 - 10:55pm
MechaTama31I really liked the first reboot Trek. Of course, I have generally liked other Abrams movies. The newer Trek movie had its moments, but wasn't as good, imho.05/04/2015 - 10:43pm
Craig R.Wife is a huge Wars fan, doesn't think much of Abrams either. So, we've found some common ground...05/04/2015 - 10:39pm
Craig R.I'm more of a Trek than Wars fan, but haven't watched either reboot film, don't care for Abrams05/04/2015 - 10:38pm
MechaTama31RE: Trek vs. Wars, I've always liked both, and although I often hear it said that the fanbases are at odds, I have never seen a shred of that in real life. Online, sure, but the internet amplifies that kind of thing, we all know that.05/04/2015 - 10:23pm
MechaTama31Because GG "tainted" those other opinions, and you couldn't express them without also implying support for all the other crap the jerk faces did.05/04/2015 - 10:19pm
MechaTama31Any GG-related discussion I got involved in, if someone expressed anything even tangentially supportive of anything GG supported, that person was guilty by association of everything GG did (whether they mentioned GG or not).05/04/2015 - 10:18pm
MechaTama31"There's no need for anyone who's not a jerk face to admit to vile actions they didn't commit." That's a nice thought, AE, but that's certainly not how it goes down, even here.05/04/2015 - 10:17pm
Goth_SkunkI for one do agree with him. I always have, as a fan of both franchises. Hopefully with J.J. Abrams doing both the Star Wars AND the Star Trek films, that'll help mend this silly rift between fanbases.05/04/2015 - 9:50pm
MattsworknameWell said MR worf, well said, but I doubt the treks and the star wars fans agree05/04/2015 - 9:44pm
PHX CorpMichael Dorn tells Star Trek and Star Wars fans that both fanbases are all part of the same Scifi family https://twitter.com/akaWorf/status/59528225364038860805/04/2015 - 9:29pm
MattsworknameAmen andrew, Amen05/04/2015 - 8:51pm
Andrew Eisenand we can all hopefully march towards a brighter future without them. Or, ideally, they act like decent human being and tag along.05/04/2015 - 8:40pm
Andrew EisenWhatever term we use, we end up creating an us vs them scenario and that's not conducive to what any of us want to achieve. Simply call out the jerk faces, no matter where you find them or what hashtags they do or do not use, condemn the behavior...05/04/2015 - 8:39pm
Mattsworknamesee a wider variety of roles for females in games as a whole, and I would love to see more games that are headed by a feamle lead succedding Hell, some of my faves have always had females. I would love to see more05/04/2015 - 8:32pm
MattsworknameI thnk that using groups is the wrong term andrew like you said, but, whats the better term, sides or movments? anyway, I actually agree with some things that anita and others have said, i would love more well writter females in games, I would love to05/04/2015 - 8:30pm
MattsworknameTwitter has beccome a virtual garbage dump over the last few years, I dont blame people from filtering twitter the way it is now05/04/2015 - 8:21pm
MattsworknameYou make a good point, i keep thinking of these as groups but there more movments then groups, I guess.05/04/2015 - 8:20pm
 

Be Heard - Contact Your Politician