Researchers Use Video Game to Crack the 'Language Code'

May 18, 2011 -

Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda are using video game training with a mock "alien" language to replicate the challenges of learning languages as an infant. The research found that listeners were to quick recognize word-like units. The study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond.

To uncover how spoken sounds are decoded by the brain, the research team designed a video game narrated in deliberately distorted speech. The soundtrack (unintelligible babble in any language) was the only source of instruction for the 77 adult players in the study. After only two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that using video games is a promising new way to explore language learning.

"This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

The research has the potential to help researchers better understand and effectively treat a number of conditions including dyslexia and improving second language learning.

Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English.

"Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said

Holt, director of CMU's Speech Perception and Learning Laboratory, is interested in taking the study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid learning. The next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view real-time brain reactions to the video game.

Researchers will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

For more information on research at Carnegie Mellon, visit www.cmu.edu/research/brain.


Comments

Re: Researchers Use Video Game to Crack the 'Language Code'

I love this stuff.  I majored in CS and minored in linguistics; Watson's performance on Jeopardy was one of the most fascinating things I've ever seen.

Re: Researchers Use Video Game to Crack the 'Language Code'

That is just too cool 

Re: Researchers Use Video Game to Crack the 'Language Code'

This is really cool. Like really cool. I want to try doing that, play an unfamiliar game in an unfamiliar language, too bad imports won't work on my consoles.

-Austin from Oregon

Feel free to check out my blog.

 
Forgot your password?
Username :
Password :

Poll

Will the FCC preempt state laws that limit municipal broadband services?:

Shout box

You're not permitted to post shouts.
Zenemulator...it's not just a slap job that makes "some" work..they do it for each which is why they work so well. I would rather have the quality over just a slap job.07/30/2014 - 5:48pm
ZenMatthew there is a difference between "worked" and "accurate". You play the Nintendo VC titles they play as damn close to the original as possible. The PSP would just run them as best they could, issues and all. And Masked...EACH VC title has their own07/30/2014 - 5:48pm
MaskedPixelanteOnce again, the 3DS already HAS a GBA emulator, it just can't run at the same time as the 3DS OS.07/30/2014 - 4:54pm
Matthew Wilsonyou cant street pass in ds mode ether, and if moders can make a gba emulator that runs very well on the psp as I understand it. you are telling me that Nintendo devs are not as good as moders?07/30/2014 - 4:49pm
Zenperformance. Halo 1 and 2 worked great because they actually did custom work on each of them...just like Nintendo does now lol07/30/2014 - 4:08pm
Zenexisting hardware while the GBA has to be emulated completely. Same reason the 360 couldn't run most Original Xbox games correctly, or had issues because they just did "blanket approach" for their emulation which led to game killing bugs or horrible07/30/2014 - 4:07pm
ZenSora/Matthew: It's not just Miiverse, but the whole idea of streetpass and things like that would be affected if the OS is not running. And just because a 3DS game can be downloaded and run does not mean that GBA can as easily. Those 3DS games use the07/30/2014 - 4:06pm
E. Zachary KnightSleaker, How is that different from every other credit card company targeting high school and college students?07/30/2014 - 1:40pm
Sleaker@EZK - I think some people are concerned beacuse it's a predatory technique targetted toward younger people that don't understand on top of offering the worst interest rates of any retailer around.07/30/2014 - 11:33am
MaskedPixelantehttp://www.joystiq.com/2014/07/30/europe-gets-long-detained-shin-megami-tensei-4-at-cut-price/ "Sorry you had to wait a year for SMT4, would a price cut make it sting less?"07/30/2014 - 10:29am
NeenekoI would hope not. Though it is not unheard of for store specific cards to be pretty good.07/30/2014 - 8:17am
E. Zachary KnightDoes anyone, or at least any intelligent person, expect a retail branded credit card to be anything close to resembling a "good deal" on interest rates?07/30/2014 - 7:13am
SleakerGamestop articles popping up everywhere about their ludicrous new Credit card offerings at a whopping pre-approval for 26.9% APR07/29/2014 - 10:19pm
Matthew Wilsonhttp://arstechnica.com/tech-policy/2014/07/podcasting-patent-troll-we-tried-to-drop-lawsuit-against-adam-carolla/ the podcasting patent troll scum is trying to turn tail and run.07/29/2014 - 9:50pm
MaskedPixelanteOf course it's improved. At launch, Origin was scanning your entire hard drive, but now it's just scanning your browsing history. If that's not an improvement, I dunno what is!07/29/2014 - 8:59pm
Papa Midnighthttp://www.escapistmagazine.com/articles/view/video-games/columns/experienced-points/12029-Has-EAs-Origin-Service-Improved-Any-Over-the-Last-Two-Years07/29/2014 - 8:25pm
Sora-ChanSo it's just a matter of having better emulation software. If it can be done with a 3DS game, with all the memory and what not it takes up, it can be done with a GBA title through emulation.07/29/2014 - 7:30pm
Sora-ChanOther VC titles for the NES and Gameboy had the same setup where you couldn't access the homescreen without quitting out of the game til a later update when those games were released for the public outside of the founder program.07/29/2014 - 7:28pm
Sora-Chanthe 3DS can, and does, run GBA games, as seen by the founder gifts, which included a number of GBA titles. As for running GBA games and still having access to the home screen, I beleive it's more of the game emulation software needs to be updated.07/29/2014 - 7:27pm
Matthew Wilsonthe 3ds already swaps os's with the original ds. plus I dont think people expect miverse interaction when playing a gba game.07/29/2014 - 6:06pm
 

Be Heard - Contact Your Politician