Researchers Use Video Game to Crack the 'Language Code'

May 18, 2011 -

Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda are using video game training with a mock "alien" language to replicate the challenges of learning languages as an infant. The research found that listeners were to quick recognize word-like units. The study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond.

To uncover how spoken sounds are decoded by the brain, the research team designed a video game narrated in deliberately distorted speech. The soundtrack (unintelligible babble in any language) was the only source of instruction for the 77 adult players in the study. After only two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that using video games is a promising new way to explore language learning.

"This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

The research has the potential to help researchers better understand and effectively treat a number of conditions including dyslexia and improving second language learning.

Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English.

"Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said

Holt, director of CMU's Speech Perception and Learning Laboratory, is interested in taking the study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid learning. The next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view real-time brain reactions to the video game.

Researchers will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

For more information on research at Carnegie Mellon, visit www.cmu.edu/research/brain.


Comments

Re: Researchers Use Video Game to Crack the 'Language Code'

I love this stuff.  I majored in CS and minored in linguistics; Watson's performance on Jeopardy was one of the most fascinating things I've ever seen.

Re: Researchers Use Video Game to Crack the 'Language Code'

That is just too cool 

Re: Researchers Use Video Game to Crack the 'Language Code'

This is really cool. Like really cool. I want to try doing that, play an unfamiliar game in an unfamiliar language, too bad imports won't work on my consoles.

-Austin from Oregon

Feel free to check out my blog.

 
Forgot your password?
Username :
Password :

Shout box

You're not permitted to post shouts.
PHX CorpI'll give the hosting 2 Streams on twitch a spin during extra life marathon10/01/2014 - 12:41pm
james_fudgequiknkold:: oh yeah which games?10/01/2014 - 11:20am
Andrew EisenInfophile - Your comment is on the second page. Scroll to the bottom and click "Previous Entries."10/01/2014 - 9:55am
MaskedPixelantehttps://time.com/3450854/amc-netflix-imax-crouching-tiger-hidden-dragon-boycott/ Theatres refuse to show the new Crouching Tiger movie because... well, I'm sure they've got a good PR spin reason, pick one.10/01/2014 - 9:06am
IanCForza Horrizon 2 isn't even out yet, but theres already a 31 car DLC pack, along with a season pass....10/01/2014 - 8:42am
quiknkoldstarting my Halloween Spooktacular Stream today. Every day from 7-11, I'm going to be streaming Spooky games on Twitch.10/01/2014 - 8:37am
MaskedPixelanteSteam is going to start charging us Canadians in CAD. This is bad news... for people who don't use key sellers like GMG and GamersGate.10/01/2014 - 7:23am
InfophileSomething weird was going on with that comment. As soon as I posted it, it looked like it had replies from the past. And now I can't even find it. Ah well, it was getting off-topic for that thread anyway.10/01/2014 - 4:29am
Sleaker@CraigR been using Win8.1 for a while, I don't really see any usability difference between it and 7 (Work uses 7)10/01/2014 - 2:16am
Craig R.Ok, my internal debate was short-lived. If Win10 is still a year out, I'm not waiting that long for an SSD, so on Win7 I will remain.09/30/2014 - 7:52pm
Matthew Wilsonits called windows 10, and I am happy to get the start menu back.09/30/2014 - 7:18pm
Jessy HartIs this stuff about Windows 10 legit? Is it actually called Windows 10 or is it just some stupid joke?09/30/2014 - 6:57pm
ZippyDSMleeSo I been trying to play Bioshock Infinite I got all the DLC,ect but do not want the extras to make your charatcer over powered from the start.....they force you to take them which is quite annoying......09/30/2014 - 6:45pm
Craig R.I need to upgrade to an SSD, still seriously debating moving to Win8.1 from 7 at the same time09/30/2014 - 6:07pm
Craig R.Win10 is probably Win8.1 with more cleanup and the Start button back.09/30/2014 - 6:06pm
Sora-ChanAhh, it's just weird seeing someone's post all of a sudden have replies from days prior before it was posted due to that.09/30/2014 - 5:49pm
MechaTama31sora: I broke the ordering intentionally, as AE's and my conversation had squeezed the text boxes down to be quite slim. I replied to an earlier post of his instead of the one I was actually replying to.09/30/2014 - 5:46pm
MechaTama31So, 9 would have been the good one, but they are skipping it to do two crap ones in a row?09/30/2014 - 5:41pm
Sora-ChanSo, judging from the poll post for #gamergate, it looks like too many thread replies breaks the ordering of posts, as seen with the recent post from Infophile.09/30/2014 - 5:31pm
Andrew EisenOr no! It wasn't Y3K compliant. Microsoft thought it best to super future proof its OS and skipped straight to 10 which is Y3K compliant!09/30/2014 - 5:01pm
 

Be Heard - Contact Your Politician