Researchers Use Video Game to Crack the 'Language Code'

May 18, 2011 -

Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda are using video game training with a mock "alien" language to replicate the challenges of learning languages as an infant. The research found that listeners were to quick recognize word-like units. The study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond.

To uncover how spoken sounds are decoded by the brain, the research team designed a video game narrated in deliberately distorted speech. The soundtrack (unintelligible babble in any language) was the only source of instruction for the 77 adult players in the study. After only two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that using video games is a promising new way to explore language learning.

"This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

The research has the potential to help researchers better understand and effectively treat a number of conditions including dyslexia and improving second language learning.

Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English.

"Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said

Holt, director of CMU's Speech Perception and Learning Laboratory, is interested in taking the study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid learning. The next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view real-time brain reactions to the video game.

Researchers will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

For more information on research at Carnegie Mellon, visit www.cmu.edu/research/brain.


Comments

Re: Researchers Use Video Game to Crack the 'Language Code'

I love this stuff.  I majored in CS and minored in linguistics; Watson's performance on Jeopardy was one of the most fascinating things I've ever seen.

Re: Researchers Use Video Game to Crack the 'Language Code'

That is just too cool 

Re: Researchers Use Video Game to Crack the 'Language Code'

This is really cool. Like really cool. I want to try doing that, play an unfamiliar game in an unfamiliar language, too bad imports won't work on my consoles.

-Austin from Oregon

Feel free to check out my blog.

 
Forgot your password?
Username :
Password :

Poll

Should Nintendo have DMCA'd a fan's free Super Mario HD remake?:

Shout box

You're not permitted to post shouts.
E. Zachary Knighthttp://reason.com/blog/2015/04/01/this-anti-gay-pizza-place-got-trashed-on04/01/2015 - 8:17pm
E. Zachary KnightAccording to this link, the pizzeria owner did not actually refuse anyone service. He was ask by a reporter if he would cater to a gay wedding and he answered in the negative. When that was published, the rants came rolling in.04/01/2015 - 8:17pm
Papa MidnightCorrection to my prior note, DiRT 3 Complete Edition does NOT replace DiRT 3 in user's libraries. But existing owners of DiRT 3 do get it for free.04/01/2015 - 8:00pm
Matthew Wilson@AE it could be like pokemo, but the tweet and the site makes it look like 2 different games. tbf I do not know Japanese.04/01/2015 - 7:29pm
MechaCrashInteresting how YouTube comments are universally acknowledged to be cesspits of idiocy where no coherent thought can survive, until a woman closes them. Then it's CENSORSHIP and being AFRAID OF DEBATE.04/01/2015 - 7:29pm
Andrew EisenThat's... weird. The Direct made it sound like this was an organic part of a single game.04/01/2015 - 7:08pm
Matthew Wilsonapparently the 2 sides of the story in the new fire emblem game is 2 difrent games in japan, and we are getting both combined. https://twitter.com/RPGSite/status/583415770744393729/photo/104/01/2015 - 7:00pm
MonteAE: there are pizzaria's that also make italian food which you can order in bulk to cater parties. Also, google pizza wedding; cause it is pretty cool04/01/2015 - 6:50pm
ConsterThe vast majority of (if not all) 1-star reviews are angry rants about its policy. 'Jesus said to love thy neighbor, assholes' (paraphrased) seems very common.04/01/2015 - 6:49pm
Matthew WilsonI did not check it out personaly. I only read a arctlice about it, but it does seem to be in a lets just say a very mean way.04/01/2015 - 6:41pm
Andrew EisenTrashed in a fair way or are people lying about cockroach infestations and stuff?04/01/2015 - 6:24pm
Matthew Wilsonwell they also are getting trashed on yelp too. given the number of people that use it, I suspect they will lose allot of business even if they change their mind.04/01/2015 - 6:19pm
Andrew EisenIt's a pizza joint. It caters weddings? Really? I mean, that's cool. Really cool, even. But seriously?04/01/2015 - 6:02pm
Consterhttp://www.huffingtonpost.com/2015/04/01/indiana-pizza-gay-couples_n_6985208.html04/01/2015 - 5:57pm
Andrew EisenConster - Link?04/01/2015 - 5:55pm
Conster-annnd they are 'temporarily closed' after phone threats. Way to take the moral high ground against bigotry, people. -,-04/01/2015 - 5:51pm
ConsterThe first business to use SB101 to deny service to gay weddings has arisen - let's see if EZK's theory about the free market being sufficient to deal with them holds u-04/01/2015 - 5:50pm
MonteYa i remember when she first started her videos with the comment sections open. There was A LOT of vile harrassment to shift through to get to any REAL debate. Youtube is a TERRIBLE debate forum. Can't blame her for not wanting to deal with harrasment.04/01/2015 - 5:49pm
ConsterWho's this "Anitia Skeeter" person you speak of?04/01/2015 - 5:31pm
Matthew Wilsonfatal frame coming to the US04/01/2015 - 5:25pm
 

Be Heard - Contact Your Politician