Variety Game Writer Troubled by "Exclusive" Reviews (including GTA IV's)

Variety Game Writer Troubled by "Exclusive" Reviews (including GTA IV's)

April 28, 2008
Ben Fritz (left), who writes The Cut Scene blog for Variety, questions the journalistic ethics underlying exclusive game reviews.

At the center of Fritz's concern is IGN's recent perfect score for Grand Theft Auto IV. Fritz writes:
I'm not at all accusing IGN of being dishonest in this particular case... HOWEVER... what the hell is with the concept of an "exclusive review?" Is anyone else as troubled by this entire concept as I am?

...being the first outlet to review a highly anticipated new videogame is a big deal. It means a major boost in Web traffic or magazine sales. ...But how can we trust a videogame review when the outlet running it has been given a major commercial favor -- one that's worth money -- from the publisher of the game?

You never see a paper or TV station getting special access from a movie studio or TV network or book publisher to run an "exclusive review." Imagine the L.A. Times or Roger Ebert touting their "exclusive review of 'Iron Man.'" Absurd, right? So why do we tolerate it for a videogame?

Via: That Videogame Blog

UPDATE: IGN responds in an interview on Game Daily. Xbox Editor Hilary Goldstein said:
My problem with online journalism in general is that nobody does their due diligence. Nobody from Variety called us and said, "Hey, would you like to comment about this?" ...A lot of people didn't get the game early. So if Variety didn't get the game early then you're looking at somebody, I don't know, who had a grudge on his shoulder because he didn't even have the game yet and we'd already put out the review.

I just wish people would call. We had so many people writing comments about us and not a single person contacted us. Not Kotaku. Not Variety. Nobody called. They just all made assumptions. And of course we gave it a 10. But so did everyone else.

Comments

Well, if Gamespot gives the 360 version a 10, and the PS3 version an 8.5, then I'll know something is fishy.
To be frank, I never quite trusted IGN's reviews in the first place. Too wordy, and it often felt more like some PR piece than an honest critique.

There are better reviewers out there - ZeroPunctuation comes to mind.
@ GoodRobotUs Says:

It’s not really a question of being right or wrong in their reviews to be honest, it’s being objective when it is what you do for a living.


EXACTLY!

That is 100% perfect what i was trying to say :)

the whole point of this article isnt so ppl can go 'oh well GTa MAY be that good duh!'. Yes it may, but there are far too many games that receive reviews not based on teh quality of the game but based on the quality of te freebiews / ad revenue they get. Its a sad but true fact that myself (as a game dev) know only too well about.

A game should earn its review PURELY on its gameplay, not even 1% due to ad money or whatever. ITs just wrong.
If it wasn't for the fact that virtually every other review has been giving it the same score, then ign would have been in serious trouble.
I don't know why but after reading this article, I though about Kane and Lynch. A review, a favor from a game company...

But what I am sure is that GTA IV deserve this score.
Forget GTA IV man...his point in general makes sense. Does anyone here actually trust reviews...especially "exclusive first" ones? Even if most magazines and review sites are honest, the very idea is cause for concern.
[...] wrote an interesting post today onHere’s a quick excerptBen Fritz (left), who writes The Cut Scene blog for Variety, questions the journalistic ethics underlying exclusive game reviews. At the center of Fritz’s concern is IGN’s recent perfect score for Grand Theft Auto IV. Fritz writes: I’m not at all accusing IGN of being dishonest in this particular case… HOWEVER… what the hell is with the concept of an “exclusive review?” Is anyone else as troubled by this entire concept as I am? [...]
He's perfectly correct, but his conclusion misses a vital point. In IGN's case, we're talking about a website. Do gamers who check websites for score base their decision PURELY on that site? No. For God's sake someone direct this guy to metacritic.com.
@Tristam

I trust some reviews. For print magazines, it's important to get games to review early so that they can have content for their magazine. IGN, however, doesn't have that excuse.
As far as this specific case goes, I don't think there is much to worry about. In general, however, it does sound a bit suspicious.
Hmm.... unethical. I agree 100% sir. Remember the Kaine and Lynch reviews?
I can understand Exclusive screen shots, videos, demo and anything else that is similar. But Reviews, not really. Its like reading book reviews, movies reviews, music reviews, critiques and etc there opinion pieces. I dont trust majority of the sources. I do find myself trust some places more than others because I found they have similar taste.

This sounds some what similar to what the Source did with Benzino. Or FOX news not having any problems with 20 century Fox new release and so forth.
This is easy.

It's because IGN's target market is the internet where the amount of content is not limited by time and space thus putting up words like "Exclusive" just makes the story more interesting.

Then again, he forget to mention all the celeb tv shows like "Entertainment Tonight" and "Access Hollywood" who have "Exclusive" interviews with celebs and reviews of movies and events involving well known celebs.
I think I kinda agree with him.
When it comes to "exclusive first" reviews I am not really looking for the rating. I don't care if they are 10/10 or whatever. I am just looking for the information on the game so I can compare it to what I know I like. If the game is deemed, in my mind, worthy of my attention then I am going to wait for more info as the release date comes closer.

However, I do agree that, in practice, this "exclusive review" system is rotten and can (and probably has) cause problems with unfair rating.

I usualy just read the review and ignore the number in the corner.
I am beginning to wonder if this writer person complaining is not unlike the same people that complain about violent video games.
I really did not know why IGN said Exclusive Review of the game because a week earlier there was a Leaked copy of the OXM giving GTA IV the same score.
actually tv shows do get exclusive trailers promoted to run at some point during specific shows. happens all the time. you just need to watch more tv...
So I did a search on Vareity's website and they had an exclusive interview with Morgan Spurlock on March 10'th of this year.

I find it a little ironic.

Hope Fritz doesn't read his employer's website.
Damn, that is a really good point, I never thought of it. But nobody informed is going to look at one review and decide whether to buy a game or not. There are multiple review sources, too many to be bought so to average them all together would be fair.

P.S. I don't know if that was a comment or a rant but you all caught my drift.
@tallika

That is paid advertising though, not supposed neutral-source reviews of the product in question. I think that the article writer is correct... Roger Ebert doesn't get exclusive reviews of movies... why? Because it makes no sense from multiple standpoints. The whole exclusive thing just means that the video game company can "sweeten the deal" to make the review be biased a bit more favorably to them... not saying it necessarily will happen, just that it can happen, while if multiple different sources can review the item in question, then the consumer is better informed about the product. "Exclusivity" is basically another word for propaganda.
Exclusive means nothing when it comes to reviews. They weren't the first ones to get their hands on it, they just got to post it first. Their exclusive lasted only, what, a few hours?

While in general exclusive reviews may seem bad they're a moot point. Five minutes after the exclusivity period is up everybody has posted their reviews. Not to mention the fact that these "exclusive firsts" are usually only done for highly anticipated titles, which makes their reviews not all that surprising when they do come out.

In the end, they're really no different than reporters getting exclusive interviews for a story.
It's only a problem if IGN purports to have journalistic integrity. Every journalist should have the phrase, "The appearance of impropriety is itself impropriety" seared somewhere deep into their brain. Do IGN writers claim to be either journalists or legitimate critics, or are they instead solely an enthusiast site?
@Arlen

I believe they've defended themselves as legitimate critics.
Arlen is right...journalism requires something a bit more above board then "look, everyone else gave a good review too". Also, to clarify, there is a HUGE difference between exclusive interviews, previews smf promotional trailers even in something as seemingly mindless as entertainment journalism. These are meant to peak interest and to serve the public's desire for information about a production or product. A review is provided as a guidance by the reviewer for consumers whether or not this is something that may be worth their time and/or money.

It's not a moot point that someone gets an exclusive review if you realize that a few hours is enough to drive additiional traffic to the site enough to enhance its normal figures for advertising sales. In essence, these 'exclusive' official rights given to a website or magazine publication for review comes with strings attached. If a publication receives exclusive rights and then torpedoes the game...this can happen:

http://gamepolitics.com/2008/01/09/editor-upset-with-coverage-gamecos-cu...

So, I would say that IGN has been indiscreet, and it is a concern for anyone who gives a crap about standards and integrity anymore in whatever venue.
Don't forget folks, this is coming from the writer that brought the pathetic Mario Galaxy review...sponsored by Sony...

http://nsidernews.com/mario-galaxy-review-is-the-worse-experience/

What gamers take Variety reviews seriously anyways?
its a well known fact amongst game developers that most reviews are in a round about way 'paid for' (wether that be direct or promises for more advertising revenue)

a sad fact i learned when becoming a dev.. :(
I'm glad to see people finally addressing this fact. It's extremely troubling and is something every gamer should be concerned with. I remember picking up a game magazine because they had a big preview of Mass Effect. At the beginning of the article they basically said something to the effect of, well we figured what better way to let you, the reader, learn about Mass Effect than to have the developers themselves tell you. The entire article was written by someone representing the Mass Effect development team. Worse, I didn't realize how screwed up that was until about halfway through the article. I basically paid money to see one big advertisement. Not good.
@Velvet_Llama

Welcome to the internet where you can find pretty much anything for free from numerous resources.
Sounds like someone is upset that they didn't get the exclusive that they went for...so they are throwing the dirt and pointing fingers to make everyone else look bad. Exclusive first looks are common for a LOT of things...home electronics, cars, clothes, music, etc. Why are we looking at this any different honestly? I base my trust of their integrity on the people that are doing the writing. I have not seen anything in regards to what I see that leads me to believe that they are "dirty" in any way. If I do find something that troubles me, then I will change my opinion at that point. Plus, these are people's opinions on something...no matter WHAT they say, someone will be able to say it's "twisted" in one direction or the other.
EGM is well known for doing this. They had a "World exclusive" of a few reviews. Some of their content, like talking to Capcom about Street Fighter 4, is great enough to be exclusive. But I agree that calling something "exclusive" when there are near-simultaneous occurrences of the same thing is false and misleading.
I think he has a very good point. Gamespot's recent troubles come to mind. Game reviewing in general has gotten pretty developer friendly. They give exclusives to top reviewers as long as they get good scores. If they don't give good scores, then they don't get exclusives, and soon lose their "top reviewer" status.

The ratings scale seems to be from 7 to 10 rather than 0 to 10, largely because of developers driving it with ad money on review sites and giving exclusive reviews to only favorable reviewers.

Considering past performance, I would believe GTA Rockstar is capable of making a 10 game, and I would not expect GTA to drop below 80% on any scale, so this may not be the example to use. There are plenty of others out there though.
Nowhere in the IGN review does it say "exclusive". This guy is making stuff up.
@Tristram

I totally agree. It's shady. But then, so is IGN. As a reader, as soon as you hear "exclusive review" you should be thinking "not going to read it".
While I agree with the intent of the article--should we trust exclusive reviews, especially when there's obviously money involved--I disagree with the comparison to film. The film industry uses exclusives...it's just that sometimes they aren't as overt as the gaming industry. Red Carpet Premieres involving a select group of journalists, websites like Aint It Cool receiving their exclusive reviews, etc.

It's always about money and site traffic/readership. The only difference is that a lot of times the film industry doesn't use the moniker "exclusive."
I just went on ign.com, but where is the "exclusive" review. Instead, it is just like any ordinary review for the game.
Yellow journalism plagues the video game world. This is just another example.

One should be wary of any pre-release review not only due to the publishers and developers controlling who gets the reviews, but also because content changes.

Variety is just as bad with their movie reviews though. It is sad when a comedic newspaper like The Onion is actually a better source of media reviews than a movie specific source.
I think he's taking "Exclusive Review" (or anything with the "exclusion" label) little too literally. Traffic is the name of the game when it comes to websites and what better way to get that traffic then to claim something as being exclusive. While I don't necessarily agree with IGN most of the time (the GTA4 review was the first time in a long time that I've been there), I think he's jumping the gun a bit here.

Did fansites like GTAGaming, GTA Planet and others pay or give favors to gain exclusive screenshots? I would argue no.

Can someone tell me how long Variety has kept a gaming section? I'd suggest that maybe this guy is new, but I down want to put him down in such a way if he's been there a while...
Another comment I wanted to add:

To me, this whole thing is similar to seeing three movie trailers in a row that claim to be the "Best Movie of the Year" by critics. They've gotta have a hook, and the phrase "exclusive" is one of them.
Kinda screams the "Kane and Lynch" incident.
Addendum

I was just thinking about someone saying 7-10 scale. Not true, if they pay for ad space it's more like 8-10, if they don't it's more like 1-7.
Since the retail game isn't out yet, the "reviews" and "scores" that have been published so far, and will be published tomorrow, are all subject to extremely large doses of salt. Any review of a game before its official release (and any review published on release day falls into this category) should be viewed with extreme skepticism. The code the reviewers received may not (and probably doesn't) reflect the code that you, the game buying public, will receive when you plunk down your hard-earned greenbacks for the retail box. In fact, I would be shocked if the two sets of code were even remotely similar.
@ Idonyo

Companies that review games do get advanced copies. Granted a lot of the reviews these days are very slanted.
@Barly
No, they will just cut and paste the same review and score, substituting PS3 for Xbox 360 (or vice versa).
Because games these days are made for poeple with attention spans too short to care (see:oblviion)
First off, I never trust an "perfect score." That means the game is perfect, and I have yet to see one. 9.9, 99%, yeah, but not a solid 100.

Second of all, that was the major warning that the authors of "Paid to Play" mentioned in their Journalism chapter. Game companies know you'd love that trip to the Bahamas to try out the latest FPS. They know you may need a new 360 in order to review Halo 3, so they send that Special Limited Edition.

Rockstar knew that IGN would love to boost their traffic (which has been dwindling lately). Nuff Said.
As a video game journalist, I have to agree. These practices cut out us in the smaller media outlets, especially.
I don't use reviews to decide my game purchasing decision anyway.
For those who are saying it's a good thing other review sites are also giving it the same score, remember these sites where also allowed to play the game in advance so that they could release the review before the game comes out.

You think Take 2 would lock them in a hotel to play the game just for these folks to give them a bad score?

I'm still buying it at midnight.
Saw the words "Variety" and "IGN" in the article.

Then my brain went to ignore-mode.
I dont suppose anyone's considered that the 10/10 score is becuase the game is actually THAT good? I mean....just to throw the idea out there.
I never, ever read reviews to be honest, lost faith in them more and more as the sheer quantity of advertising on the sites go up, I tend to prefer reading through forums etc where people who have actually paid for the game give their opinions of whether it was worth the money.
Apparently good games don't exist anymore. Nobody has though that, gee, I dunno, that GTAIV is actually a good game?

Obviously 10+ perfect scores from big-time reviewers must mean SOMETHING
@Anon,

It's not really a question of being right or wrong in their reviews to be honest, it's being objective when it is what you do for a living.

I have every respect for games reviewers, but when you get paid to review games, and when the sites or magazines you are reviewing games for are heavily dependent upon advertising money, there is...pressure. Certainly, no game reviewer wants to rate a game higher than it deserves, and I'm not saying the game is any worse than they say, but personally, I'd rather hear the opinions of people who have absolutely nothing to lose if their opinion isn't popular.

I might even disagree with them, I've bought a few games and they've turned out to be much better than other people claimed, but at least I feel like I'm getting the whole picture. A reviewer might say that a game has a few 'annoying' buglets, whereas, in my experience, 'Game crippling' would be more of an accurate depiction, both Gothic 3 and X3 at release come to mind in that respect (though both were, in all fairness, patched moderately swiftly), so getting the whole picture is sometimes very important.
We need an Anton Ego for videogames.
after the 5th bad/mediocre "9" I have written off 90% of reviews as paid advertising.
I think we'll all be just fine if we just make a solid habit of completely dismissing the first 5 reviews that come out for any game. You can't give 'exclusivity' for game reviews. You can't do it.

Eventually other people will get their hands on it and review it regardless of what a publisher wants or thinks. Eventually the truth will come out, no matter how much a publisher is willing to pay to hide it. If you're dubious, then just wait. If you're going to be sucked in by the first review, chances are you were sucked in already.

If you have a problem with exclusive reviews, your ethics are in the right place, but your logic isnt.
I haven't seen it myself but apparently IGN gave Jade Empire a 9.9 when it was first released in 2005 for the original Xbox; IGN then gave Jade Empire a 7.5 or so score when it was released for the PC in february 2007.
Hence, I tend not to trust IGN's reviews anymore. I don't trust Gamespot's reviews as much as I used to do. Greg's Kasavin's reviews seemed to be very good & honest as did Jeff Gerstmann's. However, both of these now have left Gamespot...

These days, I tend to rely much more on my fellow gamers' reviews of the games I want to play, be it adventure, rpg, or even fps games.
@Karsten

Bad example dude, it isn't that uncommon for good games on the consoles to have crappy PC ports, The reason? controls the PC may have a shit load of more buttons but the layout of a keyboard means that it will be awkward at best and unplayable at worst, one prime example is DMC3 Special Edition the controls just didn't work on the PC. just because it has the same name doesn't make it the same game, is my philosophy when it comes to PC ports, with the possible exeption of FPS's
how can a game get a 10 that freezes so much and a nonworking multiplayer? eblaealsekrbelkrhflerrgin.
hfHxZObvnSABi

Post new comment

By posting comments on this Web site you agree to abide by the Comments Policy.
The content of this field is kept private and will not be shown publicly.
  • Web page addresses and e-mail addresses turn into links automatically.

More information about formatting options

CAPTCHA
This image is for testing whether you are a human visitor and to prevent automated spam submissions. The letters in the picture are all UPPER-CASE.
Image CAPTCHA
Copy the characters (respecting upper/lower case) from the image.

GamePolitics ShoutBox

Posted 07/24/08 at 07:39am
sortableturnip: Best...comments...ever: http://jaablog.jaablaw.com/2008/07/06/jack-needs-your-help.aspx?pg=5&view=threaded
Posted 07/24/08 at 05:42am
sortableturnip: Alteffor: I 2nd that motion. GP you should have a special section for all of JT's correspondence to you
Posted 07/23/08 at 10:13pm
GRIZZAM PRIME: Lunatic: Nope. Ever fading if I'm not mistaken.
Posted 07/23/08 at 08:05pm
LuNaTiC: is there a way to view old shouts? sorry if its a noob question.
Posted 07/23/08 at 07:07pm
gamepolitics: momma didn't raise no sock puppet
Posted 07/23/08 at 06:15pm
Rodrigo Ybáñez García: Jack is a repressed man. Don´t be surprised...
Posted 07/23/08 at 06:07pm
GryphonOsiris: So Jack admitted paying for gay porn... all I can say is wow... just wow...
Posted 07/23/08 at 05:09pm
lumi: to the case, and he's been on 60 minutes once!
Posted 07/23/08 at 05:09pm
lumi: GP, you should mention you'll be filing a legal injunction against him if he doesn't comply. Phoenix Wright will be attached
Posted 07/23/08 at 03:32pm
Alteffor: You should add a section to the site for anything Jack CC's to you. It's always entertaining to read the stuff he writes.
Posted 07/23/08 at 03:31pm
Matriculated: Does anyone know when the Supreme Court reaches their decission?
Posted 07/23/08 at 03:04pm
Freyar: I demand to see this letter! (Not that I have any grounds to demand on.)
Posted 07/23/08 at 02:53pm
gamepolitics: JT called me a "sock puppet" in an e-mail to Hal Halpin... i gave him 24 hours to retract it, LOL
Posted 07/23/08 at 02:46pm
Haggard: Might want to take a look at what Anthony Horowitz wrote about GTA IV in the Telegraph, article seems to have been taken down
Posted 07/23/08 at 01:05pm
Silencets: Beutiful. I always did wonder about Jacko Wacko
Posted 07/23/08 at 10:24am
Matriculated: So Jack (an anti-gay activist) PAYED for gay porn
Posted 07/23/08 at 10:22am
Matriculated: [i]...and purchased membership.[/i]
Posted 07/23/08 at 10:21am
Matriculated: [i] few months later, as part of his ongoing campaign against Kent, Thompson followed links to gay porn on Kent's website[/i]
Posted 07/23/08 at 07:40am
sortableturnip: Jack's at it again: http://blogs.miaminewtimes.com/riptide/2008/07/jack_thompson_faces_permanent.php
Posted 07/22/08 at 11:22pm
PHOENIXZERO: Ugh, that CNBC program "Play to Win" is it? Is on again...
Login or register to post shouts