Should Critics Ditch The 10-Point Review Scale?
For decades now, the standard review scale for video games has gone up to 10. And maybe it's so ingrained now that it's impossible to change the norm.
But there are plenty of reasons to change. Firstly, we're really not utilizing the full 10-point scale; at least, not in the mathematical sense. Regardless of the policies of critics and sources, gamers will quickly harp on any game that scores below an 8. The way we have it now, a 7 is considered "average" while a 5 is just plain horrendous. Obviously, that's skewed.
Secondly, if we're breaking the review down into tenths of a point, do we really need 100 little points to fiddle with? What's the difference between an 8.2 and an 8.3, really? Or the flip side, a 3.6 and a 3.7? Some sources have eliminated the tenths and settled on a .5 differential, which makes a little more sense. It's just that the standard setup seems over-complicated and indeed, unnecessary. Are video games really that complicated?
Thirdly, maybe it'll help games push a little further into the mainstream. There's a 4-star rating for movies, for instance, and four and five-point rating scales are pretty common in the entertainment medium. Therefore, by shifting to a 5-point scale for games, it might just become a more accepted score...as silly as that may sound. It also might help us critics; I know gamers would see a 6 as a terrible score, and I have to consider that. Plus, deciding between a few tenths is getting ridiculous.
Perhaps it's time we left this old-fashioned system behind.
10/7/2011 Ben Dutka
Put this on your webpage or blog:
Email this to a friend
Follow PSX Extreme on Twitter
Comments (54 posts)
Ben Dutka PSXE [Administrator]
Friday, October 07, 2011 @ 9:51:52 PM
Besides, it really is a disservice to consumers, I think. Looking at an average review score gives you a good idea of what to expect in terms of quality and it's just a million times faster than reading twenty reviews.
johnld
Saturday, October 08, 2011 @ 1:10:51 AM
Beamboom
Saturday, October 08, 2011 @ 2:29:11 AM
Dancemachine55
Saturday, October 08, 2011 @ 2:58:42 AM
If X-Play give a game 3 stars, I will still get it if it's the type of game I like, or at least hire it or check it out and return it within a week to EB Games.
However, if a game gets below 7 out of 10, I immediately think it's not even worth checking out even though it technically scored higher than X-Play's review system. This is mostly on Metacritic though, where I usually go for an idea of what's good and what isn't.
WorldEndsWithMe
Friday, October 07, 2011 @ 9:29:51 PM
Reply
The 10 point system has the room to be more precise but like you say Ben it isn't really being used right and I think it more or less has created an atmosphere of competition between critics for fans to agree or be upset at them as for anything else.
Lawless SXE
Friday, October 07, 2011 @ 11:06:22 PM
Temjin001
Saturday, October 08, 2011 @ 12:18:20 AM
It goes something like this,
#1: Doesn't Suck ever
#2: Sometimes Sucky but usually not
#-3:Sucks (yes, this game gets a negative score)
AcHiLLiA
Saturday, October 08, 2011 @ 10:48:59 AM
AcHiLLiA
Saturday, October 08, 2011 @ 11:04:03 AM
LegendaryWolfeh
Friday, October 07, 2011 @ 9:35:07 PM
Reply
LimitedVertigo
Friday, October 07, 2011 @ 9:35:16 PM
Reply
NoSmokingBandit
Friday, October 07, 2011 @ 9:43:52 PM
Reply
GuernicaReborn
Friday, October 07, 2011 @ 10:27:40 PM
Reply
I should explain myself: In my opinion, as the rating system stands right now, the scale is too big. If your not sure about something, say the soundtrack didn't really appeal to you, but you think it might resonate with most other gamers, you could just rate it a 7.5 or 7.8... both good scores, not great, and nothing that anybody would debate if the sound was good, but not great.
Now, say we have a 4 star scale instead of the old 10 point scale, and you are unsure if you should rate the sound a 2 or a 3, because the sound was good, but not great. You will put a little more thought into it, because the difference between 2 stars and 3 is a pretty big difference, at least compared to .3 points.
I guess what I am trying to say is that I don't think a 10 point scale is doing gaming journalists, games, or gamers enough justice. There is too much leeway in a 10 point system to hide something in mediocrity.
Take the new X-men game, for example. The score Ben gave it, IIRC, was a 4, which is 40% of 10. If we translate that to the star rating, then mathematically speaking it would have gotten 2 stars, since 2 stars is equal to between 25% and 50%.
Now, lets say that Ben had to rate the game on a scale of 4 stars instead of 10 points. I have a feeling that same X-Men game would have gotten one star if he were using the 4 star rating system. The four star system would have forced Ben to ask whether this game had enough redeeming qualities to give it two stars, or if it really was so bad as to only deserve one star. And based on the content of the review, it really sounds like it was that bad.
Last edited by GuernicaReborn on 10/7/2011 10:29:00 PM
Warrior Poet
Friday, October 07, 2011 @ 10:41:34 PM
Reply
Lawless SXE
Friday, October 07, 2011 @ 11:16:13 PM
WorldEndsWithMe
Friday, October 07, 2011 @ 10:51:16 PM
Reply
Ben Dutka PSXE [Administrator]
Friday, October 07, 2011 @ 10:52:00 PM
Reply
Lawless SXE
Friday, October 07, 2011 @ 11:17:47 PM
StubbornScorpio
Saturday, October 08, 2011 @ 1:13:38 AM
johnld
Saturday, October 08, 2011 @ 1:16:14 AM
Beamboom
Saturday, October 08, 2011 @ 2:41:38 AM
But in my head I convert all ratings to a 100 score anyway (I was raised reading gaming magazines with a 100 point rating, and today I am a metarating addict :).
So when you rate a game "8.2" I think "oh so it got a 82%, that's pretty darn good!".
Same would happen with a 5 point scale: "A 4.5? Dang that's a 90%! Gotta read that review!"
Last edited by Beamboom on 10/8/2011 2:42:06 AM
GuernicaReborn
Saturday, October 08, 2011 @ 10:10:18 AM
jjlive168
Sunday, October 09, 2011 @ 3:47:23 PM
Lawless SXE
Friday, October 07, 2011 @ 11:04:09 PM
Reply
As I see it there are two real issues:
The first is that there are such a huge range of games that to try to force them all into the same categorical offerings is a bit like trying to fit a square peg into a round hole. It can be done, but it doesn't feel right to compare Guitar Hero to FIFA to Uncharted. Yet they've all scored in the 90% range at some point. They're simply not created equal. As the first is, basically, for parties, the second is an attempted representation of reality, and the third is a full blown game. Surely there is something wrong with trying to judge the three by the same scale. But then, they also have similarities, and there is no way to judge them separately without creating a megaton of work for oneself... It's confusing and frustrating.
The second issue is that the elements of games are growing and evolving. Technological improvements happen on a day-to-day basis, which means that games that are deserving of a 10/10 score very likely won't be in only a couple of years as they become dated, their graphics lose their impressiveness in the face of more detailed presentations, etc., etc.
It's because of this that I am an advocate of reading what reviews have to say. It allows for a more complete picture to be had. But more than this, I feel that too much importance is placed upon the technological elements of the game, rather than the reviewers personal sentiment. On some level, I feel that it should be taking into greater consideration the creative merit of a title and the subjective experience. I mean, quality will always shine through and should always play a large part of the review. Another thing is that there should be a greater lambasting of the flaws of highly rated games, so as to bring them down a few notches, and I know that that sounds unfair, but the amount of reviews that I've read attacking the writing of GeoW3, then going on to rate it top marks simply screams of hypocrisy. Narrative in games is growing, so when this element is poorly done, why is it glossed over? This is a debate that I rail against myself with as it truly is something to wonder about....
StubbornScorpio
Saturday, October 08, 2011 @ 1:23:49 AM
Last edited by StubbornScorpio on 10/8/2011 1:26:12 AM
Beamboom
Saturday, October 08, 2011 @ 9:37:13 AM
StubbornScorpio
Saturday, October 08, 2011 @ 11:06:19 AM
What I'm trying to get at is there is only a 2 point difference between a 6 and an 8, yet anything lower than 7 is skewed to be "awful." That's just wrong.
Temjin001
Friday, October 07, 2011 @ 11:09:33 PM
Reply
On a related note. A recent example is Forza 4. The gamespot reviewer said some utterly retarded crap during the intro of his review that never needed to be said. Calling out how familiar Forza 4 is to past Forza's and how it could have been called Forza 3.5. But then he goes on to say that as a person plays they'll discover new layers of added content that makes for a worthy sequel(or some crap like that).... ummm. okay, so why waste time talking about Forza 3.5 when it actually isn't just Forza 3.5? Is that 8.5 score reflecting the familiarity of the genre? That, for some lame reason, the reviewer believes FOrza 4 should have guns and war zones to plow through. To connect this point, if Forza 4 was given a 4.0-4.5 that lame assertion about how the game doesn't feel all that changed wouldn't have seemed so bad in my eyes.
Anyway, sorry to use Forza as an example. The same kind of arguments were leveled against GT5. Arguments that have no business being weighted against the score as a determent. I'd rather just have a simple point system, and let each player own their own preferences and eccentric complains to themselves as to why one game is fractions better or worse than another.
johnld
Saturday, October 08, 2011 @ 1:07:52 AM
Reply
Excelsior1
Saturday, October 08, 2011 @ 9:06:52 AM
i would argue the premium/non premium split generated far more reviewer negativity than the simulation aspects. sites like ign and gamespot loved the past gt games and scored them higher. why assume the simulation aspects were the problem this time around? i think that it is a reach to make that argument. i think if you remove the premium/non premium split gt5 would have scored at least .5 higher or more in many reviews. gamespot's and opm's reviews open with being critical of that design choice. opm has given the two previous gt games perfect scores but gave gt5 an 8/10 so what's really going on here?
what i mean is they called the racing sublime but complained about the uneven presentation. that seemed to be a common theme in many gt5 reviews. that's just my 2 cents on the gt5 review fiasco. i would say gt5 is messy masterpiece to borrow a term i read once. i can see why the reviews were mixed this time around with this 1 particular gt game. reviewers loved the series up until this game.
AnonymousPoster
Saturday, October 08, 2011 @ 1:16:19 AM
Reply
The trouble with a 5-point system is that it's still based on the 10-point scale, especially when people start giving half-points. 3.5 = 7.
Excelsior1
Saturday, October 08, 2011 @ 2:35:00 AM
Reply
___________
Saturday, October 08, 2011 @ 2:46:08 AM
Reply
instead of say a 8.1 or a 8.2.
its either a 8, or a 8.5.
no 8.4 or 8.8.
increments of .5 are more then enough!
a 5 point scale as in 1-5 is far too low for a game.
one thing ive noticed with G4 is there suffering because of that, because every really good game is getting a 5.
so how do you separate the really good games to the OMFG this is f*cking amazing games?
a 5 point scale does not give you enough leeway to differentiate between games.
a 10 point scale of increments of .5 is what everyone should be using.
Killa Tequilla
Saturday, October 08, 2011 @ 8:52:02 AM
GuernicaReborn
Saturday, October 08, 2011 @ 10:15:58 AM
___________
Saturday, October 08, 2011 @ 10:57:05 AM
and what about those who dont have the time to spend the time reading a 2+ page review?
allot of people just want to get the bare details to get a understanding if they would like the game or not.
thats why allot of places have resorted to video reviews, because it shows lots of gameplay so the viewer can see what the game is like and can tell if they would like it or not.
GuernicaReborn
Saturday, October 08, 2011 @ 6:22:07 PM
robinhood2010
Saturday, October 08, 2011 @ 7:40:20 AM
Reply
chucknasty
Saturday, October 08, 2011 @ 2:22:34 PM
Reply
But when I think about it game reviewers get a $60 game for free (and early!) that they can keep forever and replay at will vs movie reviewers who get to see a $10 movie once for free. I can see where it would be unwise to pan a game if it meant being removed from the mailing list. This leads to the tactful negative reviews of games that are terrible (do not play this! worst game ever! score: 5.2) but it also leads to a meaningless middle ground where most games are scored so closely it does help anyone on the fence (another 8.5, hmm).
I liked Kotaku's loved/hated reviews without a score. Often a 'hated' item sounded great.
Not trying to be overly critical of critics in general or Ben in particular. It isn't easy to review things, I would be a terrible reviewer since I like games that everyone else hates (Saw) and hate games everyone else loves (any FPS - except Portal, which doesn't count).
Superman915
Saturday, October 08, 2011 @ 4:38:50 PM
Reply
SaiyanSempai
Saturday, October 08, 2011 @ 5:24:59 PM
Reply
A 5 point scale is all that is really necessary.
1 Star - the developers obviously didn't mean to release this game.
2 Stars - This game has issues that make it not very good.
3 Stars - This game is pretty enjoyable. It has issues but doesn't detract too much from the fun. Read the review to find out if it's for you or not.
4 stars - Great game! Well designed and polished experience. You should probably pick this up.
5 Stars - Absolutely fantastic! I can't come up with a single complaint for this game and consequently, I can't stop playing it. If you like this type of genre, it doesn't get better than this.
That's the only grading that is really necessary.
Crabba
Sunday, October 09, 2011 @ 8:43:21 PM
Reply
The problem is that reviewers aren't using the scale as it should, meaning 5 should be the average. Currently, a 7 or even 8 is what should be a 5, and 5 and below is hardly used at all and if used should be interpreted as more like a 3-...
A lot of it obviously has to do with money, sites are getting free review copies, and like Ben has said himself often get a lot of other goodiebags to promote the game, so obviously the publishers aren't gonna accept or be happy with their game getting a 5, so then you have to give everything a 7+, just to please them.
Lairfan
Monday, October 10, 2011 @ 6:48:00 PM
Reply
This is why I have such a big problem with the 4 star scale for movie ratings: you can't tell how "okay" a 2 or 2.5 star film at first glance. However, I can easily tell that a 6.5 game is a okay, but save your money kind of game.
ThingsOnFire
Wednesday, October 12, 2011 @ 6:56:14 PM
Reply
Once you get down to it videogame scores are relative . A four out of five stars on one site could very well be worth a 9 at another site. So having another system wouldn't really change much since the meaning of it wouldn't change.
Or!....(and I just thought of this), you could score games based on the relative-ness of it to other games, giving your games nominal scores rather than numerical ones. "Average" "Great" "Mind-Bending" "So-So". Though I suppose if you didn't make sure that average actually was average that could destroy credibility.
Last edited by ThingsOnFire on 10/12/2011 6:59:27 PM

View Large Image









Oyashiro
Reply
Friday, October 07, 2011 @ 9:28:50 PM