![]() |
Average rating bug |
Post Reply ![]() |
Page 12> |
Author | ||
adg211288 ![]() Forum Admin Group ![]() ![]() Black Metal, Prog/AG Teams Joined: 05 Nov 2010 Location: United Kingdom Status: Offline Points: 22100 |
![]() ![]() ![]() ![]() ![]() Posted: 07 Apr 2011 at 8:05am |
|
I've just noticed that there seems to be a bug with the average rating for albums. I was just browsing the top albums in death metal and noticed this.
Entombed - Clandestine - 4 ratings/ 0 reviews: 2x 5* 1x 4.5* 1x 2.5* average rating = 4.87 Obscura - Omnivium - 4 ratings/ 4 reviews: 2x 5* 2x 4.5* average rating = 4.75 The average rating for Omnivium is correct, but Clandestine should actually be 4.25
|
||
![]() |
||
UMUR ![]() MMA Special Collaborator ![]() ![]() Errors & Omissions Team / Retired Admin Joined: 25 Mar 2010 Location: Denmark Status: Offline Points: 18180 |
![]() ![]() ![]() ![]() ![]() |
|
Are you also taking into consideration the different weighting. Rating only has a lesser rating weight than a review and Collab reviews have a bigger weigting than non-Collab reviews.
|
||
![]() |
||
adg211288 ![]() Forum Admin Group ![]() ![]() Black Metal, Prog/AG Teams Joined: 05 Nov 2010 Location: United Kingdom Status: Offline Points: 22100 |
![]() ![]() ![]() ![]() ![]() |
|
Yes I know that, but surely by that logic the Obscura album should be rated higher since it has 4 collab reviews and the Entombed album just has 4 ratings and no reviews?
Edited by adg211288 - 07 Apr 2011 at 8:33am |
||
![]() |
||
UMUR ![]() MMA Special Collaborator ![]() ![]() Errors & Omissions Team / Retired Admin Joined: 25 Mar 2010 Location: Denmark Status: Offline Points: 18180 |
![]() ![]() ![]() ![]() ![]() |
|
Yeah that�s a bit odd.
|
||
![]() |
||
Henry Plainview ![]() Forum Senior Member ![]() ![]() Joined: 27 Mar 2010 Location: non-euclidean Status: Offline Points: 262 |
![]() ![]() ![]() ![]() ![]() |
|
Well when I go to the page now there are 5 ratings: 2 five stars, one 4.5, one 4, and one 2.5 and the average is 4.83. However, one of the five stars is by Vic, who is a collab. That average works correct if you give his rating the 20x collab weight. I tested a few other albums around and I know at least this one is the same, so it's not just albums without reviews. Testing this was very annoying because I had to hover over names on the ratings to see who was a collab, so I don't remember which other ones I did, and I didn't do an extensive search because it's almost 3am and I couldn't be bothered. Some of my tests made no sense, but I think that was probably just mistakes on my part.
Maybe it has always been this way the whole time and nobody noticed until now? Oops. ![]() Edited by Henry Plainview - 09 Apr 2011 at 2:54am |
||
![]() |
||
![]() |
||
adg211288 ![]() Forum Admin Group ![]() ![]() Black Metal, Prog/AG Teams Joined: 05 Nov 2010 Location: United Kingdom Status: Offline Points: 22100 |
![]() ![]() ![]() ![]() ![]() |
|
I was under the impression that the weighting only applies if there is a review, a rating always just being a rating regardless of whose rating it is.
Actually I was also under the impression that the weighting didn't actually apply to the average shown on each album, just how the top lists on each genre page were decided, after all if the weighting applies to the average then by that logic the top album in each sub should be the one with the highest average, which isn't the case in every sub. |
||
![]() |
||
Henry Plainview ![]() Forum Senior Member ![]() ![]() Joined: 27 Mar 2010 Location: non-euclidean Status: Offline Points: 262 |
![]() ![]() ![]() ![]() ![]() |
|
A rating only is supposed to be 1 weight no matter who is giving it, but clearly something has gone awry. The weighting absolutely applies to the displayed average, the whole point is for the sober collab reviews to outweigh a lot of ratings only from random people so people have a more accurate picture. That's something that can be easily verified with a calculator. The placement on the list is considering the weight and the average relative to the other albums and is a little bit harder to do by hand because I think you would have to calculate the weight of every album in the list you're talking about. But your problem is that you are assuming the albums with the most weight from reviews and ratings are also the highest rated. That is clearly not always the case. i.e. The difference in weight between Ziltoid the Omniscient (with 4 collab reviews and a member review and more ratings only) and Fear of a Blank Planet (only 3 collab reviews) is greater than the .04% difference in their overall average. Edited by Henry Plainview - 09 Apr 2011 at 4:41am |
||
![]() |
||
![]() |
||
AtomicCrimsonRush ![]() MMA Metal Reviewer ![]() ![]() Joined: 21 May 2010 Location: Australia Status: Offline Points: 602 |
![]() ![]() ![]() ![]() ![]() |
|
^^^THIS!
|
||
![]() |
||
![]() |
||
adg211288 ![]() Forum Admin Group ![]() ![]() Black Metal, Prog/AG Teams Joined: 05 Nov 2010 Location: United Kingdom Status: Offline Points: 22100 |
![]() ![]() ![]() ![]() ![]() |
|
Ok, I understand it better now. Thank you Henry.
|
||
![]() |
||
UMUR ![]() MMA Special Collaborator ![]() ![]() Errors & Omissions Team / Retired Admin Joined: 25 Mar 2010 Location: Denmark Status: Offline Points: 18180 |
![]() ![]() ![]() ![]() ![]() |
|
I�ve always had trouble with the math, so educate me here. Is there a problem that needs to be reported or not?
|
||
![]() |
||
adg211288 ![]() Forum Admin Group ![]() ![]() Black Metal, Prog/AG Teams Joined: 05 Nov 2010 Location: United Kingdom Status: Offline Points: 22100 |
![]() ![]() ![]() ![]() ![]() |
|
I'd say yes because going back to the two albums I posted about originally, Obscura's album has 4 collab reviews which should have 20x rating weight each, whereas the Entombed album has no reviews at all, yet clearly has a higher weight rating/placement on the list.
|
||
![]() |
||
UMUR ![]() MMA Special Collaborator ![]() ![]() Errors & Omissions Team / Retired Admin Joined: 25 Mar 2010 Location: Denmark Status: Offline Points: 18180 |
![]() ![]() ![]() ![]() ![]() |
|
I�ll PM Phil and have him have a look at this thread and see what he thinks.
|
||
![]() |
||
Henry Plainview ![]() Forum Senior Member ![]() ![]() Joined: 27 Mar 2010 Location: non-euclidean Status: Offline Points: 262 |
![]() ![]() ![]() ![]() ![]() |
|
Yes, it appears that some (perhaps even all) collab ratings are receiving the 20x weight even though there is no review. Only the collab reviews should be weighted 20x, everybody's rating without a review is supposed to be equal (1x). (Sorry to repeat but I thought adg's explanation was not very clear) |
||
![]() |
||
![]() |
||
The Angry Scotsman ![]() MMA Special Collaborator ![]() ![]() Honorary Collaborator Joined: 08 Aug 2010 Location: New Jersey, US Status: Offline Points: 1076 |
![]() ![]() ![]() ![]() ![]() |
|
Wait, is the issue that collab ratings without review are getting the 20X weighting?
I was wondering about that myself a while back http://www.metalmusicarchives.com/forum/forum_posts.asp?TID=1454 I took Jonas' advice and PM'd Phil and this was his exact response to me "It doesn't matter for you because you are a collaborator and the weight for rating only and full text reviews are the same. So if the the problem is collab rating onlys are getting full weight, it seems like for collabs the 20X weight is used regardless of review or not. edit: it is 5 am I dont care for math....so if there is an actual bug with the rating system itself please have it looked into. The collab weighting for non reviews though is not an issue. Edited by The Angry Scotsman - 13 Apr 2011 at 4:14am |
||
Megadeth, Metallica, Slayer and Testament. The real Big Four of thrash metal!
Listen to doom metal, worship Satan |
||
![]() |
||
adg211288 ![]() Forum Admin Group ![]() ![]() Black Metal, Prog/AG Teams Joined: 05 Nov 2010 Location: United Kingdom Status: Offline Points: 22100 |
![]() ![]() ![]() ![]() ![]() |
|
If collab rating only is actually worth 20x, then those averages are actually working out correctly right now, despite consistently higher ratings for Obscura and more collab reviews/ratings than Entombed. Doesn't seem right, but I guess you can't argue against the maths. So now that's cleared up I'm doubting there is a bug with the average ratings after all.
|
||
![]() |
||
The Angry Scotsman ![]() MMA Special Collaborator ![]() ![]() Honorary Collaborator Joined: 08 Aug 2010 Location: New Jersey, US Status: Offline Points: 1076 |
![]() ![]() ![]() ![]() ![]() |
|
According to Phil, (and I'm pretty sure he'd know
![]() So yeah, I'll leave the math to you guys but that is the case. Guess another perk of collabhood! Of course Henry wouldn't know because he came to MMA, I assume, just to flood us with ponies ![]() Edited by The Angry Scotsman - 13 Apr 2011 at 9:45pm |
||
Megadeth, Metallica, Slayer and Testament. The real Big Four of thrash metal!
Listen to doom metal, worship Satan |
||
![]() |
||
Henry Plainview ![]() Forum Senior Member ![]() ![]() Joined: 27 Mar 2010 Location: non-euclidean Status: Offline Points: 262 |
![]() ![]() ![]() ![]() ![]() |
|
Ok, well then why is it like that on MMA but not PA? It used to be like that on PA, but Max changed it because it's a terrible idea, so why go backwards? |
||
![]() |
||
![]() |
||
The Angry Scotsman ![]() MMA Special Collaborator ![]() ![]() Honorary Collaborator Joined: 08 Aug 2010 Location: New Jersey, US Status: Offline Points: 1076 |
![]() ![]() ![]() ![]() ![]() |
|
OK, well it is? Not sure why you have to do this, besides the fact you are Henry...if you honestly care enough (I'm sure you do) than PM an admin and inquire about it and ask to have it changed. Might not result in anything but complaining here certainly won't do much. Not like everything has to be the same anyway... |
||
Megadeth, Metallica, Slayer and Testament. The real Big Four of thrash metal!
Listen to doom metal, worship Satan |
||
![]() |
||
The Angry Scotsman ![]() MMA Special Collaborator ![]() ![]() Honorary Collaborator Joined: 08 Aug 2010 Location: New Jersey, US Status: Offline Points: 1076 |
![]() ![]() ![]() ![]() ![]() |
|
Also, I thought you were still on break from the internet???
|
||
Megadeth, Metallica, Slayer and Testament. The real Big Four of thrash metal!
Listen to doom metal, worship Satan |
||
![]() |
||
Henry Plainview ![]() Forum Senior Member ![]() ![]() Joined: 27 Mar 2010 Location: non-euclidean Status: Offline Points: 262 |
![]() ![]() ![]() ![]() ![]() |
|
Not really, I'm never going to be rating anything myself here anyway. It's just the principle, but I'm not going to waste time with personal appeals. My futile effort is better spent complaining about the new emoticons.
Too much fail. Edited by Henry Plainview - 23 Apr 2011 at 11:52pm |
||
![]() |
||
![]() |
Post Reply ![]() |
Page 12> |
Tweet
|
Forum Jump | Forum Permissions ![]() You cannot post new topics in this forum You cannot reply to topics in this forum You cannot delete your posts in this forum You cannot edit your posts in this forum You cannot create polls in this forum You cannot vote in polls in this forum |