RegisterDonateLogin

Don't get cocky!

Welcome Guest Active Topics | Members

What should I do to fix the Squad Ratings issues? Options
shinja
Posted: Tuesday, February 3, 2009 5:08:23 AM
Rank: Administration
Groups: Administration

Joined: 10/2/2008
Posts: 351
Location: Kent, WA
The problem:

People are rating squads a 1 when they deserve better, just to lower their ranking. People are also rating squads a 10 when they don't deserve it, just to raise their ranking. This problem is compounded by the same users creating many different accounts for the sole purpose of giving 10s to their squads (and their friends' squads) and giving other people's squads 1s.

The solution:

You tell me.



This is a thread to make suggestions for how to improve the Squad ratings on Bloo Milk. Feel free to suggest anything you think of, although I'll be far more likely to listen to mature, thought-out posts that aren't just ranting about how "my squad got two 1s and I want revenge!!!"

If you were webmaster for a day, what would you do to fix the problem? Don't worry about whether it's too difficult to code or anything like that. Just give me your ideal suggestion. Also partial suggestions are welcome--your solution might not solve the problem completely, but it will help with part of it.
imyurhukaberry
Posted: Tuesday, February 3, 2009 5:20:31 AM
Rank: Moderator
Groups: Member , Moderator

Joined: 5/8/2008
Posts: 2,220
Location: East Coast
I've thought about this for a while. I have been on the receiving side of the "1" bandit many a time. Still have a squad that just has the "1" rating on it. No biggie. I really only post my squads with a high rating at first to get the idea of it out there. After some time they usually get knocked down and then I remove my rating from it which drops it off the radar but it's still public.

So...what would I suggest? I found that I really like how Shoebox does their rating. The squad with the most people placing it as their favorite gets the #1 spot. If you don't like it, then you don't tag it as a favorite. Sure, you can still manipulate the system, but I believe it's a bit more fair.

I personally don't care that much. I know which of my squads do well when I play them. Maybe one of my buddies won't play it like me and rush off and get slaughtered. OR...perhaps it will do better in their hands. That's the beauty of this game. SOOO many choices to tailor to your own playing style. That's why ratings will NEVER be completely fair and honest. There is too much bias and personal preference. A squad that the GenCon winner used might not do so well in the hands of someone that doesn't understand it.

The only other thing I could suggest is to divide the rankings up by points value. 100s vs 100s; 150s vs 150s; etc. I know I suggested this before but I think it will make a big difference in the ratings. Who really can rate a 100pt squad in with "Speedy Cannon" or "Exar Sings"? They never compete against each other, so why should they in the ratings? *shrugs shoulders*
Zalkrie
Posted: Tuesday, February 3, 2009 5:41:37 AM
Rank: Advanced Bloo Milk Member
Groups: Member

Joined: 5/23/2008
Posts: 314
Location: Abingdon, MD
I'm getting to the spot were I wonder about rating the squads at all. Ultimately, I think people use to use the ratings to look for squads they would like to play. I am not so sure that is the point any more however. I now look for squads built with a character that I am looking to build a squad around now. Maybe you could fix it so when we search for a squad with a character, we wouldn't have to start over to look at the next squad.

Do away with the rankings altogether, because it is causing so much contention.
DarthJak
Posted: Tuesday, February 3, 2009 6:02:06 AM
Rank: Advanced Bloo Milk Member
Groups: Member

Joined: 7/30/2008
Posts: 1,290
Location: Stow Ohio, just north of Dantooine (vacay on Ando)
I've been suggesting the whole time to eliminate the number ratings,all they seem to do is bring out the worst in us.The comments are very helpful and can help evaluate a squad with out making it a competition.

oh yea.... go bloomilkBlooMilk
Darth_Massey-Sith_Lord
Posted: Tuesday, February 3, 2009 6:15:25 AM
Rank: Advanced Bloo Milk Member
Groups: Member

Joined: 7/8/2008
Posts: 97
Location: Vancouver, WA
i think there are 2 main things you can do, shinja, that would eliminate this problem. one would be to make users register an e-mail address to sign up for an account. that makes it MUCH harder for people who just want to create an account for destructive purposes. two would be to make it so people HAVE to leave a comment to give a number rating. that way it's MUCH more apparent who is just doing drive-by 1ing (someone leaving a comment like "no").

you could also make it so you have to have your account for a month before you can rate squads. that would most likely cut WAY back on drive-by 1ing.
markedman247
Posted: Tuesday, February 3, 2009 6:21:39 AM
Rank: Advanced Bloo Milk Member
Groups: Member

Joined: 5/14/2008
Posts: 2,063
DarthJak wrote:
I've been suggesting the whole time to eliminate the number ratings,all they seem to do is bring out the worst in us.The comments are very helpful and can help evaluate a squad with out making it a competition.

oh yea.... go bloomilkBlooMilk


To be honest, the ranking system is a privilege and not a right. It's been shown to be abused. I would favor a complete removal of the system. Maybe, if there wasn't a "competitive" aspect of having a highly rated squad, people would just critique. It would be the most realistic choice outside of some way of making the "Ranker Monsters" develop some maturity.

ken_watson76
Posted: Tuesday, February 3, 2009 6:34:15 AM
Rank: Advanced Bloo Milk Member
Groups: Member

Joined: 5/29/2008
Posts: 101
Location: Cleveland, Ohio, U.S.A.
I have to disagree with removing the rating system, as I think squad ratings can be useful. I like to look at the top squads to get some ideas on combos that will work with some of the minis that I have, etc., or to give me inspiration to build squads that I would consider to be competitive with respect to those posted. Also, I would be proud in my own nerdy way to have a squad in the top 5.

What I think would help is this: stop making squad ratings anonymous. I don't think there's any good reason for them to be anonymous. If they weren't anonymous, it would make users be accountable for the ratings that they post. If somebody posts a bad rating, it would encourage me to PM them to ask why if they don't provide comments as to that effect, although I think that people WOULD be more inclined to post comments if they were to rate a squad poorly. Bottom line: if everyone had to be accountable for their ratings, it would create a more friendly, open environment for criticism and evaluation of this important aspect (squad building) of the hobby that we all enjoy.

The downside, I'm sure, is that there would be less people leaving ratings for squads. So what? I haven't rated a lot of squads, but I have no problem explaining why I've rated squads the way that I have. I would hope for nothing less from anybody else. Those people that would rate squads would do so fairly, which is what we want, right?

On another (related) topic, I also feel that the squads page should display more than just the last 5 created squads. I think 25 would probably be better. I want people to rate my squads when I post them, but often they don't ever get a chance to get rated because at peak times when many people are on Bloomilk at the same time, the turnover rate of the 5 posted squads can be very high, and my squad will never get a chance to be rated. I know that you can access previous squads just by clicking "More", but I don't think people do that (to be fair, I don't). Special thanks go out to all of the users that go through old squads and rate them (you know who you are).

My two cents. Thanks for reading.
engineer
Posted: Tuesday, February 3, 2009 6:35:33 AM
Rank: Advanced Bloo Milk Member
Groups: Member

Joined: 4/19/2008
Posts: 469
Location: Kalamazoo, MI
What about a "fun" rating and a "competitive" rating?

Removing folks with multiple accounts would be nice, but is it really worth the effort? It is a game for fun and not work.

How about:
If you have less than 10 posted squads, no rating others.
If you have at least 25 public squads, then you can rate 25 other squads.
If you have over 25 public squads, then you can rate as much as you want to.

This makes 'shell' accounts much more difficult.
EmporerDragon
Posted: Tuesday, February 3, 2009 6:58:59 AM
Rank: Advanced Bloo Milk Member
Groups: Member

Joined: 12/26/2008
Posts: 2,115
Location: Watertown, SD
Perhaps something similar to newgrounds: An overall ranking with a bunch of sub rankings (say Competitiveness, fun, theme, synergy, etc.). Users would have to leave a comment with their ranking, and vote-stuffing comments on both ends of the spectrum could be reported and removed.

The vote-stuffers themselves would get a warning about their actions, and if it continues, their rating privileges are suspended or removed.
imyurhukaberry
Posted: Tuesday, February 3, 2009 7:47:10 AM
Rank: Moderator
Groups: Member , Moderator

Joined: 5/8/2008
Posts: 2,220
Location: East Coast
Anonymous user? (no user posted w/ squad)
might help reduce "hate voting"

Just another thought...
ken_watson76
Posted: Tuesday, February 3, 2009 8:00:51 AM
Rank: Advanced Bloo Milk Member
Groups: Member

Joined: 5/29/2008
Posts: 101
Location: Cleveland, Ohio, U.S.A.
BTW - I also agree with imyurhukaberry regarding ratings by point value. I once saw a very highly rated squad that was 300 points (I believe it was number 1). I rolled my eyes. I'm not saying that it was a bad squad, nor that I will never play a 300 point game, but it didn't seem appropriate to put it in the same league as the 100, 150, and 200 point squads that are more difficult to build based on working with limitation and that are DCI legal.
Uggie Demo
Posted: Tuesday, February 3, 2009 8:25:09 AM
Rank: Advanced Bloo Milk Member
Groups: Member

Joined: 8/28/2008
Posts: 1,378
Location: Indianapolis
I thinks that the number ratings should stay, but if you rate a squad you must leave a comment and the rating you gave the squad, and if you don't your rating is negated.
Sithborg
Posted: Tuesday, February 3, 2009 8:43:46 AM
Rank: Moderator
Groups: Member , Moderator, Rules Guy

Joined: 8/24/2008
Posts: 5,201
There is no good solution. Leaving a comment is not going to stop it (if anything, it causes fueds). I keep on referring to Decktech, because it is an awesome site, but I think the best thing you can do is add an additional quantifier to squads, like whether it is a fun, theme, or competitive squad. I mean, the one rating for all squads really doesn't work, since a fun squad should be judge differently than a competitive one.

I would also like to see a function to see more than the last 5 created squads. Squads can get lost pretty quickly at peak times.

Edit: If you go with leaving a comment, make it so the poster has to post one as well.
MasterWolf
Posted: Tuesday, February 3, 2009 8:46:19 AM
Rank: Octuptarra Droid
Groups: Member

Joined: 11/6/2008
Posts: 30
I definately don't want to remove the rating system, it's how I find most of the squads I want to play.

I agree with having different rating structures per point total. This is the first major thing I think we should implement immediately.

I think being able to click on someone's name and seeing:
50 squads rated 10
12 squads rated 7
145 squads rated 1
Would also help reduce the "haters". Cause then we could just vote to remove those users or something ;-)

Or just remove ratings 1-4, lol. Then even if they rated someone a 5 it wouldn't kill the rating as bad.

I like the concept of needing X squads to rate, but I've only got like 15 squads and I've rated like 700 times. So *shrug*.

I'll keep thinking.


Edit: Also, Shinja, you have the power here. You can see what people are rating. Maybe add 1-3 moderators who have that access and when they find someone who is rating a bunch of 1s for no reason, or if they find a multi-user, they can ban that user and remove their ratings.
imyurhukaberry
Posted: Tuesday, February 3, 2009 8:55:01 AM
Rank: Moderator
Groups: Member , Moderator

Joined: 5/8/2008
Posts: 2,220
Location: East Coast
Not trying to step on toes, but if you take away the lowest 3 scores, they will just use the next lowest. Then you take away 4 & 5...they use 6. That would pretty much just leave you rating everything between 8 and 10. Not a very accurate rating system then...
MasterWolf
Posted: Tuesday, February 3, 2009 8:57:49 AM
Rank: Octuptarra Droid
Groups: Member

Joined: 11/6/2008
Posts: 30
imyurhukaberry wrote:
Not trying to step on toes, but if you take away the lowest 3 scores, they will just use the next lowest. Then you take away 4 & 5...they use 6. That would pretty much just leave you rating everything between 8 and 10. Not a very accurate rating system then...


No, you're right.
Del Muerte
Posted: Tuesday, February 3, 2009 9:00:59 AM
Rank: Acklay
Groups: Member

Joined: 11/6/2008
Posts: 49
1) A voting right period would be good, like a week or two to meta gate account creations. Also an inactive accounts that hasn't been used in three month or so is good, with possible reactivation options.

2) I did come up with a way(using stand derivation, mean, Z scores and such) to make each person vote to sift form they actual rating to they different rating based on their history of votes, basically Standardizing themselves . Example if a person(me from some months ago) vote something like this:

Rating # of times used
1...................3
2...................2
3.................12
4.................64
5...............262
6..............1300
7..............2121
8................549
9..................25
10..................0

my voting of 7 turn into 5.88 and my as that's my average rating. were my 3 ratings are shift to 1.3 as i rare go that far down on ratings and my 9 is 8.13.
Were a person who votes like this

Rating # of times used
1...................5
10.................6

Their 1 vote is shifted to a 4.73 and 10 vote is shift to a 6.66

The Problem with this method is each person need something like 50+ votes before they could be standardize with them selves and it very time consuming for the voting process as a person voting value change with every vote and changes every vote that person has done. Now you could make so a person pass votes are not retro actively change and a person vote doesn't count or count for less than a vote till he voted X amount of times then all their pass vote start are counted and retro actively shifted. Hope people understand thisRazz
Volvagia14
Posted: Tuesday, February 3, 2009 9:23:54 AM
Rank: Advanced Bloo Milk Member
Groups: Member

Joined: 11/3/2008
Posts: 498
Location: somewhere over the rainbow (a rainbow in Indiana)
just a thought...
maybe removing the 1-10 rating system and just using the number of feedback posts as the rating system would work
Durge Dude
Posted: Tuesday, February 3, 2009 9:28:16 AM
Rank: Advanced Bloo Milk Member
Groups: Member

Joined: 12/7/2008
Posts: 685
Location: a galaxy far far away
I say a rating of 6 or less should need a comment for why so low but I have know idea on how you would do thatConfused
imyurhukaberry
Posted: Tuesday, February 3, 2009 9:28:22 AM
Rank: Moderator
Groups: Member , Moderator

Joined: 5/8/2008
Posts: 2,220
Location: East Coast
Vol: Only thing with that is the originator can currently post all he wants on his own squads.
Also, someone could post a bunch of "A"s and get the top spot.
If limited to one comment per user, then you got the multiple account users that will abuse it.
(just pointing out some stuff)
Users browsing this topic
Guest


Forum Jump
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.

Main Forum RSS : RSS

Bloo Milk Theme Created by shinja
Powered by Yet Another Forum.net.
Copyright © 2003-2006 Yet Another Forum.net. All rights reserved.