Queue/Batch Discussion Thread

[Patashu]

Re: Queue/Batch Discussion Thread

hey man. spoilers.





wait until grist is in game

[Elite Ninja]

Re: Queue/Batch Discussion Thread

Why putting up the songs in a special genre and having the community pick which songs to stay and which to go is a bad idea that won't work: THE BATCHES USUALLY CONTAIN UPWARDS OF 70 FILES

Not when the judges narrow down all the good ones. But I understand the bias issue.

[TC_Halogen]

Re: Queue/Batch Discussion Thread

hey man. spoilers.





wait until grist is in game

dude, you know I'm gonna whore the living crap out of that for the AAA, right

[TC_Cyrenics]

Re: Queue/Batch Discussion Thread

Xecus lol

PS botaru is in Michael Quest 2 and I've wanted to step it since I first saw that video.

[who_cares973]

Re: Queue/Batch Discussion Thread

Not when the judges narrow down all the good ones. But I understand the bias issue.

Then its pointless to have the community judge when the judges already narrowed it down to what we feel the community would enjoy lol

[dore]

Re: Queue/Batch Discussion Thread

you have to have some sort of transparency in the system for judging to work. If you leave it open to the community, you can have a bunch of people going

1/5 song sucks
1/5 i cant fc
1/5 i hate [insert simauthor or musician or whatever here]
1/5 lol im going to do this to every file

with judges, everybody knows what everybody says about every file, and it's easy enough to air grievances about particular files/judges/whatever and have it worked out in an appropriate manner if someone feels treated unfairly.

I honestly don't mind having lots of judges. I also think it's good to have new judges enter the system and backups and whatnot. I'd rather see the system with multiple levels of judging though, because I think it's a little unfair for a file to get in the game/not get in the game but still be subject to the fact that you're making files for essentially a random audience (you don't know exactly who is going to judge your file, their preferences, their prejudices, etc.). It's impossible to completely put aside personal preferences and prejudices, but experienced judges are more experienced in doing so able to do so, and it's more difficult to do so while you're still getting into the groove of judging for FFR.

[qqwref]

Re: Queue/Batch Discussion Thread

you have to have some sort of transparency in the system for judging to work. If you leave it open to the community, you can have a bunch of people going

1/5 song sucks
1/5 i cant fc
1/5 i hate [insert simauthor or musician or whatever here]
1/5 lol im going to do this to every file

Totally agree with that - many people (even veterans) won't be able to provide useful opinions. Also, considering that the people who make fine distinctions between 3/5, 4/5, and 5/5 usually get totally overruled by the percentage of users who vote 1/5, if we did any community voting system, we'd probably want to make it just a thumbs up / thumbs down vote, like on YouTube or the FFR profiles.

I'd rather see the system with multiple levels of judging though, because I think it's a little unfair for a file to get in the game/not get in the game but still be subject to the fact that you're making files for essentially a random audience (you don't know exactly who is going to judge your file, their preferences, their prejudices, etc.).

This is a really good point, especially since the line is so thin and judges can be so subjective (last batch: 17 = flat out accept, 15 = flat out reject). Maybe the files that are obvious accept or reject (like, say, 2+ points off the grey line, which in the last batch was 16 pts) would be treated as such, and the files that are closer to the line would be reviewed by a second group of judges, to see what a bigger consensus would say about it.

[ichliebekase]

Re: Queue/Batch Discussion Thread

This is a really good point, especially since the line is so thin and judges can be so subjective (last batch: 17 = flat out accept, 15 = flat out reject). Maybe the files that are obvious accept or reject (like, say, 2+ points off the grey line, which in the last batch was 16 pts) would be treated as such, and the files that are closer to the line would be reviewed by a second group of judges, to see what a bigger consensus would say about it.

Another thing to point out with this is there were many instances where the scores for one file from 4 judges was 1, 2, 3, and 4. I actually had 2 files like that. If something like this happens, I'd think that would be a case where it should be judged by another set of judges because of such a wide range :/

Subjectivemanias running wild.

[dore]

Re: Queue/Batch Discussion Thread

This is a really good point, especially since the line is so thin and judges can be so subjective (last batch: 17 = flat out accept, 15 = flat out reject). Maybe the files that are obvious accept or reject (like, say, 2+ points off the grey line, which in the last batch was 16 pts) would be treated as such, and the files that are closer to the line would be reviewed by a second group of judges, to see what a bigger consensus would say about it.

That's basically what I would prefer to see. Have teams like normal go through everything, and then files that get 15+ points or maybe 14+ go to a team of more experienced judges (who either could be spread out among the other teams or not judge the first round). Then Team Tass (lol) could make final judgments. Then for borderline files the judges could consider the original judgments as well as discuss amongst each other which files go in/out.

[kommisar]

Re: Queue/Batch Discussion Thread

wow are people still complaining about judges and bias? there's like 20 of us. the main reason is to avoid bias. get over it. your files don't make it in, there's obviously a good reason for it. no more whining plz.

[jimerax]

Re: Queue/Batch Discussion Thread

Final pic of this batch.


Also, as for 12 primary judges of this time,

[In]
Silvuh, bmah, Arch0wl

[Out]
samurai7694, buizel8888, Vote4Nixon

I'll determine the group members and files to judge for groups later, then send the batch file.

[who_cares973]

Re: Queue/Batch Discussion Thread

Looks like there will be a lot of rejects in this batch

[who_cares973]

Re: Queue/Batch Discussion Thread

wc judging checklist:

have you submitted to at least 3 batches before?
do you have at least one file in game?
have you stepped at least 15 files?
have you ever critiqued files before?
have you stepped a file in the past 3 months?
do you have prior judging experience?
would you say you have a firm grasp of the stepping basics?
can at least one well known stepper vouch for you?

if you answered no to 3 or more then you are not qualified to judge/backup judge in my opinion

[cedolad]

Re: Queue/Batch Discussion Thread

wc judging checklist:

have you submitted to at least 3 batches before?
do you have at least one file in game?
have you stepped at least 15 files?
have you ever critiqued files before?
have you stepped a file in the past 3 months?
do you have prior judging experience?
would you say you have a firm grasp of the stepping basics?
can at least one well known stepper vouch for you?

if you answered no to 3 or more then you are not qualified to judge/backup judge in my opinion

what about sort of's? I have like 2 sort ofs.

[Gundam-Dude]

Re: Queue/Batch Discussion Thread

I answered no to the first two questions