Queue/Batch Discussion Thread v2

[i love you]

Re: Queue/Batch Discussion Thread v2

Just contacted Patashu and he said that he won't be able to finish judging within the next 2 hours so we definitely need a back-up.

[ichliebekase]

Re: Queue/Batch Discussion Thread v2

If you need someone to do it quickly I can do it. I know I'm not the first choice but I'm going to be up for a while tonight and I'm available. I have a resub in that set of files though so someone else would have to judge that one.

If it's okay with you jimerax, I can go half and half with you. Let me know.

[psychoangel691]

Re: Queue/Batch Discussion Thread v2

Wouldn't splitting Patashu's up between a couple people just kinda cause issues? With the differing of experience/opinions I don't see that as being the best idea. I really think that being it's this late already just go off a 3 judge system for that group and have someone come in for the borderlines like AJ suggested. It's really not fair to the people who have been waiting to have to wait longer for someone to complete notes now.

[bmah]

Re: Queue/Batch Discussion Thread v2

lol man, if it's going to be this quickly hashed up, I'll have a harder time taking these last set of notes seriously. The quality of assessment is never the same when you compare reviews done in 2 hours compared to reviews completed in even one or two days.

I can see the idea becoming quite messy if the plan moves forward like this.

[psychoangel691]

Re: Queue/Batch Discussion Thread v2

Yea bmah has a really good point there too. It's kinda hard to make a good judgements in such a short period of time.

[kommisar]

Re: Queue/Batch Discussion Thread v2

perhaps 3 judges notes is sufficient?

[bmah]

Re: Queue/Batch Discussion Thread v2

That's what I've been saying all along haha.

[ichliebekase]

Re: Queue/Batch Discussion Thread v2

Whatever happens, happens. I just foresee a problem with only 3 judges..

Randomly thought of this, it may sound stupid. If only 3 judges are used for that group, of the grades received, could you possibly add the average of the 3 scores to be the 4th score? Example; a file received 4, 4, 3. Average of those is 3.67 and that or the rounded up or down of the average would be the "fourth judge". Then the total score for that file would be 14/15 depending on how you calculated it.

Just a thought :/

EDIT: Thought #2 [yea, I'm full of them]. Even though this is likely what does happen already, just make the judging out of 15 instead and determine what would be accepted out of 15, which would likely be something along the lines of 12+.

[kommisar]

Re: Queue/Batch Discussion Thread v2

In case of tie breakers just send to other judges like was done with all the other files. This would throw off the point system though since it was based off 4 judges' scores.

[TC_Halogen]

Re: Queue/Batch Discussion Thread v2

In case of tie breakers just send to other judges like was done with all the other files. This would throw off the point system though since it was based off 4 judges' scores.

this seems like the best solution, because the three initial judge ratings wouldn't be affected, whereas adding a fourth could potentially mess them up due to pressure of time constraints, etc.

EDIT: forgot to add something -- there would be two separate borderlines for the batch; 4 group batch would have either 15/16 and 3 would be 11/12, right? then have all judges vote on borderline files.

[qqwref]

Re: Queue/Batch Discussion Thread v2

Halogen: nah, a file from the 3-judge part of the batch would need at least 17 out of 15 points to make it ingame. 16 out of 15 would be okay if people really like the file. Why would we bother changing the bar just because there are fewer judges?


Honestly I think 3 judges is no worse than 4. One judge can already ruin a file by giving it a -, and 3 judges doesn't really make that situation any better or worse.

[TC_Halogen]

Re: Queue/Batch Discussion Thread v2

Halogen: nah, a file from the 3-judge part of the batch would need at least 17 out of 15 points to make it ingame. 16 out of 15 would be okay if people really like the file. Why would we bother changing the bar just because there are fewer judges?

25/15 for [++]. no need to adjust.

[bmah]

Re: Queue/Batch Discussion Thread v2

Brenton Mah 9:58 pm
I'm sort of leaning for you to be the 4th judge then.

jimerax (jimerax) is available 10:11 pm
jimerax 10:12 pm
fine

[who_cares973]

Re: Queue/Batch Discussion Thread v2

Make patashus judgements all be +. And release the notes

[bmah]

Re: Queue/Batch Discussion Thread v2

haha, that'd be awesome