Queue/Batch Discussion Thread v2

[Rebirth0]

Re: Queue/Batch Discussion Thread v2 (Submission Closed)

For the sake of the argument, I don't care about the judgement on Fleeting Fantasy.

I'm simply offering easy advice. Do not let technicality be the weighted factor in judging files. There are plenty of good files that can be made with the old school approach. If a file is offsync or notes are clearly off (bad use of rainbow syndrome) then that's one thing. But if a file isn't technical or layered enough, then it should matter.

I don't know what to think about the judging process of today. It's hard to have a solid standard of how things should go and what mindset to use when there are 12 judges. I personally liked it back when it was just me and jimerax judging. Tass' opinions got in the way more than I would have liked and some things got rejected that shouldn't have been and vice versa

There is a way to have a perfect judging system. Have ONE judge, PERIOD. But that judge has to be someone very very familiar with all styles and have a ton of history and knowledge of the game. I think these seasoned members should have the ability to judge correctly. There needs to be balance between technicality and fun factor. (the same shit thats been said a million times before)

[hi19hi19]

Re: Queue/Batch Discussion Thread v2 (Submission Closed)

I'd be most happy with all 12 judges playing every file, to be honest. The more reviews the better, especially from a wide range of skill levels and mindsets.

Of course that's asking a little much so I feel the current system is a decent compromise.

[Rebirth0]

Re: Queue/Batch Discussion Thread v2 (Submission Closed)

I don't have any new ideas for judging. The one judge thing is the best way to do it fairly, but we've been down that road before. As the site got more popular, more submissions were made, and the workload got way too big. That's why we got to 3 judges, then 5, now 12

[who_cares973]

Re: Queue/Batch Discussion Thread v2 (Submission Closed)

two groups of 6 judges.

bam problem solved

how i judge a file:
start with 20 points

is it on sync? if no -12 points
is every sound represented one way or another? if no -10 points
is there a new technique being employed? if no -20 points
when i close my eyes and listen to the song is the file similar to what i imagined? if no -20 points
is it fun? if no -5 points

[qqwref]

Re: Queue/Batch Discussion Thread v2 (Submission Closed)

you forgot "is it by dossar? yes -15 points"

[jimerax]

Re: Queue/Batch Discussion Thread v2 (Submission Closed)

btw, can someone make a point list of the last batch please (sry if I miss it)?

[dag12]

Re: Queue/Batch Discussion Thread v2 (Submission Closed)

I'll do it.

Edit:
Did it in an excel file, so sent it by email.

[jimerax]

Re: Queue/Batch Discussion Thread v2 (Submission Closed)

Excel.. nice, thanks.

wow, 62 files have 13+ rating out of 97 files already.
I doubt we really should do voting for borderline (12) files with this acceptance rate.

[qqwref]

Re: Queue/Batch Discussion Thread v2 (Submission Closed)

It doesn't seem fair to throw out 12/15s just because there were a lot of good files in the batch. They were just as good as 12/15s from any other batch, and should have the same treatment.

I'm not really sure why you're against having a lot of files in FFR - if they truly are good files, there's nothing wrong with having more of them. There are already over 1000 public charts, so if you're worried about there being too many charts for a casual player to handle, we definitely already reached that point.

[who_cares973]

Re: Queue/Batch Discussion Thread v2 (Submission Closed)

with that many accepted files id rather have all borderline files worked on and refined instead of being voted on

[ichliebekase]

Re: Queue/Batch Discussion Thread v2 (Submission Closed)

Including the previously queued files and excluding all of the ones 12 and lower from this batch, there's now 90 charts ready (ish I should say) to go in game...

Batch clearing event sounds like a good idea x]

[jimerax]

Re: Queue/Batch Discussion Thread v2 (Submission Closed)

Overall quality of this batch might be good this time, but obviously it's does not explain the acceptance rate enough from what I've seen. Leniency in judgement, or limitation of current rating system might affect at the same time. For future batches whole judgement system definitely will be changed, anyway.

The concept of the judgement should be either accepting all semi-good files and go for the quantity, or accepting selected number of files and go for the quality. I'm just leaning to the latter.

13/15 is just a cutoff, and we have to set the cutoff to determine the borderline anyway. For this time, I'm not against having borderline vote for the consistency though.

[ichliebekase]

Re: Queue/Batch Discussion Thread v2 (Submission Closed)

Sent in fixes for We Will Fly. The new version should have 808 steps (just so this is clear as to which is the correct one).

[TC_Halogen]

Re: Queue/Batch Discussion Thread v2 (Submission Closed)

There was mention in the Simfile Judgment forum by JX to use the [+] rating a bit less, yet nearly every judge had double digits. This isn't to say that the quality of files wasn't good, but there are a few files with extremely questionable ratings in this batch.

I'm afraid I have to agree with wc on this for batch control -- with a 60% acceptance rating, adding more files that are borderline will be an excessive amount of files.

[who_cares973]

Re: Queue/Batch Discussion Thread v2 (Submission Closed)

i'll use [+] less when theres a better system in place to distinguish good, kinda good, and acceptable though i dislike certain section that are stepped that ruin the flow but arent necessarily wrong