Queue/Batch Discussion Thread

[bmah]

Re: Queue/Batch Discussion Thread

Fixes for queued files can be sent without rejudging - unless you're changing the file significantly. If so, please let us know in your email.

[jimerax]

Re: Queue/Batch Discussion Thread

Oh I misread

As for queue'd files, you can just send the .dwi. will write about it.

[dore]

Re: Queue/Batch Discussion Thread

so why is a +. +. +. rejected outright? I don't understand the premise here (and yes I'm asking because it affects me, but only because that's how I noticed that particular example and I disagree with rejecting a +. +. +. without any discussion, further judging, etc.)

[TC_Halogen]

Re: Queue/Batch Discussion Thread

+. 3x isn't a reject to my knowledge. +. +. +? is borderline though.

EDIT: oh, I see what you're saying. I guess JX and bmah went over and made sure the acceptances were justified, because it seems like we lost 8 accepted files.

[dore]

Re: Queue/Batch Discussion Thread

yeah they upped the points requirements for a couple of the groups

[jimerax]

Re: Queue/Batch Discussion Thread

you mean 12/15 files in G1 and G4? It was accept on my 2nd criteria idea but

1. acceptance rate adjustment among groups (it's needed this time).
2. 41 files are way too many for accepted files.
3. just resubmit with improvement if files are rejected.

[bmah]

Re: Queue/Batch Discussion Thread

I guess JX and bmah went over and made sure the acceptances were justified, because it seems like we lost 8 accepted files.

I made a staff progress report earlier, but I did not specifically go over simfiles again. You'll have to ask jx about that. I'm pretty sure it has to do with the imbalance of accepted files amongst various judges. Think of it like a grading curve.

*ninja'd*

[Khenra]

Re: Queue/Batch Discussion Thread

How long does it approximately take for a submission to be graded? I've submitted a file a few days ago and haven't heard anything from it since.

I don't know where to look for feedback either.. the OP of this thread?

[dore]

Re: Queue/Batch Discussion Thread

I understand that but I think my disagreement stems from the fact that you're comparing different judges on different files with different levels of experience, so it's hard (especially with some people having only ever judged ~25 files for FFR ever) to get a decent determination of what is judging bias and what is actual discrepancy in quality from one group to another. I just think that unless (a) all of the judges judge every file and you can compare directly, (b) a few people play every file in order to subjectively judge the trends, or (c) all of the judges are in direct communication with each other during the judging process (which should happen anyway, because it's much easier to reduce discrepancies based on what mood you're in that particular day or even the order of the files, which can impact the final judgment), it's hard to compare.

I really don't mind making the changes and redoing it, I just question the premise of the decision. (And in my case, I feel like I could've gotten that extra point from one of the judges by changing 10 notes, and I don't think that should be the boundary from absolute acceptance to absolute rejection)

[bmah]

Re: Queue/Batch Discussion Thread

How long does it approximately take for a submission to be graded? I've submitted a file a few days ago and haven't heard anything from it since.

I don't know where to look for feedback either.. the OP of this thread?

It varies, but it can take anywhere from 2 weeks to a month+ for submissions to be graded. We're hoping that reviews in future batches will be done at a reasonable pace.

For feedback of the files you've submitted, please refer to the batch review thread.

@dore: the inconsistency due to the level of judging experience (or lack of) is something I'm trying to tackle...it's one reason why I made a progress report, as well as providing resubmitted files an extra sort of distinction amongst the others. I have a number of files that weren't accepted that I suspect was due to this issue. If I actually can't find anything to fix, I'm going to send them completely unchanged, because it's not an issue on my end if it's due to judging incompetency. You can't completely eliminate the problem with this many judges, but I'm trying to reduce it.

[0]

Re: Queue/Batch Discussion Thread

11eleven was judged [+] [+.] [+.] (13 points) why was it rejected

[bmah]

Re: Queue/Batch Discussion Thread

The only reason I can think of is that perhaps decisions may have been finalized based off of Halogen's earlier post, which in this case I do notice a discrepency (noted as +.,+.,+. = 12pts). I'd like to have jx confirm this.

Human error sucks, I know.

[jimerax]

Re: Queue/Batch Discussion Thread

oh +, +., +., is accept, will check and change it.

If there're miscounts tell me about them.

[Izzy]

Re: Queue/Batch Discussion Thread

I bet the judges hate my file because of all the jumpstream. It isn't to much different then the jumpstream in exciting hyperhighspeed star though.

[Plan_Bsk81127]

Re: Queue/Batch Discussion Thread

FFR needs more jumpstream and chill out on the bursty dnb songs for a bit. lol.