Rethink Our Chart Difficulties

[Kanzas]

Re: Rethink Our Chart Difficulties

I would always get 1-0-0-1 on ABCDEath, like everytime. One day I miraculously was able to read it as a DR. Seuss book and AAAd the damn thing. 56? Doubt it.... A really complex high 40? Sure.

[TheSaxRunner05]

Re: Rethink Our Chart Difficulties

It does sit there until approved.

I sent somehing like two weeks ago lol

[hi19hi19]

Re: Rethink Our Chart Difficulties

I should note that, as a rule, files tend to wind up being rated by their hardest part.
This is a consequence of the game mechanics leading the scoring to be AAA/low SDG-focused.
For some extreme examples of this effect consider the ratings on party 4u "holy nite mix" v1 and Crowdpleaser, but of course it also holds true for less pants-on-head stupid difficulty spikes too.

So in general files with notable short difficulty spikes tend to be rated higher than it initially appears they should be- you typically quickly progress to the point where you have 98% of the file mastered, but that 2% will keep you from the AAA longer than you might think, raising the rating.

That said I'm glad the ABCDEath thread is made, it definitely needed one... I'm not pretending the system is perfect lol

[TheSaxRunner05]

Re: Rethink Our Chart Difficulties

What would be really helpful is if we could run a query on the songs that make the most people's top 4, and then decide whether there on so many people's top scores because they are actually good scores, or if they are overrated.

[Rapta]

Re: Rethink Our Chart Difficulties

Sounds like a good idea @post before mine

[hi19hi19]

Re: Rethink Our Chart Difficulties

What would be really helpful is if we could run a query on the songs that make the most people's top 4, and then decide whether there on so many people's top scores because they are actually good scores, or if they are overrated.

This is a really, really good idea.

Conversely, you can also run a query for songs that hardly appear at all in people's top scores, and see if that's because they are underplayed or underrated.
Ideally, you'd want a fairly even distribution of songs appearing in people's top scores. This will never be perfect due to factors such as popularity and differences in song structure (files that are tricky to PA versus straight up files that are just a "are you this fast" speed test) but it's completely worth checking.

[blanky!]

Re: Rethink Our Chart Difficulties

Some curve needs to be invented that measures the difficulty of getting a certain score on a file.
On every song the curve would be different; for example, World Tour 2004 is easily SDG'able by upper D4, but AAA'ing is another story.
Meanwhile, you have jacky files like Turbo that are hard to FC but easy to AAA.

Though, unless a reliable difficulty formula is established, this would have to rely on statistics, which can be muddled by all the D7 players on harder songs.
So +1 to Sax's idea.

[noname219]

Re: Rethink Our Chart Difficulties

This is a really, really good idea.

Conversely, you can also run a query for songs that hardly appear at all in people's top scores, and see if that's because they are underplayed or underrated.
Ideally, you'd want a fairly even distribution of songs appearing in people's top scores. This will never be perfect due to factors such as popularity and differences in song structure (files that are tricky to PA versus straight up files that are just a "are you this fast" speed test) but it's completely worth checking.

Or if a range of songs always appears on top (say 60-65), maybe it's the formula that is problematic and we should tweak it a little bit. Anyway, it's a win-win idea.

[TheSaxRunner05]

Re: Rethink Our Chart Difficulties

Some curve needs to be invented that measures the difficulty of getting a certain score on a file.
On every song the curve would be different; for example, World Tour 2004 is easily SDG'able by upper D4, but AAA'ing is another story.
Meanwhile, you have jacky files like Turbo that are hard to FC but easy to AAA.

Though, unless a reliable difficulty formula is established, this would have to rely on statistics, which can be muddled by all the D7 players on harder songs.
So +1 to Sax's idea.

This effects could be mitigated by small adjustments to those specific file difficulties which need to be reworked to fit our new system.