Forum

In my opinion it’s a very interesting project, I have waited for something like this since the use of logs was established. Let’s just hope it doesn’t go the way of metacritic, where a single number has way too much weight on the assessment of quality/performance.

For instance, I noticed the Prem/Div 1 Spies are ranked all over the place. Spy is arguably one of the hardest classes to asses using numbers, though. And it might be for other reasons like recent inactivity.

Quoted from Selek

In my opinion it’s a very interesting project, I have waited for something like this since the use of logs was established. Let’s just hope it doesn’t go the way of metacritic, where a single number has way too much weight on the assessment of quality/performance.

For instance, I noticed the Prem/Div 1 Spies are ranked all over the place. Spy is arguably one of the hardest classes to asses using numbers, though. And it might be for other reasons like recent inactivity.

The current rating system uses several metrics (which vary by class) and is probably going to head into the direction of using more rather than less as long as it doesn’t compromise accuracy, as this makes it far harder to game.

Variation in player ranking is down to a lot of factors, not playing particularly seriously being a very large one. There are a handful of players I’m in contact with who (having seen their lowly spot) have been keening it up to maximise their rankings over the last few days with considerable success.

Anyone who’s not happy with where they are should try stringing a handful of lobbies together where they determinedly kick ass and see where they end up. One thing I might increase is the strength of the inactivity decay effect.

Also bear in mind that it’s only in beta and making it public is an important part of the development process, I’ve received several bits of grumpy feedback that have already proved useful in planning new improvements.

Quoted from Kaneco

hey Jon, just wanna clear up some stuff…

I don’t want to get too far into specifics, there are problems with applying win/loss in TF2 without looking at individual performance, and at the same time there are ways of winning that don’t always produce great stats.

I’ve tried, and continue to refine attempts, to ensure players who win ugly aren’t unduly punished but at the same time I’m restricted by the original goals which are to identify and compensate for blatant imbalance in lobbies, so anything that makes those attempts less effective I can’t use, even if it seems fairer.

Sorry it’s a bit wishy washy, I used a very similar system to look at player performances in Season 19 and Rising and T-Mac routinely outscored several pocket soldiers from other teams, although I never made the direct comparison between the roles, so things aren’t stacked entirely against the roaming soldiers.

Quoted from Kaneco

I kinda get the gist of what you’re saying, this is originally a concept for player ranking not team ranking, and you dont wanna deviate much from that, but I still think in the end, the game result should be a big factor to consider, no matter what statistical representation your performance has on the logs, as it can be deceiving in some cases such as the one stated above.

I’m not telling you it isn’t taken into account, I’m also not telling you it is taken into account, I’m not going to give away anything that let’s people game things more easily. My point about the quality of the rating doesn’t mean it has to be biased excessively towards individuals, but changes have to adhere to specific measured goals so team measurements are fine as long as they don’t cause a problem with that. I personally am neutral within the bounds of those measures.

I don’t think I’m punishing players who play non-pocketed roles unfairly, but drawing the line at when a roamer is being sacrificial and when they are being shit is not easily done, ask 10 players and you’ll get 10 different answers, so I think the mathematical guides I’m using are the most neutral measures I’ll get. If the question is whether I experiment with measures that should help players who don’t chase stats to win, the answer is yes.

I’m aware that in an ideal world I’d be able to publish it and no one would be able to game it anyway, but that’s not the current situation.

Quoted from Gentleman Jon

[reply to my post]

All fair points, if you are aware of this all is good.
I’m not particularly surprised about my low ranking either, I haven’t played many lobbies in the last months anyway. I hope you didn’t count me to the grumpy feedback people, that was not my intention :D

Looking forward to how it turns out, great job so far!

UPDATE:
You can now login via steam and update your name! It’s a bit of a rush job but it should help anyone who’s not happy with what they’re currently called on the site. There will probably be a bit of lag between the update and your name changing in the ranking lists. It seems to be working for people but if you get any problems let me know.

http://beta.tf2playerrankings.com/

I’m really waiting for the feature where you can track your rank progress over time, that would be neat

A few minor but useful site updates have been made. If you’re logged in and your profile isn’t private then your friends list will be displayed on the right to make it easier for you to see how your steam friends are doing.

Under the player search recent popular searches are now displayed.

Finally in the player profile window a player’s position in the list can be clicked to show the context of their ranking, and who is currently around them. You can also use urls generated from these links to link straight to a specific results page. For example

http://beta.tf2playerrankings.com/#/site/1/class/3/page/3

Links to page 4 of the scouts on TF2 Pickup without having to navigate to it first.