ECF Grading Proposals

General discussions about ratings.
Maurice Lawson
Posts: 23
Joined: Sun Apr 05, 2015 10:38 pm

Re: ECF Grading Proposals

Post by Maurice Lawson » Mon Mar 04, 2019 8:11 pm

No one has a constant playing strength - our performance changes regularly. No one should be given grading points for free - we need to earn them by our performance.

NickFaulks
Posts: 8453
Joined: Sat Jan 02, 2010 1:28 pm

Re: ECF Grading Proposals

Post by NickFaulks » Mon Mar 04, 2019 8:36 pm

Maurice Lawson wrote:
Mon Mar 04, 2019 8:11 pm
No one has a constant playing strength - our performance changes regularly.
Underlying playing strength certainly can be constant, performance varies around it. Why should a player be rewarded solely for variability of performance?
If you want a picture of the future, imagine a QR code stamped on a human face — forever.

Maurice Lawson
Posts: 23
Joined: Sun Apr 05, 2015 10:38 pm

Re: ECF Grading Proposals

Post by Maurice Lawson » Mon Mar 04, 2019 8:39 pm

Because that's exactly what ratings should be about! Measurement of performance!

NickFaulks
Posts: 8453
Joined: Sat Jan 02, 2010 1:28 pm

Re: ECF Grading Proposals

Post by NickFaulks » Mon Mar 04, 2019 8:50 pm

Maurice Lawson wrote:
Mon Mar 04, 2019 8:39 pm
Because that's exactly what ratings should be about! Measurement of performance!
But that is precisely and deliberately what this isn't.
If you want a picture of the future, imagine a QR code stamped on a human face — forever.

David Sedgwick
Posts: 5249
Joined: Mon Apr 09, 2007 5:56 pm
Location: Croydon
Contact:

Re: ECF Grading Proposals

Post by David Sedgwick » Mon Mar 04, 2019 9:18 pm

NickFaulks wrote:
Mon Mar 04, 2019 8:36 pm
Underlying playing strength certainly can be constant, performance varies around it. Why should a player be rewarded solely for variability of performance?
By the same token, why should a player be punished solely for variability of performance?

Yet that is what the FIDE Rating system, for which you are now responsible, does to new players seeking their first FIDE ratings.

NickFaulks
Posts: 8453
Joined: Sat Jan 02, 2010 1:28 pm

Re: ECF Grading Proposals

Post by NickFaulks » Mon Mar 04, 2019 9:31 pm

David Sedgwick wrote:
Mon Mar 04, 2019 9:18 pm
By the same token, why should a player be punished solely for variability of performance?
It is freely acknowledged that initial ratings are the one area of the current FIDE rating System where significant improvement is required. No simple solutions seem to help, and there may be no alternative to something more complicated. This is a major decision.
If you want a picture of the future, imagine a QR code stamped on a human face — forever.

Brian Valentine
Posts: 574
Joined: Fri Apr 03, 2009 1:30 pm

Re: ECF Grading Proposals

Post by Brian Valentine » Tue Mar 05, 2019 8:09 am

NickFaulks wrote:
Mon Mar 04, 2019 7:35 pm
The k factor will be 20 except that in a month where a junior player has outperformed expectation, then the k factor will be 40.
My impression based on a few seconds of mental arithmetic is that a junior whose playing strength is constant and who plays ten games each month might be expected to gain 100-150 points per annum from this rule. If that is our desired result, why not just give them the extra points and be done with it?
After spending many months looking at the data, I think the hypothesis that juniors tend to improve is conclusively proved against the alternate that playing strength is constant. Based on this conclusion it then becomes a question of how to recognise this in the system where a lot of junior results are against other juniors. Earning the grade improvement seems to be a good idea as opposed to "just give them extra points".

Brian Valentine
Manager of ECF Grading

Kevin Thurlow
Posts: 5821
Joined: Wed Apr 30, 2008 12:28 pm

Re: ECF Grading Proposals

Post by Kevin Thurlow » Tue Mar 05, 2019 8:44 am

"After spending many months looking at the data, I think the hypothesis that juniors tend to improve is conclusively proved against the alternate that playing strength is constant."

Are you sure? Admittedly it was many years ago, but I took a small sample of juniors (about the first 30 pages of the grading list) and discovered that on average juniors went up slightly. Obviously some went up (some dramatically so), some went down, but what tended to happen is that the ones who started to get lower grades, gave up, therefore removing themselves from the calculation.

I am sure you thought of that!

Alex Holowczak
Posts: 9085
Joined: Sat May 30, 2009 5:18 pm
Location: Oldbury, Worcestershire
Contact:

Re: ECF Grading Proposals

Post by Alex Holowczak » Tue Mar 05, 2019 9:59 am

Kevin Thurlow wrote:
Tue Mar 05, 2019 8:44 am
"After spending many months looking at the data, I think the hypothesis that juniors tend to improve is conclusively proved against the alternate that playing strength is constant."

Are you sure? Admittedly it was many years ago, but I took a small sample of juniors (about the first 30 pages of the grading list) and discovered that on average juniors went up slightly. Obviously some went up (some dramatically so), some went down, but what tended to happen is that the ones who started to get lower grades, gave up, therefore removing themselves from the calculation.

I am sure you thought of that!
On the other hand, you have high-graded juniors leaving the system at age 18, and low-graded juniors joining the system very young. So don't they cancel each other out?

Roger de Coverly
Posts: 21301
Joined: Tue Apr 15, 2008 2:51 pm

Re: ECF Grading Proposals

Post by Roger de Coverly » Tue Mar 05, 2019 10:17 am

Alex Holowczak wrote:
Tue Mar 05, 2019 9:59 am
On the other hand, you have high-graded juniors leaving the system at age 18, and low-graded juniors joining the system very young. So don't they cancel each other out?
The key point, as perhaps established by the BCF graders 50 years ago when 5 and later 10 points started to be added to junior grades as directly calculated, is that when playing adult players, there needs to be an inflationary measure so that the players in the pool of adults don't find their grades reducing for no good reason as at least some of the juniors are going to have grades below their current playing strength. Most national Elo systems have felt the need to adjust for this in some arbitrary manner. Even the international system attempts to do so with the K=40 rule.

NickFaulks
Posts: 8453
Joined: Sat Jan 02, 2010 1:28 pm

Re: ECF Grading Proposals

Post by NickFaulks » Tue Mar 05, 2019 10:54 am

Roger de Coverly wrote:
Tue Mar 05, 2019 10:17 am
Even the international system attempts to do so with the K=40 rule.
If your are suggesting this was intended as an inflationary measure, then you are mistaken. The k factor represents a tradeoff between two risks

1. The player's strength is changing but the system does not reflect that quickly enough, and

2. The player's strength is not changing but the system reflects random fluctuations in results.

It seems plausible, and is supported by evidence, that juniors are more likely than adults to experience genuine changes in playing strength ( typically up, but also down ). The different k factor is therefore statistically justified.
If you want a picture of the future, imagine a QR code stamped on a human face — forever.

Kevin Thurlow
Posts: 5821
Joined: Wed Apr 30, 2008 12:28 pm

Re: ECF Grading Proposals

Post by Kevin Thurlow » Tue Mar 05, 2019 11:26 am

"On the other hand, you have high-graded juniors leaving the system at age 18, and low-graded juniors joining the system very young. So don't they cancel each other out?"

Probably - but that wasn't so much the case then.

Brian Valentine
Posts: 574
Joined: Fri Apr 03, 2009 1:30 pm

Re: ECF Grading Proposals

Post by Brian Valentine » Tue Mar 05, 2019 1:44 pm

Kevin Thurlow wrote:
Tue Mar 05, 2019 8:44 am
"After spending many months looking at the data, I think the hypothesis that juniors tend to improve is conclusively proved against the alternate that playing strength is constant."

Are you sure? ....
Being sure is not a concept fitting with statistics theory!

It is clear from both senior and junior data that weaker players are more likely to drop out. On its own this would lead to the average of the remainers to be higher than the bigger initial list.

However I regularly see big improvements in the 3Rs from pupils in our local school. This is essentially a closed set albeit with a strong focus on improvement. This lends weight to the view that juniors might tend to improve at chess.

What I can see is that between July 2018 and January 2019 those juniors in both lists improved by 4 grading points (about 30 Elo in six months -pretty consistent with the last 10 years). We have no evidence on those leaving the list, but I would think it perverse that their change in ability was/would have been backwards enough to counter balance the observed improvements.

You can decide whether whether that is conclusive enough for you.

Kevin Thurlow
Posts: 5821
Joined: Wed Apr 30, 2008 12:28 pm

Re: ECF Grading Proposals

Post by Kevin Thurlow » Tue Mar 05, 2019 7:07 pm

"Being sure is not a concept fitting with statistics theory!"

That's true! I'm happy to bow to your statistical knowledge.

Roger de Coverly
Posts: 21301
Joined: Tue Apr 15, 2008 2:51 pm

Re: ECF Grading Proposals

Post by Roger de Coverly » Wed Mar 06, 2019 12:48 am

Someone seems to have got in mind that there's an ECF proposal to delay the publication of July/August grades in the traditional format. If true this has a knock on effect on those leagues that have grading restrictions as clubs wouldn't know what teams they could enter.

You might hope the ECF wouldn't be so stupid, but then ...

A clarification that grades in the existing format will be published to the usual schedules in July/August 2019 might be welcome.

Post Reply