Page 3 of 15

Re: ECF Grading Proposals

Posted: Mon Mar 04, 2019 8:11 pm
by Maurice Lawson
No one has a constant playing strength - our performance changes regularly. No one should be given grading points for free - we need to earn them by our performance.

Re: ECF Grading Proposals

Posted: Mon Mar 04, 2019 8:36 pm
by NickFaulks
Maurice Lawson wrote:
Mon Mar 04, 2019 8:11 pm
No one has a constant playing strength - our performance changes regularly.
Underlying playing strength certainly can be constant, performance varies around it. Why should a player be rewarded solely for variability of performance?

Re: ECF Grading Proposals

Posted: Mon Mar 04, 2019 8:39 pm
by Maurice Lawson
Because that's exactly what ratings should be about! Measurement of performance!

Re: ECF Grading Proposals

Posted: Mon Mar 04, 2019 8:50 pm
by NickFaulks
Maurice Lawson wrote:
Mon Mar 04, 2019 8:39 pm
Because that's exactly what ratings should be about! Measurement of performance!
But that is precisely and deliberately what this isn't.

Re: ECF Grading Proposals

Posted: Mon Mar 04, 2019 9:18 pm
by David Sedgwick
NickFaulks wrote:
Mon Mar 04, 2019 8:36 pm
Underlying playing strength certainly can be constant, performance varies around it. Why should a player be rewarded solely for variability of performance?
By the same token, why should a player be punished solely for variability of performance?

Yet that is what the FIDE Rating system, for which you are now responsible, does to new players seeking their first FIDE ratings.

Re: ECF Grading Proposals

Posted: Mon Mar 04, 2019 9:31 pm
by NickFaulks
David Sedgwick wrote:
Mon Mar 04, 2019 9:18 pm
By the same token, why should a player be punished solely for variability of performance?
It is freely acknowledged that initial ratings are the one area of the current FIDE rating System where significant improvement is required. No simple solutions seem to help, and there may be no alternative to something more complicated. This is a major decision.

Re: ECF Grading Proposals

Posted: Tue Mar 05, 2019 8:09 am
by Brian Valentine
NickFaulks wrote:
Mon Mar 04, 2019 7:35 pm
The k factor will be 20 except that in a month where a junior player has outperformed expectation, then the k factor will be 40.
My impression based on a few seconds of mental arithmetic is that a junior whose playing strength is constant and who plays ten games each month might be expected to gain 100-150 points per annum from this rule. If that is our desired result, why not just give them the extra points and be done with it?
After spending many months looking at the data, I think the hypothesis that juniors tend to improve is conclusively proved against the alternate that playing strength is constant. Based on this conclusion it then becomes a question of how to recognise this in the system where a lot of junior results are against other juniors. Earning the grade improvement seems to be a good idea as opposed to "just give them extra points".

Brian Valentine
Manager of ECF Grading

Re: ECF Grading Proposals

Posted: Tue Mar 05, 2019 8:44 am
by Kevin Thurlow
"After spending many months looking at the data, I think the hypothesis that juniors tend to improve is conclusively proved against the alternate that playing strength is constant."

Are you sure? Admittedly it was many years ago, but I took a small sample of juniors (about the first 30 pages of the grading list) and discovered that on average juniors went up slightly. Obviously some went up (some dramatically so), some went down, but what tended to happen is that the ones who started to get lower grades, gave up, therefore removing themselves from the calculation.

I am sure you thought of that!

Re: ECF Grading Proposals

Posted: Tue Mar 05, 2019 9:59 am
by Alex Holowczak
Kevin Thurlow wrote:
Tue Mar 05, 2019 8:44 am
"After spending many months looking at the data, I think the hypothesis that juniors tend to improve is conclusively proved against the alternate that playing strength is constant."

Are you sure? Admittedly it was many years ago, but I took a small sample of juniors (about the first 30 pages of the grading list) and discovered that on average juniors went up slightly. Obviously some went up (some dramatically so), some went down, but what tended to happen is that the ones who started to get lower grades, gave up, therefore removing themselves from the calculation.

I am sure you thought of that!
On the other hand, you have high-graded juniors leaving the system at age 18, and low-graded juniors joining the system very young. So don't they cancel each other out?

Re: ECF Grading Proposals

Posted: Tue Mar 05, 2019 10:17 am
by Roger de Coverly
Alex Holowczak wrote:
Tue Mar 05, 2019 9:59 am
On the other hand, you have high-graded juniors leaving the system at age 18, and low-graded juniors joining the system very young. So don't they cancel each other out?
The key point, as perhaps established by the BCF graders 50 years ago when 5 and later 10 points started to be added to junior grades as directly calculated, is that when playing adult players, there needs to be an inflationary measure so that the players in the pool of adults don't find their grades reducing for no good reason as at least some of the juniors are going to have grades below their current playing strength. Most national Elo systems have felt the need to adjust for this in some arbitrary manner. Even the international system attempts to do so with the K=40 rule.

Re: ECF Grading Proposals

Posted: Tue Mar 05, 2019 10:54 am
by NickFaulks
Roger de Coverly wrote:
Tue Mar 05, 2019 10:17 am
Even the international system attempts to do so with the K=40 rule.
If your are suggesting this was intended as an inflationary measure, then you are mistaken. The k factor represents a tradeoff between two risks

1. The player's strength is changing but the system does not reflect that quickly enough, and

2. The player's strength is not changing but the system reflects random fluctuations in results.

It seems plausible, and is supported by evidence, that juniors are more likely than adults to experience genuine changes in playing strength ( typically up, but also down ). The different k factor is therefore statistically justified.

Re: ECF Grading Proposals

Posted: Tue Mar 05, 2019 11:26 am
by Kevin Thurlow
"On the other hand, you have high-graded juniors leaving the system at age 18, and low-graded juniors joining the system very young. So don't they cancel each other out?"

Probably - but that wasn't so much the case then.

Re: ECF Grading Proposals

Posted: Tue Mar 05, 2019 1:44 pm
by Brian Valentine
Kevin Thurlow wrote:
Tue Mar 05, 2019 8:44 am
"After spending many months looking at the data, I think the hypothesis that juniors tend to improve is conclusively proved against the alternate that playing strength is constant."

Are you sure? ....
Being sure is not a concept fitting with statistics theory!

It is clear from both senior and junior data that weaker players are more likely to drop out. On its own this would lead to the average of the remainers to be higher than the bigger initial list.

However I regularly see big improvements in the 3Rs from pupils in our local school. This is essentially a closed set albeit with a strong focus on improvement. This lends weight to the view that juniors might tend to improve at chess.

What I can see is that between July 2018 and January 2019 those juniors in both lists improved by 4 grading points (about 30 Elo in six months -pretty consistent with the last 10 years). We have no evidence on those leaving the list, but I would think it perverse that their change in ability was/would have been backwards enough to counter balance the observed improvements.

You can decide whether whether that is conclusive enough for you.

Re: ECF Grading Proposals

Posted: Tue Mar 05, 2019 7:07 pm
by Kevin Thurlow
"Being sure is not a concept fitting with statistics theory!"

That's true! I'm happy to bow to your statistical knowledge.

Re: ECF Grading Proposals

Posted: Wed Mar 06, 2019 12:48 am
by Roger de Coverly
Someone seems to have got in mind that there's an ECF proposal to delay the publication of July/August grades in the traditional format. If true this has a knock on effect on those leagues that have grading restrictions as clubs wouldn't know what teams they could enter.

You might hope the ECF wouldn't be so stupid, but then ...

A clarification that grades in the existing format will be published to the usual schedules in July/August 2019 might be welcome.