Junior half year grades

Request amendments or pass comments on this free service.
Neill Cooper
Posts: 1298
Joined: Sun Feb 24, 2008 4:43 pm
Location: Cumbria

Junior half year grades

Post by Neill Cooper » Thu Jan 14, 2010 8:48 pm

The new junior grades are producing erratic results, particularly for those who don't play 30 games:
One example, an improving junior has just got a very dispiriting grade change of -30:

Category Standard Category Rapid
Jan 2010 ... ... ... ... B 111
July 2009 A 137... ... B 141
Jan 2009 ... ... ... ... B 85
July 2008 A ..79... ... C 73

Is there going to be a review of the new method of producing junior grades?

User avatar
Carl Hibbard
Posts: 6028
Joined: Fri Dec 08, 2006 8:05 pm
Location: Evesham

Re: Junior half year grades

Post by Carl Hibbard » Thu Jan 14, 2010 9:25 pm

Neill Cooper wrote:One example, an improving junior has just got a very dispiriting grade change of -30
I see you have raised this via the feedback form Neill, so I would appreciate you also posting the follow up on that when you receive it...
Neill Cooper wrote:Is there going to be a review of the new method of producing junior grades?
I cannot comment on that one sorry!
Cheers
Carl Hibbard

Neill Cooper
Posts: 1298
Joined: Sun Feb 24, 2008 4:43 pm
Location: Cumbria

Re: Junior half year grades

Post by Neill Cooper » Fri Jan 15, 2010 5:55 pm

Carl Hibbard wrote:
Neill Cooper wrote:One example, an improving junior has just got a very dispiriting grade change of -30
I see you have raised this via the feedback form Neill, so I would appreciate you also posting the follow up on that when you receive it...
It is not the sort of thing that the grading officer deals with. I should raise it directly with the Manager of Grading or the Home Director.

User avatar
Carl Hibbard
Posts: 6028
Joined: Fri Dec 08, 2006 8:05 pm
Location: Evesham

Re: Junior half year grades

Post by Carl Hibbard » Fri Jan 15, 2010 5:58 pm

Neill Cooper wrote:It is not the sort of thing that the grading officer deals with. I should raise it directly with the Manager of Grading or the Home Director.
Ok...
Cheers
Carl Hibbard

Neill Cooper
Posts: 1298
Joined: Sun Feb 24, 2008 4:43 pm
Location: Cumbria

Re: Junior half year grades

Post by Neill Cooper » Fri Jan 15, 2010 6:18 pm

A bit more analysis shows:
In 2008 list 40 adults and 4 juniors had their Rapidplay grade go down by more than 10 points
In 2009 list 57 adults and 89 juniors had their Rapidplay grade go down by more than 10 points

So no great change for the adults, but a dramatic increase in the number of juniors with significantly falling grades

Roger de Coverly
Posts: 21301
Joined: Tue Apr 15, 2008 2:51 pm

Re: Junior half year grades

Post by Roger de Coverly » Fri Jan 15, 2010 6:26 pm

Neill Cooper wrote: So no great change for the adults, but a dramatic increase in the number of juniors with significantly falling grades
Entirely to be expected as the system for juniors has weighted the balance between lag and randomness much more in the direction of randomness.

To amplify this, all grades are potentially wrong so if you get results which don't agree with the previous published grades, do you
(a) presume the results to be random fluctuations and make a small change to the previous grade
or
(b) presume the previous grade to be incorrect and make a large change to the previous grade.

Alex Holowczak
Posts: 9085
Joined: Sat May 30, 2009 5:18 pm
Location: Oldbury, Worcestershire

Re: Junior half year grades

Post by Alex Holowczak » Fri Jan 15, 2010 6:43 pm

Roger de Coverly wrote:
Neill Cooper wrote: So no great change for the adults, but a dramatic increase in the number of juniors with significantly falling grades
Entirely to be expected as the system for juniors has weighted the balance between lag and randomness much more in the direction of randomness.

To amplify this, all grades are potentially wrong so if you get results which don't agree with the previous published grades, do you
(a) presume the results to be random fluctuations and make a small change to the previous grade
or
(b) presume the previous grade to be incorrect and make a large change to the previous grade.
or
(c) Forget about it and just play the game for fun? :roll:

Perhaps that is too idealistic.

Brian Valentine
Posts: 574
Joined: Fri Apr 03, 2009 1:30 pm

Re: Junior half year grades

Post by Brian Valentine » Fri Jan 15, 2010 8:12 pm

Alex,
I'm playing for fun tomorrow, tonight I'm looking at this thorny issue.

Roger,
I think there is a deeper point in Neill's issue. Overall those juniors with grades for both periods have increased their sum of grades. However those going down are roughly in the ratio of 5 for every 4 increasing, on adults it's more like 2-1 . There is the feature in a milder form in the long play changes. The situation is very difficult to pin down because of the high number of players who only appear in one of the two lists and therefore may be changing the strength of the pool. However one measure of deflation might be that the average grade (sum of grades/# of players) is falling which it is with the junior rapid play grades for those involved.

There are other measures of deflation, but on the face of it based rapid play grading list, there is evidence that people playing rapid play are getting weaker.

Roger de Coverly
Posts: 21301
Joined: Tue Apr 15, 2008 2:51 pm

Re: Junior half year grades

Post by Roger de Coverly » Fri Jan 15, 2010 9:32 pm

Brian Valentine wrote:
There are other measures of deflation, but on the face of it based rapid play grading list, there is evidence that people playing rapid play are getting weaker.
I thought that general reasoning had established that the "new" method of grading juniors is unstable. Is this perhaps a correction factor from the 2009 grades being too compressed (or over inflated).

User avatar
David Shepherd
Posts: 912
Joined: Fri Nov 23, 2007 3:46 pm

Re: Junior half year grades

Post by David Shepherd » Fri Jan 15, 2010 9:45 pm

My guess is that the grade change now is highly dependent on the strength of the opposition played for juniors (particulary those playing less than 30 games in a season) and the weaker the tournament they play in relative to their grade the more likely their grade is to fall as they in effect lose the 40 point protection from their previous grade. In rapidplay games they are more likely to produce a slip than in standard games and this has a snowball effect dragging down their grade but also the average grade for the year on which the 40 points rule is calculated.

If a player with a grade of 160 plays one tournament all against players of 190 say and loses all 6 games and 3 tournaments against players graded 90 say and wins all 18 games I think their grade as a new player under the new system would be less than 140 or 140?

Under the old system it would be ((170 x18) + (140x6))=163

Although the above is an extreme example it is my interpretation of what is happening.

Brian Valentine
Posts: 574
Joined: Fri Apr 03, 2009 1:30 pm

Re: Junior half year grades

Post by Brian Valentine » Fri Jan 15, 2010 10:13 pm

Roger,
I agree the process is unstable, especially when juniors may even be in the majority (depending on the influence of entrants and leavers. However I think Neill is pointing out another issue in that more players (that are measured) are declined than those who have grading increases. This is consistent with those playing most games being those who have rising grades.

This situation may or may not represent the reality. But it doesn't do much to enthuse the next generation of chessplayers.

User avatar
David Shepherd
Posts: 912
Joined: Fri Nov 23, 2007 3:46 pm

Re: Junior half year grades

Post by David Shepherd » Fri Jan 15, 2010 11:48 pm

My posting above is wrong forgot about the itterations - tired, but the really sad thing is that I don't really understand the new player process enough to work out what the grade would be in my example. Does anyone know? I know it is probably a stupid example but what is the answer anyone :-( ?

Sean Hewitt

Re: Junior half year grades

Post by Sean Hewitt » Sat Jan 16, 2010 8:28 am

David Shepherd wrote:My posting above is wrong forgot about the itterations - tired, but the really sad thing is that I don't really understand the new player process enough to work out what the grade would be in my example. Does anyone know? I know it is probably a stupid example but what is the answer anyone :-( ?
I believe the answer is 163 (isn't it) as the process for calculating performance has not changed as far as I am aware. If the graded players were juniors then you would be unable to calculate the performance (and therefore the grade) at all.

E Michael White
Posts: 1420
Joined: Fri Jun 01, 2007 6:31 pm

Re: Junior half year grades

Post by E Michael White » Sat Jan 16, 2010 10:56 am

If I've thought this through correctly a juniors grade under the iterative basis is made up of a performance bit plus a weighted average of previous grades of some graded players, not necessarily just the juniors own rated opponents. The weights will sum to 1 and the average at present appear to be something sensible like 100 or 170. However the performance related bit is not restricted to -50 -> +50 as it brings in the performance of opponents and performance of opponents of opponents etc. The performance bit may stack up by a series of +ve or -ve parts and produce very high or very low grades depending on who the juniors opponents are. At some stage a junior grade of +300 and substantial negative grades are not unlikely.
Last edited by E Michael White on Sat Jan 16, 2010 11:06 am, edited 1 time in total.

Neill Cooper
Posts: 1298
Joined: Sun Feb 24, 2008 4:43 pm
Location: Cumbria

Re: Junior half year grades

Post by Neill Cooper » Sat Jan 16, 2010 11:05 am

Brian Valentine wrote:Roger,
I agree the process is unstable, especially when juniors may even be in the majority (depending on the influence of entrants and leavers. However I think Neill is pointing out another issue in that more players (that are measured) are declined than those who have grading increases. This is consistent with those playing most games being those who have rising grades.

This situation may or may not represent the reality. But it doesn't do much to enthuse the next generation of chessplayers.
The main point I am making is under the previous system junior grades were stable and therefore could useful to indicate their progress. Junior grades are now unstable as not only is their old grade ignored, but for those who play less games only a maximum of 20 games are used not 30. The result is that some junior were either overgraded last time or undergraded this time, or both. Felix Ynojosa has dropped 12 points, Maria Wang 20 points.

[Edited to correct name]
Last edited by Neill Cooper on Sat Jan 16, 2010 12:55 pm, edited 1 time in total.