Page 1 of 1

Tournament Pgn Files

Posted: Sun Jan 21, 2018 3:05 pm
by Joey Stewart
Why is it that so many tournament pgn files are full of garbage? I enclose an example (one of many) of the junk that pads out the pgn files of many respectable tournaments.

[Event "Hastings Masters"]
[Site "Horntye, Hastings"]
[Date "2018.01.02"]
[Round "6.2"]
[White "Gormally, Daniel W"]
[Black "Fier, Alexandr"]
[Result "1-0"]
[BlackElo "2576"]
[WhiteElo "2477"]
[LiveChessVersion "1.4.8"]
[ECO "A48"]

1. d4 {[%clk 1:40:58]} Nf6 {[%clk 1:40:45]} 2. Nf3 {[%clk 1:41:14]} g6
{[%clk 1:41:11]} 3. Bg5 {[%clk 1:40:02]} Bg7 {[%clk 1:41:36]} 4. Nbd2
{[%clk 1:39:48]} O-O {[%clk 1:41:59]} 5. e4 {[%clk 1:37:17]} d5 {[%clk 1:42:25]}
6. exd5 {[%clk 1:36:56]} Nxd5 {[%clk 1:42:49]} 7. Nb3 {[%clk 1:35:59]} a5
{[%clk 1:40:25]} 8. a4 {[%clk 1:35:16]} h6 {[%clk 1:40:50]} 9. Bd2
{[%clk 1:32:10]} Nc6 {[%clk 1:41:09]} 10. Bb5 {[%clk 1:30:16]} Ncb4
{[%clk 1:38:49]} 11. c3 {[%clk 1:26:30]} c6 {[%clk 1:39:15]} 12. Be2
{[%clk 1:26:13]} Na6 {[%clk 1:39:42]} 13. O-O {[%clk 1:25:43]} b6
{[%clk 1:36:59]} 14. Re1 {[%clk 1:25:07]} c5 {[%clk 1:35:35]} 15. Bd3
{[%clk 1:15:16]} cxd4 {[%clk 1:35:28]} 16. Nbxd4 {[%clk 1:15:38]} Nc5
{[%clk 1:32:18]} 17. Bc2 {[%clk 1:10:54]} Bb7 {[%clk 1:32:38]} 18. Ne5
{[%clk 1:09:26]} Rc8 {[%clk 1:29:20]} 19. Ng4 {[%clk 1:01:11]} Kh7
{[%clk 1:20:39]} 20. Nxh6 {[%clk 0:59:05]} Nf6 {[%clk 1:21:05]} 21. Nhf5
{[%clk 0:46:11]} gxf5 {[%clk 1:21:19]} 22. Nxf5 {[%clk 0:44:25]} e6
{[%clk 1:20:17]} 23. Nxg7+ {[%clk 0:40:43]} Kxg7 {[%clk 1:20:09]} 24. Bh6+
{[%clk 0:41:08]} Kg8 {[%clk 1:17:33]} 25. Qc1 {[%clk 0:30:29]} Qd5
{[%clk 1:16:47]} 26. f3 {[%clk 0:30:53]} Nh5 {[%clk 1:04:40]} 27. Bxf8
{[%clk 0:29:41]} Kxf8 {[%clk 0:59:26]} 28. Qh6+ {[%clk 0:29:57]} Ng7
{[%clk 0:59:55]} 29. Qh8+ {[%clk 0:29:18]} Ke7 {[%clk 1:00:19]} 30. Qxg7
{[%clk 0:29:42]} Qd2 {[%clk 1:00:47]} 31. Rac1 {[%clk 0:25:20]} Rd8
{[%clk 1:01:13]} 32. Qg3 {[%clk 0:25:15]} Rd5 {[%clk 1:01:01]} 33. Qf2
{[%clk 0:22:33]} Qh6 {[%clk 1:01:26]} 34. Rcd1 {[%clk 0:22:57]} Rh5
{[%clk 1:01:52]} 35. Qd2 {[%clk 0:22:54]} 1-0


Not to knock the inputters, who do a fine job getting it all online, but I really do not see any purpose to all this weird code - is there any way to remove it without having to spend many hours cutting it out by hand?

Re: Tournament Pgn Files

Posted: Sun Jan 21, 2018 3:11 pm
by LawrenceCooper
Joey Stewart wrote: ↑
Sun Jan 21, 2018 3:05 pm
Why is it that so many tournament pgn files are full of garbage? I enclose an example (one of many) of the junk that pads out the pgn files of many respectable tournaments.

[Event "Hastings Masters"]
[Site "Horntye, Hastings"]
[Date "2018.01.02"]
[Round "6.2"]
[White "Gormally, Daniel W"]
[Black "Fier, Alexandr"]
[Result "1-0"]
[BlackElo "2576"]
[WhiteElo "2477"]
[LiveChessVersion "1.4.8"]
[ECO "A48"]

1. d4 {[%clk 1:40:58]} Nf6 {[%clk 1:40:45]} 2. Nf3 {[%clk 1:41:14]} g6
{[%clk 1:41:11]} 3. Bg5 {[%clk 1:40:02]} Bg7 {[%clk 1:41:36]} 4. Nbd2
{[%clk 1:39:48]} O-O {[%clk 1:41:59]} 5. e4 {[%clk 1:37:17]} d5 {[%clk 1:42:25]}
6. exd5 {[%clk 1:36:56]} Nxd5 {[%clk 1:42:49]} 7. Nb3 {[%clk 1:35:59]} a5
{[%clk 1:40:25]} 8. a4 {[%clk 1:35:16]} h6 {[%clk 1:40:50]} 9. Bd2
{[%clk 1:32:10]} Nc6 {[%clk 1:41:09]} 10. Bb5 {[%clk 1:30:16]} Ncb4
{[%clk 1:38:49]} 11. c3 {[%clk 1:26:30]} c6 {[%clk 1:39:15]} 12. Be2
{[%clk 1:26:13]} Na6 {[%clk 1:39:42]} 13. O-O {[%clk 1:25:43]} b6
{[%clk 1:36:59]} 14. Re1 {[%clk 1:25:07]} c5 {[%clk 1:35:35]} 15. Bd3
{[%clk 1:15:16]} cxd4 {[%clk 1:35:28]} 16. Nbxd4 {[%clk 1:15:38]} Nc5
{[%clk 1:32:18]} 17. Bc2 {[%clk 1:10:54]} Bb7 {[%clk 1:32:38]} 18. Ne5
{[%clk 1:09:26]} Rc8 {[%clk 1:29:20]} 19. Ng4 {[%clk 1:01:11]} Kh7
{[%clk 1:20:39]} 20. Nxh6 {[%clk 0:59:05]} Nf6 {[%clk 1:21:05]} 21. Nhf5
{[%clk 0:46:11]} gxf5 {[%clk 1:21:19]} 22. Nxf5 {[%clk 0:44:25]} e6
{[%clk 1:20:17]} 23. Nxg7+ {[%clk 0:40:43]} Kxg7 {[%clk 1:20:09]} 24. Bh6+
{[%clk 0:41:08]} Kg8 {[%clk 1:17:33]} 25. Qc1 {[%clk 0:30:29]} Qd5
{[%clk 1:16:47]} 26. f3 {[%clk 0:30:53]} Nh5 {[%clk 1:04:40]} 27. Bxf8
{[%clk 0:29:41]} Kxf8 {[%clk 0:59:26]} 28. Qh6+ {[%clk 0:29:57]} Ng7
{[%clk 0:59:55]} 29. Qh8+ {[%clk 0:29:18]} Ke7 {[%clk 1:00:19]} 30. Qxg7
{[%clk 0:29:42]} Qd2 {[%clk 1:00:47]} 31. Rac1 {[%clk 0:25:20]} Rd8
{[%clk 1:01:13]} 32. Qg3 {[%clk 0:25:15]} Rd5 {[%clk 1:01:01]} 33. Qf2
{[%clk 0:22:33]} Qh6 {[%clk 1:01:26]} 34. Rcd1 {[%clk 0:22:57]} Rh5
{[%clk 1:01:52]} 35. Qd2 {[%clk 0:22:54]} 1-0


Not to knock the inputters, who do a fine job getting it all online, but I really do not see any purpose to all this weird code - is there any way to remove it without having to spend many hours cutting it out by hand?
Isn't that taken direct from a live board rather than manually input?

Re: Tournament Pgn Files

Posted: Sun Jan 21, 2018 3:37 pm
by Paul Dargan
That just looks liek the time infor from the liveboards ..

Re: Tournament Pgn Files

Posted: Sun Jan 21, 2018 4:10 pm
by Alex Holowczak
This is a function of copying and pasting it from the liveboards.

I spend a lot of time at 4NCL pasting the moves minus the header into ChessBase, and if you paste in all these clock presses into a skeleton file, ChessBase won't recognise what you're pasting, so it'll leave them out. You then save it, and they're gone.

Re: Tournament Pgn Files

Posted: Sun Jan 21, 2018 8:15 pm
by E Michael White
Joey Stewart wrote: ↑
Sun Jan 21, 2018 3:05 pm
is there any way to remove it without having to spend many hours cutting it out by hand?
I might be saying the same thing as AH but in my old chessbase 10 this works:


right click on the database in the database window then click - convert to cbh

then if you want a cleaned up pgn database create a new empty PGN and copy the converted file into it.

I haven't checked whether the comments are dropped in the first or second step

Re: Tournament Pgn Files

Posted: Mon Jan 22, 2018 10:48 am
by Reg Clucas
It would be easy to write a simple script to remove the comments if you have the necessary programming skills.

Re: Tournament Pgn Files

Posted: Mon Jan 22, 2018 11:21 am
by Angus French
The weekly TWIC game files seem to be stripped of clock times.

Re: Tournament Pgn Files

Posted: Mon Jan 22, 2018 2:49 pm
by Geoff Chandler
Hi Angus

Just copied the PGN into Chesspad, then use 'Delete All Annotations.'
This clears out the junk. Took just a few seconds.
(Good Game, Was Danny in a wee bit of TT towards the end? 32. Rcd1!)

[Event "Hastings Masters"]
[Site "Horntye, Hastings"]
[Date "2018.01.02"]
[Round "6.2"]
[White "Gormally, Daniel W"]
[Black "Fier, Alexandr"]
[Result "1-0"]
[ECO "A48"]
[WhiteElo "2477"]
[BlackElo "2576"]
[LiveChessVersion "1.4.8"]

1. d4 Nf6 2. Nf3 g6 3. Bg5 Bg7 4. Nbd2 O-O 5. e4 d5 6. exd5 Nxd5 7. Nb3 a5 8. a4 h6 9. Bd2 Nc6 10. Bb5 Ncb4 11. c3 c6 12. Be2 Na6 13. O-O b6 14. Re1 c5 15. Bd3 cxd4 16. Nbxd4 Nc5 17. Bc2 Bb7 18. Ne5 Rc8 19. Ng4 Kh7 20. Nxh6 Nf6 21. Nhf5 gxf5 22. Nxf5 e6 23. Nxg7+ Kxg7 24. Bh6+ Kg8 25. Qc1 Qd5 26. f3 Nh5 27. Bxf8 Kxf8 28. Qh6+ Ng7 29. Qh8+ Ke7 30. Qxg7 Qd2 31. Rac1 Rd8 32. Qg3 Rd5 33. Qf2 Qh6 34. Rcd1 Rh5 35. Qd2 1-0



Re: Tournament Pgn Files

Posted: Tue Jan 23, 2018 10:25 pm
by Brian Towers
Geoff Chandler wrote: ↑
Mon Jan 22, 2018 2:49 pm
(Good Game, Was Danny in a wee bit of TT towards the end? 32. Rcd1!)
No. Check the original post for the pgn including clock times.

So, you see, Joey? They are useful. Just not to you.

Re: Tournament Pgn Files

Posted: Wed Jan 24, 2018 12:51 am
by Paolo Casaschi
Joey Stewart wrote: ↑
Sun Jan 21, 2018 3:05 pm
Why is it that so many tournament pgn files are full of garbage? I enclose an example (one of many) of the junk that pads out the pgn files of many respectable tournaments.

[Event "Hastings Masters"]
[Site "Horntye, Hastings"]
[Date "2018.01.02"]
[Round "6.2"]
[White "Gormally, Daniel W"]
[Black "Fier, Alexandr"]
[Result "1-0"]
[BlackElo "2576"]
[WhiteElo "2477"]
[LiveChessVersion "1.4.8"]
[ECO "A48"]

1. d4 {[%clk 1:40:58]} Nf6 {[%clk 1:40:45]} 2. Nf3 {[%clk 1:41:14]} g6
{[%clk 1:41:11]} 3. Bg5 {[%clk 1:40:02]} Bg7 {[%clk 1:41:36]} 4. Nbd2
{[%clk 1:39:48]} O-O {[%clk 1:41:59]} 5. e4 {[%clk 1:37:17]} d5 {[%clk 1:42:25]}
6. exd5 {[%clk 1:36:56]} Nxd5 {[%clk 1:42:49]} 7. Nb3 {[%clk 1:35:59]} a5
{[%clk 1:40:25]} 8. a4 {[%clk 1:35:16]} h6 {[%clk 1:40:50]} 9. Bd2
{[%clk 1:32:10]} Nc6 {[%clk 1:41:09]} 10. Bb5 {[%clk 1:30:16]} Ncb4
{[%clk 1:38:49]} 11. c3 {[%clk 1:26:30]} c6 {[%clk 1:39:15]} 12. Be2
{[%clk 1:26:13]} Na6 {[%clk 1:39:42]} 13. O-O {[%clk 1:25:43]} b6
{[%clk 1:36:59]} 14. Re1 {[%clk 1:25:07]} c5 {[%clk 1:35:35]} 15. Bd3
{[%clk 1:15:16]} cxd4 {[%clk 1:35:28]} 16. Nbxd4 {[%clk 1:15:38]} Nc5
{[%clk 1:32:18]} 17. Bc2 {[%clk 1:10:54]} Bb7 {[%clk 1:32:38]} 18. Ne5
{[%clk 1:09:26]} Rc8 {[%clk 1:29:20]} 19. Ng4 {[%clk 1:01:11]} Kh7
{[%clk 1:20:39]} 20. Nxh6 {[%clk 0:59:05]} Nf6 {[%clk 1:21:05]} 21. Nhf5
{[%clk 0:46:11]} gxf5 {[%clk 1:21:19]} 22. Nxf5 {[%clk 0:44:25]} e6
{[%clk 1:20:17]} 23. Nxg7+ {[%clk 0:40:43]} Kxg7 {[%clk 1:20:09]} 24. Bh6+
{[%clk 0:41:08]} Kg8 {[%clk 1:17:33]} 25. Qc1 {[%clk 0:30:29]} Qd5
{[%clk 1:16:47]} 26. f3 {[%clk 0:30:53]} Nh5 {[%clk 1:04:40]} 27. Bxf8
{[%clk 0:29:41]} Kxf8 {[%clk 0:59:26]} 28. Qh6+ {[%clk 0:29:57]} Ng7
{[%clk 0:59:55]} 29. Qh8+ {[%clk 0:29:18]} Ke7 {[%clk 1:00:19]} 30. Qxg7
{[%clk 0:29:42]} Qd2 {[%clk 1:00:47]} 31. Rac1 {[%clk 0:25:20]} Rd8
{[%clk 1:01:13]} 32. Qg3 {[%clk 0:25:15]} Rd5 {[%clk 1:01:01]} 33. Qf2
{[%clk 0:22:33]} Qh6 {[%clk 1:01:26]} 34. Rcd1 {[%clk 0:22:57]} Rh5
{[%clk 1:01:52]} 35. Qd2 {[%clk 0:22:54]} 1-0


Not to knock the inputters, who do a fine job getting it all online, but I really do not see any purpose to all this weird code - is there any way to remove it without having to spend many hours cutting it out by hand?
Why would you get rid of useful information such as the clock information during the game?
Any half-decent pgn viewer should be able to show you the relevant information, such as http://pgn4web.casaschi.net/viewer.php