Biographer Bistro (kibitz #9574)

<Q - How does <ChessBase> database software handle illegal PGN?>

I only run <CBLight 2009>, and it seems to just try to load the PGN in as best it can. But it seems to neglect informing me of these errors.

<CG> has (or had) at least 70 illegal games with illegal PGN.

I feel that some systematic screening should be done before such games get introduced into the database. The fact that there are "corrupt" games suggests to me that no such safeguards are in place.

It's important for several reasons.

<1) As a database server to your customers and community at large, all the games should have legal PGN.>

This isn't too hard a task, with programs like SCID it's automatic. Just load a submission in, and get a pass/fail vote.

<2) Legal pgn is required to actually play over the games with pgn4web.>

Some mistakes it allows, but many it doesn't.

<3) There is a standard to meet when matched against your competition (or whatever is the proper term).>

I have never (or almost never) found an illegal game from <ChessTempo>, <Carolus>, <MarkWeeks>, <TWIC>, <Chessbase>, <365chess>.

I have never found (or almost never) found illegal PGN in any of the massive collections of games from <MillBase> (katar), <Enormous> (Hyatt) or <ICOfY> (now defunct).

I have very rarely found any illegal PGN in <RUSbase> (al20102007.nimrod.ru).

Although the percentage is low, the number of games is high, ~70 in <CG>'s database.

<4) Submissions with illegal PGN can also indicate that closer scrutiny of the validity of the scores is needed.>

Of course some of the illegal PGN is truly trivial, obvious, and easily fixed.

That would include pawn promotion (e8(Q) being illegal). Or using [] instead of {}, or SCID's picky complaint about bad token input (e.g. 1.e4! vs. correct 1.e4 !, etc.

But the standard is the standard, and erring on the side of strictness is better right? And it's very easy to fix.

But, on the other hand, there is one tournament with 9 ! illegal games on <CG>. And it seems at least one of the games has several bad moves in the score.

Having so much bad PGN calls into queston the reliability of the entire submission.

Another example is where the king gives check to another king directly (not via discovered check), e.g. 57.Ke4+ or whatever. Now, we all like a fighting king in the middle of the board, but not to that extent. We know that the score is off somehow.

<Q - How can <CG> even detect those games in its database with illegal PGN.>

This is one reason why I asked about <Chessbase>. I had assumed it was one of your tools, since it's widely accepted within the "industry".

Me, I use <CGlight 2009> as mentioned several times. I also have a old copy of <Fritz 12>. They're good, but not as capable as the true <Chessbase> professional version.

On the other hand, my preference is for SCID. I know it better from using it everyday, and I can point out several functions that I think it does better than my versions of <CB>.

One of which is detecting, and importantly, reporting, illegal PGN.

One other feature it has, but I don't know if <CB> has, is the ability to script with it.

I love doggerel,

when told rather well,

deliciously swell,

even if cartel,

so let's all revel,

and my dear marcel,

misdemeanor or felony PGN?>

Maybe the kind that causes Windows to tell you, "You have attempted an illegal operation. Please remain where you are and do nothing else until help arrives."