< Earlier Kibitzing · PAGE 77 OF 79 ·
Later Kibitzing> |
Jan-16-12 | | timhortons: rajlich say something about free domain and that everybody is doin it, so rajlich cant be brought to the court of law for violating patent rights, if he can handle this mess, this could improve the popularity of his software, after all the battle ground of this issue is on blog sites and chess sites. |
|
Jan-16-12 | | chessexp: The code that Rajlich copied isn't covered by public domain. He copied from GPL programs, GPL is a clear and well known license. |
|
Jan-16-12 | | timhortons: how did you know its GPl, do you have any links to show us clearly indicating from reliable source that he use it? |
|
Jan-16-12 | | polarmis: Here's the pdf of the ICGA report: http://chessprogramming.wikispaces.... |
|
Jan-16-12 | | Marmot PFL: The funniest thing in the video is that sales of Rybka, which had slowed, got a big boost from all the publicity. |
|
Jan-16-12 | | drik: <Marmot PFL: The Shakespeare examples are interesting. How much of the material in his plays do you think originated with Shakespeare?> ...clearly not Richard III or Henry V (I wonder if they themselves should be coauthors)! But excluding the obvious, even the story of Macbeth (which I had to slog through) has it's origins in Raphael Holinshed's Chronicles of England, Scotland and Ireland. I guess if he had changed the name to MacSomethingElse, Levy would give it higher marks for orginality. At least then 'reverse engineering' Macbeth would be more difficult. |
|
Jan-16-12 | | drik: <polarmis: Still, that's the "creative" solution, not the "normal" one.> That was one of the two possible solutions considered - as stated by Levy. Nothing creative about it whatsoever. That decision could have been seamlessly extended to full disqualification, after further study. Instead they chose to burn their bridges, rather than keep their options open - which does not seem like 'normal' decision making to me. <You're inventing a narrative that never existed.> It is a narrative that circulated 'uncorrected' in the Rybka forums. <1)Which business model? As I understand it the ICGA isn't a "for-profit" organisation, more competition among chess engines > Why are non-commercial engines not in the tournament. Every hobbyist making rating lists includes them; but an official organisation chooses to ignore them. No comment? I suspect that there are various entry fees for the publicity - & the publicity is not positive if one guy keeps winning. As for 'not-for-profit', please check Levy's business history - say with Ray Keene. Read what his ex-wife has to say about him on the Keene page here. <Rybka's no longer the best engine around.> But it was the best commercial engine, when the letters about 'cloning' were circulated. |
|
Jan-16-12 | | polarmis: <drik>, I don't think there's any need to repeat myself on your first points. You can read more about the ICGA at their website: http://ilk.uvt.nl/icga/ or here: http://chessprogramming.wikispaces.... If you want to portray it as a commercial juggernaut threatened by Rybka I suppose you can, but that's just your fantasy. |
|
Jan-16-12 | | drik: <AylerKupp: What embarrassing dominance by Rybka? This may have been true several years ago (and I'm not sure about the "embarassing" part)> ...what embarrassing dominance? Four consecutive victories in the WCCC, with a likely fifth stopped by disqualification? You have to go back a quarter of century for back to back wins - & then they were probably due Cray XMP hardware. Rybka last won in 2010 - which in my calendar is not several years ago. <Since March 2011 at the latest Rybka has not been considered the highest rated engine, neither by the results of the CCRL 40/40 tournament or the IPON tournament. Houdini was.> And was Houdini entered in the 2011 WCCC? No. Since I was discussing dominance OF THAT EVENT, the sudden emergence of Houdini is not relevant. Incidentally the first salvos Levy fired were on 19 February 2011 - 'Attack of the clones'. Houdini had barely been released for 5 months, so I doubt Levy was heaving a huge sigh of relief. The relevant engine is Junior, which was awarded the 2011 title. SSDF has Rybka 138 Elo stronger than Junior. 138 Elo! The gap is SO large that the two barely belong in the same event. The fact that EVEN stronger engines exist, just makes things worse for the 'paper' ICGA champion. |
|
Jan-16-12 | | drik: <polarmis: <drik>, I don't think there's any need to repeat myself on your first points.> No - it is clear that we have rather different impressions of what constitutes 'normal' behaviour. If you were in court, I'm sure you would wish the jury thought more like me than like you! <You can read more about the ICGA at their website:> Yes, I too have Google.
<If you want to portray it as a commercial juggernaut threatened by Rybka I suppose you can, but that's just your fantasy.> Hardly a juggernaut ... but definitely commercial. Since we are swapping links, how about - Raymond Keene
And you might want to check Levy's management of Ronnie Biggs - the great train robber & possible murderer . BUt of course plagiarism would be a step too far. Fantasy? Sounds like it ... but - http://www.scotsman.com/news/simon_... |
|
Jan-16-12 | | polarmis: <drik: If you were in court, I'm sure you would wish the jury thought more like me than like you!> If you read what Rajlich himself wrote about Strelka you'll see he thought much more like me than like you. On Levy: how good or bad a businessman he is has no relevance whatsoever, leaving aside the fact Keene's sister or Keene himself are somewhat less than unbiased witnesses (or 100% reliable in the latter's case, but as you have Google I won't add references). You can spin a story about motivations for both sides (personally I think Rajlich's "borrowing"/disguise/hubris is a much better and more convincing tale) but again, it just comes down to facts. Leave aside the ad hominem arguments and try and dispute those. Or rather let's have Rajlich himself do that. |
|
Jan-16-12
 | | AylerKupp: <drik> As I said in my post, Rybka's dominance was true several years ago but it isn't true now. If the ICGA's action had been taken initially then I might have agreed that it was a concern (although I'm not sure why it would be considered embarrassing). But at the moment, at the time that the ICGA chose to take its action, it's a non-issue. So, while I think that there are very many good justifications for the ICGA to take its action, and to take its action at this point in time, I don't think that Rybka's embarrassing domination is/was an issue. As far Junior being relevant, it is not, and neither is the ICGA's World Computer Chess Championship tournament. As I also indicated earlier, the seven currently top rated engines in the CCRL 40/40 tournament did not participate, and that's like FIDE labeling a tournament a World Championship tournament without the top seven rated players participating. Why didn't these engines, including Houdini, participate? I don't know, I'm sure the developers have their reasons. But not having these engines participate renders the tournament meaningless as far as labeling it the World Computer Chess Championship tournament. And just to make my opinion clear, I DO believe that, based on the information presented, Rybka incorporated code from both Crafty and Fruit at various times. My posts are just addressed to the very limited issue that I don't think that Rybka's embarrassing dominance was a factor in the ICGA's decision to take the action that it did. |
|
Jan-16-12 | | drik: <polarmis: but again, it just comes down to facts ... Leave aside the ad hominem arguments> Interesting. In analyzing an argument between human beings, you want to leave out the human beings completely. I guess you never play the man, only the board? The problem with the 'facts' is that they are in dispute. Until that dispute is resolved, selecting the facts you believe is equivalent to selecting the people you believe. <On Levy: how good or bad a businessman he is has no relevance> Not BAD but UNSCRUPULOUS. And Eales may be Keene's sister, but she was also Levy's wife & made very specific allegations. You make no comment on his assisting Biggs avoid extradition on a legal technicality. That is a matter of record. |
|
Jan-16-12 | | drik: <AylerKupp: <drik> As I said in my post, Rybka's dominance was true several years ago but it isn't true now.> I was discussing the ICGA championship that Levy presides over. That is what Rybka has been banned from after winning in 2007, 2008, 2009, 2010 & being 138 Elo stronger than Junior the default 2011 'winner'. So Rybka's dominance is pretty current because it is THAT event that I was arguing about - not which engine is 'strongest'. <As far Junior being relevant, it is not, and neither is the ICGA's World Computer Chess Championship tournament.> In this, I agree with you completely. The emergence of Stockfish, Critter, Komodo & Houdini has made both a complete irrelevance. But the ICGA championship still exists - so any competitor banned from it has be to compared to its rivals IN THAT TOURNAMENT. With Houdini 2.0 turning commercial, it will be interesting to see the welcome it gets - if entered. <And just to make my opinion clear, I DO believe that, based on the information presented, Rybka incorporated code from both Crafty and Fruit at various times.> This is not disputed. Rajlich & Schroeder contend that there is no 'game-playing code', their detractors disagree. I only suggested that it was unwise to immediately take the most drastic action, rather than an intermediate one whilst awaiting a consensus. |
|
Jan-17-12 | | polarmis: <drik>, they reached a consensus (Rybka was derived from Fruit and broke the rules) and took a decision. If Rajlich wants to dispute it he can appeal. |
|
Jan-17-12
 | | AylerKupp: <polarmis> I don't believe that the ICGA investigation panel reached a consensus that Rybka was derived from Fruit because a lot depends on the definition of the word "derived". Instead, they ruled that Rybka had copied code from Fruit, and therefore violated ICGA Tournament Rule 2 that "Each program must be the original work of the entering developers." And they showed examples that there was code in Rybka that was derived (copied and them modified) from Fruit. But saying that a program contains code derived from other programs and saying that the program is derived from another program are not the same thing. Much depends, IMO, on the starting point of the source code base. If Rajlich had started with the Fruit 2.1 source code, modified it, and called it Rybka, then I would say that Rybka was derived from Fruit 2.1. But if the Rybka code was already developed and running, and then Rajlich took some source code from Fruit 2.1, copied it into Rybka, and possibly modified it, then I would not say that Rybka was derived from Fruit 2.1. At least not in the general sense. This may sound like nitpicking and it probably is, but another aspect of ICGA Tournament Rule 2 is that " Programs which are discovered to be close derivatives of others (e.g., by playing nearly all moves the same), may be declared invalid by the Tournament Director after seeking expert advice." Clearly the interpretation of "close derivative" will differ between individuals. After all, how close is "close"? The ICGA has published examples showing similarities between Fruit 2.1 and Rybka 2.3.2 code but to my knowledge has not attempted to determine how much of Rybka (any version) contains copied or modified Fruit 2.1 code. That would be a very large task without access to the Rybka source code. But if, say, less than 5% of the total code in Rybka is determined to be copied or modified from Fruit, then to make the argument that Rybka is a "close derivative" of Fruit would be difficult. So that's why I suspect that the "close derivative" clause in ICGA Tournament Rule 2 was not cited as a factor in Rybka's disqualification. |
|
Jan-17-12 | | polarmis: <AylerKupp>, you're right, I should just have written: "Rybka contained code derived from Fruit". That said, of your two options it seems to have been more a case of taking Fruit and altering it, as the "Fruitified" Rybka bore very little resemblance to the 600+ points weaker earlier version of Rybka it was supposedly a development of. I think the only part of the programs that was fully looked at was the evaluation function and the consensus was that was taken wholesale from Fruit and then tweaked. |
|
Jan-17-12
 | | AylerKupp: <drik> OK, we are talking about two different things. By virtue of Rybka winning the ICGA championship from 2007 – 2010 it was clearly dominant over all the other engines entered. I still quibble about the "embarrassing" part, but that's not important. But I doubt that Rybka would be dominant today in a tournament that would include all the current top engines, that's why I don't consider Rybka's dominance to be a factor in the ICGA's decision at this point in time. But, of course, I could be wrong. In retrospect, I think that it was unfortunate that the ICGA investigation panel included members involved in computer chess engine development such as Amir Ban (Junior), Don Daily (Komodo), Eric Hallsworth (Hiarcs), Fabien Letousky (Fruit), Ingo Bauer (Shredder), Kai Kimstedt (Toga), Ralf Schaefer (Spike), Richard Vida (Critter), and many others which I'm to lazy to mention (for a complete list, see http://www.chessvibes.com/plaatjes/...), some of which developed programs that competed against Rybka. It does raise the question of possible impartiality. And determining whether two programs share common code does not require much, if any, knowledge of chess program development; only experienced software developers and the appropriate tools. At a minimum, I think that it would have been desirable to exclude from the investigation panel any individuals that developed programs that competed against Rybka in any of the ICGA tournaments on which this action was taken, as well as any developers of commercial chess programs that compete against Rybka in the marketplace. Maybe the ICGA should keep this in mind if they ever find themselves in a similar situation in the future. |
|
Jan-17-12
 | | AylerKupp: <polarmis> Only Rajlich really knows whether he started from the Rybka code base and incorporated selected Fruit 2.1 code into it or whether he started from the Fruit 2.1 code base and incorporated selected Rybka code into it, and he's not talking. From a practical perspective I believe that most software developers, if they already had a working program, would start from that program's code base and incorporate other programs' code and ideas into it, rather than start from the other program's code base and incorporate whatever code and ideas they found desirable from their existing program. This is based on the developer's much better familiarity with their own code over other developers' code, not to mention the ego factor so strong among software developers, particularly the good ones. Rajlich indicated that he studied the Fruit 2.1 code extensively, but he was still very likely much more familiar with his own code than that of Fruit 2.1's. That plus the fact that modifications of this type are typically done incrementally; you introduce some new or copied/modified code into an existing program structure, evaluate its performance, introduce additional new or copied/modified code, and repeat the process. It's possible that Rajlich decided that Fruit 2.1's program and data structure was so far superior to his existing Rybka version that it was better to scrap most of the Rybka code and start over from Fruit 2.1, but I think that's unlikely. To give you an idea, I downloaded both Fruit 2.1 and Rybka 1.0 beta executables and disassembled both *.exe files. I found out that the size of the Fruit 2.1 code segment is 148 KB and the size of the Rybka 1.0 beta code segment is 105 KB. But the size of the Fruit 2.1 data segment is only 32 KB, while the size of the Rybka 1.0 beta code segment is 2,507 KB. So Rybka 1.0 beta is apparently much more extensively data driven and/or its data structures much more elaborate than Fruit 2.1's, and yet the executable code is about 30% smaller. So I think that Rybka 1.0 beta's implementation approach is MUCH different than Fruit 2.1's, and I would doubt that you would reasonably arrive at Rybka 1.0 beta starting from Fruit 2.1. Of course, this is all conjecture on my part and depends on the compilers used, the amount of debugging code retained, and other factors, so it's just an approximation. Again, only Rajlich knows for sure, and he's not talking. |
|
Jan-17-12 | | drik: <polarmis: <drik>, they reached a consensus> I meant a consensus within the entire community, not just the inquisition. By initially awarding joint trophies, they would have sparked debate within the community and a consensus would have been reached. Further sanctions were possible afterwards. Instead they have split the community & tarnished its image at the same time. Rybka 1.0 beta's time management & UCI coding appears Fruit derived - maybe even the point scoring tables (but they have a scaling factor allowing much finer tuning). The evaluation function appears different. Rybka 3 is different on all counts. I notice you still have no explanation for Schroeder's stance - no comment on Levy's history - & no explanation for why Rybka was stronger than Fruit. But facts that don't fit are always less welcome than the facts that do. |
|
Jan-17-12 | | drik: <AylerKupp: But saying that a program contains code derived from other programs and saying that the program is derived from another program are not the same thing.> Exactly. The code should still be referenced - but the term 'clone' is entirely inappropriate. <"Each program must be the original work of the entering developers."> In IP law this is dubious. Patent lawyers tend to use 'SUBSTANTIALLY original'. How many programs could claim complete originality, if the source code was laid bare? |
|
Jan-17-12 | | drik: <AylerKupp: <drik> OK, we are talking about two different things.>
Yes. Because those ICGA events didn't include ALL relevant engines ... & it is now debatable whether they will include ANY relevant engines. <I think that it would have been desirable to exclude from the investigation panel any individuals that developed programs that competed against Rybka in any of the ICGA tournaments> I agree here too. The commercial competitors should not have been included, particularly as they do not submit their own code for evaluation to the same standard. The open source guys are acceptable - but I'd like to have seen them supplemented by AI experts outside chess, to guarantee neutrality. Say David Fotland from go and Jonathan Schaeffer from checkers. Though those guys might not want to get involved. |
|
Jan-17-12 | | polarmis: <drik>, this had already been discussed for a couple of years, then examined in excruciating detail by a panel of 34 people (not a single one of whom felt Rajlich was innocent) and then reviewed by another five who voted 5-0. When's enough enough? After all, it was the members of a private club interpreting their own rules, not a matter of life and death. For the sort of "consensus" you want we'd have to wait to the end of human history, but somehow I doubt you'd get it then either (and if it wasn't in Rajlich's favour you still wouldn't be satisfied). <I notice you still have no explanation for Schroeder's stance - no comment on Levy's history - & no explanation for why Rybka was stronger than Fruit. But facts that don't fit are always less welcome than the facts that do.> Utterly meaningless rhetoric (again). I said I think Schroeder's website just disproves something that was never claimed. If you're asking why can one programmer think something that others don't then you might as well ask why one scientist supports a conspiracy theory and others don't. Or again, of course, he might have some personal motivation blah, blah, blah - but what's the point of speculation? The same goes for Levy. It's utterly irrelevant whether he's Jesus or the Antichrist. The ICGA process was transparent and, as far as I can see, fair. Your ICGA narrative (about a dark plot to make money by killing off Rybka) is obvious nonsense, but other than that what possible benefit can come from pure speculation about the motives of those involved? <no explanation for why Rybka was stronger than Fruit> More nonsense. I've said all along Rajlich took the Fruit code and improved on it - that doesn't stop taking the code from breaking the ICGA championship rule and/or the Fruit licence. |
|
Jan-18-12 | | drik: <polarmis: After all, it was the members of a private club interpreting their own rules, not a matter of life and death.> So members of private clubs can make public denunciations with complete impunity? <(and if it wasn't in Rajlich's favour you still wouldn't be satisfied)> You presume to speak for me? Let me tell you, if every AI expert ruled against Rajlich I would defer to their expertise. Only when there is disagreement between them, do I try to exercise judgement. Would YOU accept a decision against your opinion? Given that I am only asking for a deferral of decision, whilst you insist on the accuracy of your own ... <For the sort of "consensus" you want we'd have to wait to the end of human history,> For a consensus among programmers? I doubt it. But what you are admitting to, is that there isn't one currently & it is unlikely to arise soon. Which was precisely my point. <Utterly meaningless rhetoric> The opinions of an expert dissenter are not meaningless. A man was suspicious enough to add his name to the doubters - and then changed his mind. <The same goes for Levy. It's utterly irrelevant whether he's Jesus or the Antichrist. The ICGA process was transparent and, as far as I can see, fair.> So 'processes' work in a transparent & fair manner, despite the ethics of the people implementing them? It seems that people play a pretty small role in your view of the world. <I've said all along Rajlich took the Fruit code and improved on it - that doesn't stop taking the code from breaking the ICGA championship rule and/or the Fruit licence.> And I've said all along that Rajich may have taken code for Rybka 1.0 beta (time management & UCI parser) - but these are minor areas & can't explain the strength differential between it & Fruit. Rybka 3 is substantially different in both, but its titles have also been expunged. |
|
Jan-18-12
 | | AylerKupp: While I agree with and applaud its intent, I think that a lot of the problem arises from the wording of ICGA Tournament Rule 2 which I repeat here again: "Each program must be the original work of the entering developers. Programming teams whose code is derived from or including game-playing code written by others must name all other authors, or the source of such code, in their submission details. Programs which are discovered to be close derivatives of others (e.g., by playing nearly all moves the same), may be declared invalid by the Tournament Director after seeking expert advice. For this purpose a listing of all game-related code running on the system must be available on demand to the Tournament Director." To start with, the phrase "original work" is subject to wide interpretation. Does it apply to source code, object code, ideas, or any combination of the three? And the second sentence directly contradicts the first sentence; if any programming team admits that its code is derived from or includes "game-playing code" (whatever the definition of that is), then it cannot be considered "original work" and would presumably be automatically disqualified. Seems like a requirement for self-incrimination. I have many other criticisms about Rule 2 but in an attempt at brevity I won't list them since it would make this post even more boring than my usual posts. But I think the ICGA should wake up to the realities that every software developer in every field tries to, for expediency if nothing else, "leverage" (the most non-prejudicial word I could think of) the work of others and adjust its tournament rules accordingly. |
|
 |
 |
< Earlier Kibitzing · PAGE 77 OF 79 ·
Later Kibitzing> |
|
|
|