Go back
Is Rybka Growing Weary?

Is Rybka Growing Weary?

Only Chess

e

Joined
19 Nov 05
Moves
3112
Clock
25 Jul 06
Vote Up
Vote Down

I've been running several 15 10 games between Rybka 1.2f and Rybka 2.1c and the results are surprising. Rybka 1.2f is actually leading the way. Of course, so far, only 7 games have been played and it could just be bad luck for Rybka 2.1. ;p However, could it be possible that Rybka has grown weaker with the new version?!

S

Joined
21 Feb 06
Moves
6500
Clock
25 Jul 06
1 edit
Vote Up
Vote Down

Originally posted by exigentsky
I've been running several 15 10 games between Rybka 1.2f and Rybka 2.1c and the results are surprising. Rybka 1.2f is actually leading the way. Of course, so far, only 7 games have been played and it could just be bad luck for Rybka 2.1. ;p However, could it be possible that Rybka has grown weaker with the new version?!
It depends....

as black? as white?

and also....

Read the version history, see what they changed...

if for example the new version uses rather agressive pruning (and the older one doesn't) then that may help explain it.

....(if that is the case) then that means the new version can search deeper, BUT, there is bigger chance it may miss an exceptionally clever move...the older version being less "selective" ((and because it has the time)) may be able to spot some clever, rather obscure move...which its "successor" didn't

and another plausible possibilty...
check the engine settings...both EXACTLY the same??, same books, same tablebases, same hash sizes, etc, etc

e

Joined
19 Nov 05
Moves
3112
Clock
25 Jul 06
1 edit
Vote Up
Vote Down

Everything is the same except the engine.

- No books
- Same tablebases
- 200 MB each
- 15 + 10 sec. increment
- Alternate colors
- Parameters are identical/default and they are turned off anyway.

From what you say, it sounds like Rybka 2.1 may be better in blitz. Very possible, but when i ran 50 games at 5 5 settings, Rybka 1.2f was leading by about 5%. This leads me to think that the blitz settings must be very low, perhpas 3 3 or even faster.

All I can say so far is, I'm really dissapointed.

S

Joined
21 Feb 06
Moves
6500
Clock
25 Jul 06
Vote Up
Vote Down

Originally posted by exigentsky
Everything is the same except the engine.

- No books
- Same tablebases
- 200 MB each
- 15 + 10 sec. increment
- Alternate colors
- Parameters are identical/default and they are turned off anyway.

From what you say, it sounds like Rybka 2.1 may be better in blitz. Very possible, but when i ran 50 games at 5 5 settings, Rybka 1.2f was leading by ...[text shortened]... t be very low, perhpas 3 3 or even faster.

All I can say so far is, I'm really dissapointed.
Try changing the actual engine settings....

Many engines (of course not all) have parameters you can tinker around with - and 15-10 controls try turning down the selectivity and prunning a little (if possible)

e

Joined
19 Nov 05
Moves
3112
Clock
25 Jul 06
Vote Up
Vote Down

But wouldn't doing so actually make the match rather pointless? I thought both should have the same settings for fairness.

S

Joined
21 Feb 06
Moves
6500
Clock
25 Jul 06
Vote Up
Vote Down

Originally posted by exigentsky
But wouldn't doing so actually make the match rather pointless? I thought both should have the same settings for fairness.
true....

anyway, I think I have found the awnser to your question.....

http://www.rybkachess.com/index.php?auswahl=FAQ+for+v+1.2f

There it is, clear as day....

Is the playing strength changed from Rybka 1.2?
No - unless losses on time, or forfeit losses, are counted as a part of playing strength.

l

Joined
15 Apr 06
Moves
5554
Clock
25 Jul 06
Vote Up
Vote Down

I may of missed somthing but i think that link compares Rybka 1.2 and 1.2f not 1.2f and 2.1 as in the question

S

Joined
21 Feb 06
Moves
6500
Clock
25 Jul 06
Vote Up
Vote Down

Originally posted by lafredo
I may of missed somthing but i think that link compares Rybka 1.2 and 1.2f not 1.2f and 2.1 as in the question
Oh.....so it is - in which case I stand correct.....

well from what I read 2.1 was for multi-processors, --- in which case the increase in playing strength is not from imporved evaluation functions but rather, more hardware.

e

Joined
19 Nov 05
Moves
3112
Clock
25 Jul 06
1 edit
Vote Up
Vote Down

Yes, 2.1 is for multiprocessors/dual core processors but it is also for the average 32 bit single core computer. (mine) Also, according to the help file, it should also have had some strength improvement.

Here are the differences between 1.2 and 2.1: http://www.rybkachess.com/download/Rybka_2_1.htm

In any case, you may be right that the search improvements actually lead Rybka to perform worse with longer time controls because it misses the less obvious moves. Thus, I have cancelled the 15 10 matches and started another tournament but with 5 0 time settings. I'll wait until at least 100 matches before commenting on the results.

Even if the strength improvement between 2.1 and 1.2 is minor, I can't understand why there would be a downgrade in strength.

V

Joined
21 Sep 05
Moves
27507
Clock
25 Jul 06
Vote Up
Vote Down

I don't think you're alone in having some doubts about the strength improvement of 2.1. I've read similar posts elsewhere.

However, it's still early days. With more test data things will become clearer and more definite. Also, regarding your own tests, it's not always best to just test various versions of the same engine. e.g. it may be that 2.1 performs better against Shredder, Fritz, etc. than 1.2.

d

Joined
12 Jun 05
Moves
14671
Clock
25 Jul 06
2 edits
Vote Up
Vote Down

Originally posted by Varenka
I don't think you're alone in having some doubts about the strength improvement of 2.1. I've read similar posts elsewhere.

However, it's still early days. With more test data things will become clearer and more definite. Also, regarding your own tests, it's not always best to just test various versions of the same engine. e.g. it may be that 2.1 performs better against Shredder, Fritz, etc. than 1.2.
Also, anyone who bought 2.1 automatically gets 2.2 and 2.3 later this year.

In other words, Rybka 2 is still a work in progress.

I bought Shredder 10 recently and having watched the free beta version of Rybka repeatedly kick its ass, now have no idea why.

H
Renouned Grob Killer

Joined
17 Dec 05
Moves
14725
Clock
25 Jul 06
1 edit
Vote Up
Vote Down

Rybka 2.1 is hands down stronger, it can hang with Deep Shredder 10

H
Renouned Grob Killer

Joined
17 Dec 05
Moves
14725
Clock
25 Jul 06
1 edit
Vote Up
Vote Down

You should probably upgrade to Rybka 2.3. Get the dual processor version it's 50-100 stronger than any other engine

e

Joined
19 Nov 05
Moves
3112
Clock
25 Jul 06
1 edit
Vote Up
Vote Down

Rybka 2.1 is stronger if you have teh right hardware as it supports multiple processors. However, on equal hardware, I have my doubts. So far, 70 game s have been played. I'll give the results in a few more hours.

Rybka 2.2 does not yet exist.

H
Renouned Grob Killer

Joined
17 Dec 05
Moves
14725
Clock
25 Jul 06
Vote Up
Vote Down

Originally posted by exigentsky
Rybka 2.1 is stronger if you have teh right hardware as it supports multiple processors. However, on equal hardware, I have my doubts. So far, 70 game s have been played. I'll give the results in a few more hours.

Rybka 2.2 does not yet exist.
your right 2.2 isnt due out for another two months

Cookies help us deliver our Services. By using our Services or clicking I agree, you agree to our use of cookies. Learn More.