I haven't tried this, but I think if you go to public games, you can do a search by adding the username of both players.
I'll go try it myself and see what happens.
<edit> OK, that worked fine. I checked one person I have completed eight games with, some as black and some as white. I entered his username and mine, and all eight games came up. From there you should be able to look at each game, then use the browser 'back' button to get back to the main list.
Hope that helps.