My perfect game would probably be one where you're actually in the game. Either through virtual reality, or a holographic interface, like the holodeck in Star Trek.
It would have to be an open world role playing game. Something like The Elder Scrolls games. Or maybe something like Fallout.
Games like Skyrim are some of my favourites games already, because they immerse you and your character because unique and tailored to your play style.
Therefore, my perfect game would have to be that much different from Skyrim, because the reason it would become perfect, is from the total immersion you get from being in the game directly.
Of course, the graphics would have to be real life quality, and the game would have to interoperate anything you say and react accordantly, but aside from that, it's doesn't have to be much more to keep me happy. xD