Yes, this is correct. You can only ever play against two AI opponents, no more, no less. They control all the planets that you don't start with, so adding more wouldn't make it any more difficult. The only reason it's two instead of one is that allows for more variance between the planets the AI controls.
