No, you're not supposed to see them, and I figured that the EnemyToAll minor faction flag would work for that, but since it shares a player number with the first human players no such luck
I guess I can try giving it AIAlly but then it'll show as a hostile in other contexts, etc.
I'll probably just have to add a new "please don't draw this ever" flag