Wait, so what's the point of the other players then? Canon fodder for the black king?

They have their own quests and purposes.  A time and space player are the bare minimum.  A two-player session is incredibly rare and more difficult than the average session.