2 Comments

Thanks John, as clear a framing of the current zeitgeist as I've read anywhere.

One suggested extension: "This war will rage on until one side wins or we develop a networked decision-making method that incorporates each approach's strengths into an integrated whole." ... what about the invisible "Third Player" here: the non-biological "intelligence" evolving rapidly in the online spaces between every human mind (swarm OR horde)?

If this AI network achieves greater agency than any collective of human brains - by effectively controlling the network layer between them - at that point control of human political, economic, social (...evolutionary...) outcomes moves beyond biological humanity. (Indeed, we may already be there).

What are some of the ways to architect / influence the Third Player now, early on, so as to be able to direct gameplay in the future...? (Pretty much the AI Alignment problem but placed in the Swarm vs Horde framing...)

Expand full comment

Thanks. Top of mind: Constraints (rights, ownership, etc.), goals (what it optimizes), and circuit breakers (slow swarm). It won't be intelligent in the AGI sense, but rather symbiotes (if we are lucky, parasites if we aren't) that we build, train, and care for.

Expand full comment