Design for Provably Safe AI with Evan Miyazono

Membership | Donations | Spotify | YouTube | Apple Podcasts

This week’s guest is my friend Evan Miyazono, CEO and Director of Atlas Computing — a tech non-profit committed not to the false god of perfect alignment but to plausible strategy of provable safety. Focusing on community building, cybersecurity, and biosecurity, Evan and his colleagues are working to advance a new AI architecture that constrains and formally specifies AI outputs, with reviewable intermediary results, collaborating across sectors to promote this radically different and more empirical approach to applied machine intelligence.

After completing his PhD in Applied Physics at Caltech, Evan led research at Protocol Labs, creating their research grants program, and led the special projects team that created Hypercerts, Funding the Commons, gov4git, and key parts of Discourse Graphs and the initial Open Agency Architecture proposal.

In our conversation we talk about a wide swath of topics including regulatory scaling problems, specifying formal organizational charters, the spectre of opacity, and the quantification of trust — all, in some sense, interdisciplinary matters of “game design” in our entanglement with magical technologies and fundamental uncertainty.

If you enjoy this conversation, join the Wisdom x Technology Discord server and consider becoming a member for access to our study groups, community calls, and complete archives.

Founding members also get access to the entire twenty hours of lecture and discussion from my recent course, How to Live in the Future.

Links

• Hire me for speaking or consulting• Explore the Humans On The Loop archives• Dig into nine years of mind-expanding podcasts• Browse the books we discuss on the show at Bookshop.org• Explore the interactive knowledge garden grown from over 250 episodes

Discussed

• Atlas Computing Summary Slides• Atlas Computing Institute Talks (YouTube Playlist)• A Toolchain for AI-Assisted Code Specification, Synthesis and Verification• Also, a relevant paper from Max Tegmark:Provably safe systems: the only path to controllable AGI

Mentioned

Gregory BatesonDavid DalrympleK. Allado-McDowellTerence McKennaYuval Noah HarariCosma ShaliziHenry FarrellHakim BeyNatalie DeprazFrancisco VarelaPierre VermerschPlurality InstitutePuja OhlhaverSean Esbjörn-HargensAlfred North WhiteheadDe Kai

Primer Riff

Are we doing AI alignment wrong? Game designers Forrest Imel and Gavin Valentine define games as having meaningful