Microsoft CEO Nadella: Superintelligence must benefit humanity and be controlled by humanity

Microsoft CEO Satya Nadella posted on X stating: Any pursuit of superintelligence must be based on core principles, namely that if the AI we build cannot help humanity and is not under human control, it is not worth pursuing.

He also mentioned the need to accelerate and widely disseminate the benefits of AI, allowing it to spread broadly across nations, communities, and companies, which requires a thriving frontier ecosystem for both closed-source and open-source models. For enterprises, it is essential to retain complete control over their unique and tacit knowledge, and each organization should be able to build its own continuous learning loop without relying on any single model provider, embedding its own knowledge into the models and weights it controls.

Nadella welcomed the necessary research, attention, and careful pacing for proper alignment, as well as ideas like "embedded evaluators." This cannot be controlled by a few entities; it must have broad representation across ecosystems, nations, and fields including academia. Microsoft's approach is broad access and choice at every layer of the AI stack, enterprise control over learning loops and models, and the release of its proprietary MAI model "Code of Conduct" for public consultation tomorrow.