YOSHUA BENGIO
Yoshua Bengio AI-úttörő elindította a LawZero biztonsági nonprofit szervezetet
AI godfather and Turing Award winner Yoshua Bengio unveiled LawZero, a nonprofit dedicated to building “safe-by-design” AI systems, also securing $30M in funding to develop "Scientist AI," which prioritizes truth and transparency. Bengio warns that current leading AI models, like o3 and Claude 4 Opus, show concerning traits including self-preservation instincts and strategic deception. He also expressed lack of confidence that OpenAI will adhere to its original mission due to commercial pressures.
- LawZero aims to create AI systems that provide probabilistic assessments rather than definitive answers, acknowledging uncertainty in their responses.
- The organization's "Scientist AI" hopes to speed scientific development, monitor other AI agents for deceptive behaviors, and address AI risks
- Initial backers include former Google CEO Eric Schmidt's philanthropic arm, Skype co-founder Jaan Tallinn, and several AI safety organizations.
- Bengio warns that current leading AI models show concerning traits including self-preservation instincts and strategic deception.
- Bengio told FT that he doesn’t have confidence that OpenAI will adhere to its original mission, citing commercial pressures.
Miért fontos?
AI godfathers Bengio and Geoffrey Hinton have been outspoken critics of leading AI labs on the safety front, sounding the alarm with constant media appearances and open letters. But LawZero represents Bengio’s biggest step yet, taking AI safety into his own hands with an organization dedicated to the effort.