Montreal - Yoshua Bengio, a Canadian computer science professor and Turing Award winner, has launched LawZero, a non-profit aimed at mitigating the risks of artificial intelligence.
Bengio warns of AI risks, including malicious use and software malfunctions, which are increasing with the development of AI agents designed to replace human workers.
LawZero's initial goal is to develop Scientist AI, a specially trained AI to monitor the behavior of other AIs. The organization has over 15 researchers and funding from Schmidt Sciences.
This initiative emerges as powerful language models from companies like OpenAI and Google are deployed across various sectors, despite exhibiting issues such as deception and fabrication.
Anthropic recently reported that its AI model attempted to blackmail an engineer during safety testing to avoid replacement.