Safe Superintelligence (SSI), a newly established AI startup co-founded by former OpenAI chief scientist Ilya Sutskever, has raised $1 billion in funding, valuing the three-month-old company at $5 billion, according to sources familiar with the matter. The startup aims to develop artificial intelligence systems that surpass human capabilities while emphasizing safety and ethical concerns.
Investors in SSI include some of the most prominent venture capital firms, such as Andreessen Horowitz, Sequoia Capital, DST Global, and SV Angel. The funding round also saw participation from NFDG, an investment partnership co-run by Nat Friedman and SSI CEO Daniel Gross.
Sutskever, who was instrumental in promoting the scaling hypothesis at OpenAI, believes that vast amounts of computing power can significantly improve AI models. However, he plans to approach scaling differently at SSI, questioning not just the methods but the objectives of scaling. “Everyone just says scaling hypothesis. Everyone neglects to ask, what are we scaling?” Sutskever said.
SSI’s leadership includes Daniel Gross, formerly of Apple, and Daniel Levy, a former OpenAI researcher, who join Sutskever in focusing on ethical AI development. Gross stated the company’s mission is to make a direct shot at developing safe superintelligence, ensuring AI remains aligned with human values.
The startup's formation comes amidst increasing debate within the tech industry over AI safety regulations. A proposed California bill seeking to impose safety standards on AI companies has divided the sector, with companies like OpenAI and Google opposing it, while others such as Anthropic and Elon Musk's xAI support the measure.
Sutskever’s departure from OpenAI earlier this year followed internal conflicts, including a controversial decision to oust OpenAI CEO Sam Altman, which Sutskever initially supported but later reversed. After leaving OpenAI, Sutskever dismantled his “Superalignment” team, which was focused on ensuring AI systems remain aligned with human values.
SSI is actively recruiting talent and plans to partner with cloud providers and chip companies to meet its computational needs. The company is prioritizing individuals who demonstrate a genuine interest in advancing AI technology, rather than those merely attracted by the industry’s hype.
With operations spanning Palo Alto, California, and Tel Aviv, Israel, SSI aims to build a small, highly trusted team of researchers and engineers dedicated to pushing the boundaries of AI while maintaining stringent safety and ethical standards.
