Enlarge / Mustafa Suleyman, co-founder and chief govt officer of Inflection AI UK Ltd., throughout a city corridor on day two of the World Financial Discussion board (WEF) in Davos, Switzerland, on Wednesday, Jan. 17, 2024. Suleyman joined Microsoft in March. (credit score: Getty Photographs)
Microsoft is engaged on a brand new large-scale AI language mannequin referred to as MAI-1, which may probably rival state-of-the-art fashions from Google, Anthropic, and OpenAI, in response to a report by The Info. This marks the primary time Microsoft has developed an in-house AI mannequin of this magnitude since investing over $10 billion in OpenAI for the rights to reuse the startup’s AI fashions. OpenAI’s GPT-Four powers not solely ChatGPT but additionally Microsoft Copilot.
The event of MAI-1 is being led by Mustafa Suleyman, the previous Google AI chief who just lately served as CEO of the AI startup Inflection earlier than Microsoft acquired nearly all of the startup’s employees and mental property for $650 million in March. Though MAI-1 might construct on strategies introduced over by former Inflection employees, it’s reportedly a wholly new giant language mannequin (LLM), as confirmed by two Microsoft workers aware of the challenge.
With roughly 500 billion parameters, MAI-1 will probably be considerably bigger than Microsoft’s earlier open supply fashions (similar to Phi-3, which we lined final month), requiring extra computing energy and coaching information. This reportedly locations MAI-1 in the same league as OpenAI’s GPT-4, which is rumored to have over 1 trillion parameters (in a mixture-of-experts configuration) and effectively above smaller fashions like Meta and Mistral’s 70 billion parameter fashions.
Learn Three remaining paragraphs | Feedback
