Microsoft open-sourced its Phi-Four small language mannequin on Wednesday. The most recent synthetic intelligence (AI) mannequin within the Phi collection was launched final month, nonetheless, on the time it was solely accessible through the corporate’s Azure AI Foundry. On the time, the Redmond-based tech big stated that it might quickly make the supply code of the AI mannequin accessible within the public area. Now, people can entry the reasoning-focused AI mannequin through Hugging Face. Microsoft can also be letting the mannequin be used for each educational and business use instances.
Microsoft Open-Sources Phi-Four AI Mannequin
Shital Shah, a member of the technical workers at Microsoft AI, took to X (previously referred to as Twitter) to announce the provision of the Phi-Four AI mannequin’s weights on Hugging Face. The AI mannequin is obtainable with the MIT licence for tutorial and business utilization. people can entry the mannequin itemizing right here.
Launched eight months after the discharge of the Phi-Three AI mannequin, the SLM is alleged to supply vital enhancements in fixing advanced reasoning-based queries in areas similar to arithmetic. The Phi-Four has a context window of 16,000 tokens and was educated on a dataset of 9.eight trillion tokens.
Citing the supply of the coaching information, the Hugging Face itemizing highlights the dataset contains publicly accessible high-quality instructional information and code, artificial information throughout a variety of topics, acquired educational books and Q&A datasets, in addition to chat format supervised information.
Notably, it’s a text-only mannequin which suggests it solely accepts textual content as each enter and output. The AI mannequin comes with 14 billion parameters. Microsoft states that the AI mannequin was constructed on a dense decoder-only Transformer structure.
On the time of launch, Microsoft additionally shared benchmark scores of the AI mannequin. Primarily based on them, the corporate claimed that the most recent iteration of the Phi SLM outperforms the Gemini 1.5 Professional mannequin on the maths competitors issues benchmark.
The Phi-Four AI mannequin can be accessed through Microsoft’s Azure AI Foundry. The platform additionally presents to assist builders and enterprises handle AI dangers. It additionally comes with options similar to immediate shields, groundedness detection and content material filters. These security capabilities can be exported to an software utilizing the corporate’s software programming interface (API).
Catch the most recent from the Client Electronics Present on Devices 360, at our CES 2025 hub.
