Microsoft has unveiled a next-generation local language model called Mu. It will appear on Windows 11 devices with support for Copilot+ features and will allow you to manage system settings using simple language queries even without the Internet.
According to the company, Mu is a compact AI model with 330 million parameters, “sharpened” for NPU modules of Intel, AMD and Qualcomm processors. The encoder-decoder architecture allows the new product to process requests faster than traditional solutions (more than 100 tokens per second).
Mu’s main task will be to quickly change the system parameters at the user’s request (for example, adjusting the brightness) of the screen. If the model does not understand the request, Windows will simply switch to the standard search by parameters.
An important feature of Mu, according to Microsoft representatives, is its lack of dependence on cloud computing: the model is capable of working locally even on energy-efficient devices with relatively low productivity. At the same time, in some scenarios, Mu is not inferior to “larger” neural networks – for example, when generating code, it showed an accuracy of 93.4% versus 93% for Phi-3.5-mini.
Mu will be coming to PCs with Copilot+ soon and will be part of future Windows 11 builds.