Microsoft Enhances LLM Accuracy & Efficiency, Mistral's GPT-4 Rival Leaked, and Microsoft Discloses a New Risk

Microsoft shared some techniques that make LLMs more accurate and efficient, Mistral's GPT-4 competitor was leaked, and Microsoft discloses a new risk in their earnings report.

Microsoft Enhances LLM Accuracy with LASER Technique

Microsoft shared how Layer-Selective Rank Reduction (or LASER) can make LLMs more accurate. The technique basically replaces selected weight matrices in an LLM with their suitable low-rank approximation.

Surprisingly, the right LASER adjustments can actually reduce model loss, which enhances performance…