AI MODEL RUNS ON 12.5% OF EXPERTS WITH MINIMAL LOSS

Researchers at the Allen Institute for AI and UC Berkeley have developed EMO, a mixture-of-experts model that maintains near-full performance while using just one-eighth of its experts. The breakthrough could make advanced AI systems practical for memory-constrained devices.