INTEL RELEASES AUTO-ROUND QUANTIZATION FOR LLMS

Intel has open-sourced Auto-Round, an advanced quantization algorithm designed to compress large language models while maintaining performance. The tool addresses the computational demands of deploying LLMs at scale.