28.9M PARAMETER LLM RUNS ON $8 ESP32

The project, shared on GitHub as esp32-ai, shows that capable language models can run on severely resource-constrained devices. The ESP32 microcontroller, widely available and inexpensive, typically features 4MB of flash storage and limited RAM. Running LLMs on microcontrollers addresses edge computing use cases where cloud connectivity is unavailable or undesirable. Inference happens locally without network latency or privacy concerns associated with cloud services. The implementation generated 122 points and 27 comments on Hacker News, indicating significant interest from the developer community. This work follows broader trends in model optimization, including quantization and pruning techniques that reduce model size without sacrificing substantial performance. The approach opens possibilities for embedding AI capabilities directly into IoT devices, industrial equipment, and embedded systems where computational power and cost are primary constraints.