OpenAI and Broadcom have developed a custom AI chip called Jalapeno, designed specifically for large language model inference. The companies claim the processor can reduce costs by 50% and plan to deploy it at scale by late 2026.
OpenAI is moving beyond relying solely on third-party semiconductors. The company has partnered with Broadcom to create Jalapeno, a custom Application-Specific Integrated Circuit (ASIC) tailored for AI inference workloads.
Jalapeno represents OpenAI's first foray into custom chip design. Unlike general-purpose processors, ASICs are optimized for specific tasks—in this case, running inference on large language models. When users interact with ChatGPT or similar systems, inference processors handle the computational work of generating responses.
The chip addresses a critical pain point in AI infrastructure: cost. By designing hardware specifically for inference operations, OpenAI and Broadcom say Jalapeno can cut expenses by 50% compared to existing solutions. This efficiency gain matters significantly as AI companies scale operations and face mounting computational demands.
OpenAI is currently testing Jalapeno samples. Full-scale deployment is targeted for late 2026, giving the company time to validate performance and integrate the chip into its infrastructure.
The move reflects a broader industry trend. Major tech companies including Google, Amazon, and Meta have developed custom chips to reduce dependency on vendors like Nvidia and optimize for their specific workloads. For OpenAI, controlling its own silicon gives the company greater flexibility in pricing, performance, and supply chain management.
Broadcom's involvement brings manufacturing expertise and established relationships with foundries. The partnership allows OpenAI to leverage Broadcom's semiconductor knowledge while maintaining focus on AI development.
Custom chips alone won't solve all infrastructure challenges facing AI companies, but they provide meaningful advantages in cost and efficiency. Jalapeno's 50% cost reduction claim could significantly impact OpenAI's operational expenses and competitiveness as the AI market intensifies.
The US Department of Homeland Security has retasked hundreds of surveillance drones to monitor the spread of flesh-eating screwworms across Texas livestock and wildlife. The parasitic infestation marks a rare deployment of border security technology for agricultural crisis response.
A widespread outage of a popular smart pet feeder has left owners unable to feed their animals remotely, prompting concerns about device reliability and backup systems.
Silicon Valley robotics company Matic is differentiating its robot vacuum from Chinese competitors by offering full voice command functionality. The feature allows users to control the device entirely through spoken instructions.
Matic has launched Matic Cues, a new feature enabling voice commands and gesture recognition for its robot vacuum. Users can now point at spills for spot cleaning or speak directly to the device.