OpenAI Jalapeño is truly the first AI silicon developed by GPT-Astra and other OpenAI internal models. I believe they heavily used reinforcement learning on internal models like GPT-Astra to achieve these SOTA results. Here is what I think they did: 1. RL an internal GPT to help them write the RTL. This helped them tape out fast. 2. RL GPT-Astra on their ISA / assembly format and write all the kernels in pure assembly. 3. RL on top of the ISA RLed GPT-Astra to write megakernels for Jalapeño. Continue to hill climb with RL over time. Astra + Codex also wrote the entire cycle accurate chip simulator enabling all these hill climbs to run on CPU without any Jalapeño chip. This is honestly what I have been expecting. RSI is already here for AI silicon development. I would not be shocked if 99% of source code for Jalapeño was AI generated.

OpenAI Jalapeño is truly the first AI silicon developed by GPT-Astra and other OpenAI internal models. I believe they heavily used reinforcement learning on internal models like GPT-Astra to achieve these SOTA results. Here is what I think they did: 1. RL an internal GPT to help them write the RTL. This helped them tape out fast. 2. RL GPT-Astra on their ISA / assembly format and write all the kernels in pure assembly. 3. RL on top of the ISA RLed GPT-Astra to write megakernels for Jalapeño. Continue to hill climb with RL over time. Astra + Codex also wrote the entire cycle accurate chip simulator enabling all these hill climbs to run on CPU without any Jalapeño chip. This is honestly what I have been expecting. RSI is already here for AI silicon development. I would not be shocked if 99% of source code for Jalapeño was AI generated.

Source:https://x.com/jukan05/status/2092495587828768882