@pukerrainbrow Throughput changes what agents are for. A 10-minute task gets queued and checked later. A 20-second one you iterate on live, retry and refine while it's still in your head. Same model, different product. Reply to @pukerrainbrow: An AI agent task that takes 10 minutes at 100 tokens per second would take about 20 seconds at 3,000. Gimlet Labs wants to deliver the second number. It raised $300 million at a $3 billion valuation less than a year after leaving stealth. The company is based in San Francisco and led by CEO Zain Asgar, a former NVIDIA GPU architect who also led engineering at Google AI and teaches as an adjunct professor at Stanford. His co-founders include Michelle Nguyen, Omid Azizi, and Natalie Serrino. The four built Pixie Labs, a Kubernetes observability startup that New Relic acquired in 2020. The problem, Gimlet says, is that many inference clouds are built on one kind of GPU, which forces a tradeoff between total throughput and the speed each user experiences. It argues that inference isn't one uniform workload. Processing the prompt, generating the answer, attention, and feed-forward layers all stress chips differently. So Gimlet splits the job and runs each piece on the chip best suited to it. It works with chips from six makers, NVIDIA, AMD, Intel, Arm, Cerebras, and d-Matrix. Its software orchestrates the pieces, and developers see a standard inference API. The company says this delivers either 3 to 10 times higher interactivity or 3 to 10 times more throughput per kilowatt, depending on which target you hold fixed. It also sells Gimlet Cloud, serverless inference for AI agents, and kforge, which generates optimized GPU kernels from PyTorch code. The company is moving beyond software into infrastructure. It says it is securing data center capacity and is hiring data center architects. On September 28, Gimlet announced a partnership with Cerebras to deploy 100 megawatts of Cerebras-powered inference capacity. The first datacenter is expected online later this year, with speeds of up to 3,000 tokens per second. Gimlet will also be a launch partner for Cerebras's next system, the CS-4, in 2027. On September 4, Gimlet raised a $300 million Series B led by Andreessen Horowitz at a $3 billion valuation. Sapphire Ventures, M12, Arm, Menlo Ventures, Samsung Ventures, and Tiger Global joined, among others. Earlier came a $12 million seed and an $80 million Series A led by Menlo in March, bringing total funding to $392 million. Gimlet says it has tripled its customer base since March and added one of the top three frontier AI labs and one of the top three hyperscalers. It hasn't disclosed revenue or a customer count. Asgar says the future of inference is vertically integrated and multisilicon, with many chip architectures orchestrated as one system.