Anthropic has appointed Rahul Patil as its new Chief Technical Officer (CTO), succeeding co-founder Sam McCandlish, who transitions to the role of chief architect. Patil began his tenure at Anthropic earlier this week and will oversee key areas including compute, infrastructure, inference, and a variety of engineering tasks. The restructuring of Anthropic’s technical group aims […]
NVIDIA has released Dynamo, an open-source inference software designed to enhance and scale reasoning models within AI factories. The efficient management of AI inference requests across multiple GPUs is essential for cost-effectiveness and for maximizing token revenue generation. As AI reasoning becomes more common, AI models are expected to produce tens of thousands of tokens […]