Amazon’s TorchNeuron targets Nvidia’s AI software advantage

Amazon is introducing TorchNeuron, software it says will let developers run PyTorch code on its Trainium AI chips with a single configuration change and no rewriting. The company planned to announce the tool at a Silicon Valley developer conference on Monday, October 19, as it seeks to weaken the software advantage supporting Nvidia’s position in AI computing.

Economic Times Markets, carrying reporting that included a Reuters interview with Amazon’s chip unit, reported that the software would be released publicly as a free, open-source offering. The compatibility claim comes from Amazon’s Annapurna Labs.

Reducing the work needed to switch chips

PyTorch is an open-source AI software framework, rather than a standalone programming language. Its widespread use makes support for existing PyTorch code important for chipmakers trying to attract developers without asking them to overhaul their software.

Nvidia has spent more than a decade developing CUDA, the software platform that helps PyTorch workloads run effectively on its chips. Amazon’s pitch is to reduce the effort involved in trying an alternative: developers could retain their code while changing the configuration needed to use Trainium.

Colin Brace, vice president of software at Annapurna Labs, said the objective was to cut the number of steps customers must take to test Amazon’s in-house hardware. Google, which also develops custom AI chips, is working on better PyTorch tools to attract developers away from Nvidia.

Early use, but no quantified savings

Brace said more than 30 early customers were using TorchNeuron across robotics, world models and voice AI. He also said switching to Amazon’s chips could deliver substantial cost savings.

Those savings remain a company claim: the report did not provide quantified cost comparisons or benchmark results. Easier code compatibility and lower computing costs are distinct propositions; the announcement describes the former, while offering no figures with which to assess the latter.

Amazon shares were up 5% in morning trading, with Morgan Stanley naming the company a top pick. That was an intraday snapshot, not a closing price, and the report did not establish how much of the move was attributable to TorchNeuron.