Amazon.com’s AWS cloud computing unit announced on Tuesday that it will adopt key Nvidia technology in future generations of its artificial intelligence computing chips. This move is part of the firm’s intensified effort to attract major AI customers to its services.
Nvidia Partnership and Trainium Chips
AWS will adopt a technology called NVLink Fusion in a future chip known as Trainium4. The NVLink technology creates speedy connections between different kinds of chips and is considered one of Nvidia's crown jewels. AWS did not specify a release date for Trainium4.
This announcement was made during AWS's annual week long cloud computing conference in Las Vegas.
Nvidia has been pushing other chip firms to adopt its NVLink technology, with Intel, Qualcomm, and now AWS on board. The technology will help AWS build bigger AI servers that can recognize and communicate with one another faster. This is a critical factor in training large AI models, which require thousands of machines to be strung together.
As part of the partnership, customers will have access to what AWS is calling AI Factories. This exclusive AI infrastructure inside their own data centers offers greater speed and readiness. Nvidia CEO Jensen Huang stated, "Together, Nvidia and AWS are creating the compute fabric for the AI industrial revolution, bringing advanced AI to every company, in every country, and accelerating the world's path to intelligence."
Separately, Amazon is rolling out new servers based on the Trainium3 chip. These new servers are available immediately. Each server contains 144 chips and boasts more than four times the computing power of AWS's previous generation of AI, while using 40% less power. Dave Brown, vice president of AWS compute and machine learning services, emphasized that AWS aims to compete with rivals, including Nvidia, based on price.
New Nova AI Models
The company also introduced new versions of its foundational AI models known as Nova.
- Nova 2 is faster and more responsive. It includes a version that can respond with images or text to text, image, speech, or video prompts.
- Sonic can respond to speech prompts with speech outputs, which AWS CEO Matt Garman called "human like" during his keynote address.
Although Amazon has faced challenges gaining broad acceptance for Nova against rivals like OpenAI’s ChatGPT, Anthropic’s Claude, and Google’s Gemini, Amazon posted a 20% sales boost in AWS in its most recent quarter, primarily driven by its cloud computing and AI infrastructure services.
At the Las Vegas conference, Amazon also introduced a service called Nova Forge. This service helps companies create their own AI models using their input data. Garman explained that
this allows users to produce a model that deeply understands their information without forgetting the core information that the model was trained on.
Found this article interesting? Follow us on X(Twitter) ,Threads and FaceBook to read more exclusive content we post.
