Menu

AI Labs Get a Bare-Metal Option for Keeping Models Private on Rented NVIDIA GPUs
📰

AI Labs Get a Bare-Metal Option for Keeping Models Private on Rented NVIDIA GPUs

#webpronews#news#nvidia#confidential#cloud
Reading 0:00
15s threshold

Frontier model builders that rent GPUs from clouds and neoclouds have to run their model weights on hardware they don’t control. NVIDIA is pitching a fix for that with Confidential Bare Metal, a deployment option it says lets model builders run sensitive workloads on third-party infrastructure “while retaining control of their models and data.”

NVIDIA announced the option in a blog post Wednesday during GTC Berlin. It is the third piece of what the company now calls a converged security architecture for NVIDIA Confidential Computing, alongside Confidential Containers for Kubernetes and Confidential Virtual Machines for virtualized environments.

Owning the whole stack on someone else’s racks

The bare-metal mode is aimed at labs that want to run their own host and platform software rather than accept a provider’s hypervisor. To make that workable, NVIDIA said it is adding platform security controls that protect data in transit, measure platform integrity and enforce hardware-level access restrictions.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.