Frontier model builders that rent GPUs from clouds and neoclouds have to run their model weights on hardware they don’t control. NVIDIA is pitching a fix for that with Confidential Bare Metal, a deployment option it says lets model builders run sensitive workloads on third-party infrastructure “while retaining control of their models and data.”
NVIDIA announced the option in a blog post Wednesday during GTC Berlin. It is the third piece of what the company now calls a converged security architecture for NVIDIA Confidential Computing, alongside Confidential Containers for Kubernetes and Confidential Virtual Machines for virtualized environments.
Owning the whole stack on someone else’s racks
The bare-metal mode is aimed at labs that want to run their own host and platform software rather than accept a provider’s hypervisor. To make that workable, NVIDIA said it is adding platform security controls that protect data in transit, measure platform integrity and enforce hardware-level access restrictions.…