Private endpoints for storage trip a lot of people up, and it's almost always DNS. If the privatelink.blob.core.windows.net zone isn't linked to the VNet, or the endpoint has no DNS zone group, clients resolve the public IP and get a 403 because public access is off.
The pieces you need:
Storage account with publicNetworkAccess: 'Disabled'
Private DNS zone privatelink.blob.${environment().suffixes.storage}
A virtualNetworkLinks entry linking it to your VNet (or hub)
The private endpoint with groupIds: ['blob']
A privateDnsZoneGroups child on the endpoint so Azure manages the A record for you
Step 5 is the one most examples skip.
Happy to share the full Bicep if anyone wants it.