SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints
Amazon SageMaker Inference now supports GPU partitioning with NVIDIA Multi-Instance GPU (MIG), which divides one GPU into hardware-isolated partitions so you can run a different model in each or take a right-sized fraction of a newer accelerator. This post shows how two optional API fields place one model per partition, and what we measured against a whole older GPU.
Contenu original affiche; la traduction localisee n'est pas encore disponible.
Ce qui s'est passé
Amazon SageMaker Inference now supports GPU partitioning with NVIDIA Multi-Instance GPU (MIG), which divides one GPU into hardware-isolated partitions so you can run a different model in each or take a right-sized fraction of a newer accelerator. This post shows how two optional API fields place one model per partition, and what we measured against a whole older GPU.
Pourquoi c'est important
The development may change operating conditions or market expectations around NVIDIA, Amazon. Further confirmation and measurable outcomes matter.
Entités concernées
Voir les preuves
1 articles · 1 publication d'origine · 1 independantes
- AWS Machine Learning BlogSource primaire · Confirme · EN · 100%SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints ↗
Affirmations
- SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints Observé
Divergences
Aucune divergence importante détectée dans les preuves disponibles.
Chronologie
- Premier signalement
Mouvement de marché suivant l'événement
La réaction du marché n'est pas encore disponible pour cet actif et cette fenêtre.