[ad_1]
Microsoft Azure is dedicated to offering its prospects with industry-leading real-world AI capabilities. In December 2021, Microsoft Azure debuted its management efficiency with the MLPerf coaching v1.1 outcomes. Azure debuted at primary amongst cloud suppliers and quantity two general at scale amongst all submitters. Azure’s supercomputer’s constructing blocks had been used to generate the leads to our v2.0 submissions for the MLPerf inferencing outcomes revealed on April 6, 2022.
These industry-leading outcomes are pushed by Microsoft’s publicly obtainable supercomputing capabilities designed for real-world AI inferencing workloads. Microsoft permits prospects of all scales to deploy highly effective AI options, whether or not at a centered native scale or on the scale of the biggest supercomputers on this planet.
Microsoft Azure’s publicly obtainable AI inferencing capabilities are led by the NDm A100 v4, ND A100 v4, and NC A100 v4 digital machines (VMs) which are powered by NVIDIA A100 SXM and PCIe Tensor Core graphics processing items (GPUs). These outcomes showcase Azure’s dedication to creating AI inferencing obtainable to all in essentially the most accessible means—whereas elevating the bar for AI inferencing in Azure.
In our quest to repeatedly present the very best know-how for our prospects, Azure has not too long ago introduced the preview for the NC A100 v4. With this introduction of the NC A100 v4 sequence, we have now supplied our prospects with three totally different VM sizes starting from one to 4 GPUs. From our benchmarking, we have now seen greater than two instances efficiency over the earlier technology. Azure’s prospects can get entry to those new techniques as we speak by signing up for the preview program.
Some highlights for this spherical of MLPerf inferencing submissions may be seen within the following tables.
Highlights from the outcomes
ND96amsr A100 v4 powered by NVIDIA A100 80G SXM Tensor Core GPU
| Benchmark | Samples/second | Queries/second | Situations |
| bert-99 | 27,500 plus | ~22,500 plus | Offline and server |
| resnet | 300,000 plus | ~200,000 plus | Offline and server |
| 3d-unet | 24.87 | Offline |
NC96ads A100 v4 powered by NVIDIA A100 80G PCIe Tensor Core GPU
| Benchmark | Samples/second | Queries/second | Situations |
| bert-99 | ~6,300 | ~5,300 | Offline and server |
| resnet | 144,000 | ~119,600 | Offline and server |
| 3d-unet | 11.7 | Offline |
The above tables showcase three of the six benchmarks the group ran utilizing NVIDIA A100 SXM and PCIe Tensor Core GPUs for offline and server situations respectively. Check out the full checklist of outcomes for the assorted divisions.
Azure works carefully with NVIDIA
The outcomes had been generated by deploying the atmosphere utilizing the VM choices and Azure’s Ubuntu 18.04-HPC market picture. We labored carefully with NVIDIA to rapidly deploy the atmosphere and carry out benchmarks with industry-leading leads to efficiency and scalability.
These outcomes are a testomony to Azure’s give attention to providing scalable supercomputing for any workload whereas enabling our prospects to make the most of “on-demand” supercomputing capabilities within the cloud to resolve their most advanced issues. Go to the Azure Tech Neighborhood weblog to learn the steps to breed the outcomes.
Extra about MLPerf
MLPerf is a consortium of AI leaders from academia, analysis labs, and {industry} the place the mission is to “construct truthful and helpful benchmarks” that present unbiased evaluations of coaching and inference efficiency for {hardware}, software program, and companies—all carried out underneath prescribed situations. To remain on the chopping fringe of {industry} tendencies, MLPerf continues to evolve, holding new checks at common intervals and including new workloads that symbolize state-of-the-art AI. MLPerf’s checks are clear and goal, so customers can depend on the outcomes to make knowledgeable shopping for selections. The {industry} benchmarking group, shaped in Might 2018, is backed by dozens of {industry} leaders. The benchmark checks throughout inferencing are more and more changing into the important thing checks that {hardware} and software program distributors use to reveal efficiency. Check out the full checklist of outcomes for MLPerf Inference v2.0.
[ad_2]
