Inspur Information, Jinan, Shandong, China: Inspur NF5488A5 Supercomputing AI Server

Company: Inspur Information
Nomination Submitted by: Interprose
Company Description: Inspur Information, a leading provider of data center infrastructure, cloud computing, and AI solutions, is the world’s 2nd largest server manufacturer. Through engineering and innovation, Inspur Information delivers cutting-edge computing hardware design and extensive product offerings to address important technology sectors such as open computing, cloud data center, AI, and deep learning.
Nomination Category: Product & Service Categories - Business Technology Solutions
Nomination Sub Category: Business Technology Solution - Other
2022 Stevie Winner Nomination Title: Inspur NF5488A5 Supercomputing AI Server
  1. Which will you submit for your nomination in this category, a video of up to five (5) minutes in length about the the nominated new or new-version product or service, OR written answers to the questions for this category? (Choose one):
    Written answers to the questions
  2. If you are submitting a video of up to five (5) minutes in length, provide the URL of the nominated video here, OR attach it to your entry via the "Add Attachments, Videos, or Links to This Entry" link above, through which you may also upload a copy of your video.

    Written responses with links to supporting materials 

  3. If you are providing written answers for your submission, you must provide an answer to this first question: If this is a brand-new product, state the date on which it was released. If this is a new version of an existing product, state the date on which the update was released:

    Inspur NF5488A5 was released on August 2020

  4. If you are providing written answers for your submission, you must provide an answer to this second question: Describe the features, functions, and benefits of the nominated product or service (up to 350 words):

    Total 308 words used.

    The Inspur NF5488A5 is an AI server powered by eight NVIDIA A100 GPUs fully interconnected with the 3rd generation NVLink plus two of the latest AMD CPUs supporting PCIe4.0. It provides users with ultimate AI performance and ultra-high-speed bandwidth while offering powerful computing support for various AI scenarios such as intelligent customer service, financial analysis, smart city, and intelligent language processing.

    The Inspur NF5488A5 ranks first in single sever performance in MLPerf 0.7, it supports 8 fully interconnected NVLink 3.0 NVIDIA A100 GPUs, and 2 AMD Rome processors enabling PCIe4.0 in a 4U space, NF5488A5 delivers outstanding AI performance of 5 petaFLOPS and ultra-high data throughput, making it ideal choice for a series of AI scenarios such as intelligent image, video and voice processing, financial analysis and virtual assistant. The design of the Inspur NF5488A5 reduces operation and maintenance costs and facilitates ease of installation.

    Customer Application:

    The Inspur-powered GPU cluster “Alex” is the core component of Friedrich-Alexander-Universität Erlangen-Nürnberg through its Erlangen National Center for High-Performance Computing (NHR@FAU) HPC Infrastructure to handle the rapidly growing computing resource demands for ML and MD in scientific research. Alex is among the TOP500 and Green500 of the most powerful and energy efficient HPC systems in the world. It is composed of 32 NF5488A5 and 38 NF5468A5 Inspur GPU servers, providing a total of 256 NVIDIA A100 Tensor Core GPUs and 304 NVIDIA A40 Tensor Core GPUs for maximum GPU computing performance. In addition to the massive GPU resources available, there are 140 AMD EPYC 7713 CPUs, and the total memory capacity is almost 50TB. The cluster is interconnected through a high-speed HDR InfiniBand network, resulting in top-level general-purpose computing with excellent MD and AI performance that runs a multitude of research-specific software with various hardware, while supporting massive ML datasets, molecular dynamics simulations, and improving training efficiency.

  5. If you are providing written answers for your submission, you must provide an answer to this third question: Outline the market performance, critical reception, and customer satisfaction with the product or service to date. State monetary or unit sales figures to date, if possible, and how they compare to expectations or past performance. Provide links to laudatory product or service reviews. Include some customer testimonials, if applicable (up to 350 words):

    Total 184 words used.

    NF5488A5 is one of the most popular AI servers worldwide. In MLPerf Training v1.0, NF5488A5 led the top position in 11 leading benchmarks tests in the closed division. Compared to the best performance of the BERT model in 2020, NF5488A5 decreased training time to 21.15 minutes in 2021, raising the performance up to 56.85%. In addition, NF5488A5 ranked No.1 on DLRM model in MLPerf inference v1.1, with 7.3% higher performance than DGX A100. MLPerf is an independent benchmark suite that measures how fast systems can train models to a target quality metric. Each benchmark is defined by a Dataset and Quality Target.

    Both Gartner and IDC show that Inspur Information has risen from third to second place in the global ranking of server shipments and first in server revenue in China. Between Q4 of 2021 and Q1 of 2022, Inspur Information's sales of servers increased year-over-year, with a growth rate of over 15%, more than twice the average growth rate in the industry. Inspur information also remains No.1 worldwide for AI server market share based on revenue.

  6. You have the option to answer this final question: Reference any attachments of supporting materials throughout this nomination and how they provide evidence of the claims you have made in this nomination (up to 250 words):

    Total 15 words used.

    The following links include information, press releases and videos that demonstrate Inspur Information’s market leadership. 

Attachments/Videos/Links:
Inspur NF5488A5 Supercomputing AI Server
URL MLCommons MLPerf Benchmark Model Inspur Results
URL MLCommons MLPerf Inference v1.1 Results
URL Inspur Information and MEGWARE Help the Friedrich-Alexander-Universität Erlangen-Nürnberg Build an Advanced GPU Cluster for Scientific Research
URL Inspur NF5488A5 8x NVIDIA A100 HGX Platform Review
URL Inspur NF5488A5 Overview
URL Case Study : Inspur Information and MEGWARE Help the Friedrich-Alexander-Universität Erlangen-Nürnberg Build an Advanced GPU Cluster for Scientific Research
URL Video: Inspur NF5488A5 8x A100 GPU AI Server
URL Inspur: Supporting the World in 2021 and Beyond
URL Inspur Information and MEGWARE Build a Leading GPU Cluster for the Friedrich-Alexander-Universität Erlangen-Nürnberg – Performance targets were exceeded in machine learning and molecular dynamics, which are essential to advancing scientific research and d
URL Inspur NF5488A5 Breaks AI Server Performance Record in Latest MLPerf Benchmarks – NF5488A5 completed the ResNet50 model training in only 33.37 minutes, ranking first in single server performance of Resnet50 benchmark.
URL Inspur Information Impresses in AI Performance with 7 Titles in MLPerf Training v1.1 – Inspur won a combined 44 AI benchmark titles during MLPerf 2021.
URL Inspur Information Leads MLPerf™ Inference v2.0 Across All Data Center Closed Division – Large performance gains were seen in image classification, Speech Recognition and natural language processing tasks by 31.5%, 28.5% and 21.3% respectively
URL Inspur Releases 5 New AI Servers Powered by NVIDIA A100 Tensor Core GPUs – Inspur released five new AI servers, which fully support the new NVIDIA Ampere architecture. The new servers support up to 8 or 16 NVIDIA A100 Tensor Core GPUs, with remarkable AI