ThinkSystem NVIDIA A100 80GB Pci-e Gen4 Passive GPU

Introduction

The NVIDIA A100 Tensor Core GPU delivers unprecedented acceleration—at every scale—to power the world’s highest-performing elastic data centers for AI, data analytics, and high-performance computing (HPC) applications. As the engine of the NVIDIA data center platform, A100 provides up to 20X higher performance over the prior NVIDIA Volta™ generation. A100 can efficiently scale up or be partitioned into seven isolated GPU instances with Multi-Instance GPU (MIG), providing a unified platform that enables elastic data centers to dynamically adjust to shifting workload demands.

NVIDIA A100 Tensor Core technology supports a broad range of math precisions, providing a single accelerator for every workload. The latest generation A100 80GB doubles GPU memory and debuts the world’s fastest memory bandwidth at 2 terabytes per second (TB/s), speeding time to solution for the largest models and most massive datasets.

A100 is part of the complete NVIDIA data center solution that incorporates building blocks across hardware, networking, software, libraries, and optimized AI models and applications from the NVIDIA NGC™ catalog. Representing the most powerful end-to-end AI and HPC platform for data centers, it allows researchers to deliver real-world results and deploy solutions into production at scale.

Processor

CUDA

Y

CUDA cores

8192

Graphics processor family

NVIDIA

Graphics processor

A100

Memory

Discrete graphics card memory

80 GB

Graphics card memory type

High Bandwidth Memory 2 (HBM2)

Memory bandwidth (max)

1.935 GB/s

Ports & interfaces

Interface type

PCI Express x16 4.0

Design

Cooling type

Passive

Power

Power consumption (max)

300 W