The NVIDIA Datacenter Platform accelerates a broad array of workloads, from AI training and inference to scientific computing and virtual desktop infrastructure (VDI) applications, with a diverse range of GPUs, all powered by a single unified architecture. For optimal performance, let Koi Computers help you identify the ideal GPU for your specific workload.
|Features||A100 40GB PCIe||A100 80GB PCIe||A100 40GB SXM||A100 80GB SXM||A30|
|FP64||9.7 TFLOPS||5.2 teraFLOPS|
|FP64 Tensor Core||19.5 TFLOPS||10.3 teraFLOPS|
|FP32||19.5 TFLOPS||10.3 teraFLOPS|
|Tensor Float 32 (TF32)||156 TFLOPS | 312 TFLOPS*||82 teraFLOPS | 165 teraFLOPS*|
|BFLOAT16 Tensor Core||312 TFLOPS | 624 TFLOPS*||165 teraFLOPS | 330 teraFLOPS*|
|FP16 Tensor Core||312 TFLOPS | 624 TFLOPS*||165 teraFLOPS | 330 teraFLOPS*|
|INT8 Tensor Core||624 TOPS | 1248 TOPS*||330 TOPS | 661 TOPS*|
|INT4 Tensor Core||–||661 TOPS | 1321 TOPS*|
|GPU Memory||40GB HBM2||80GB HBM2e||40GB HBM2||80GB HBM2e||24GB HBM2|
|GPU Memory Bandwidth||1,555GB/s||1,935GB/s||1,555GB/s||2,039GB/s||933GB/s|
|Max Thermal Design
|Multi-Instance GPU||Up to 7 MIGs @ 5GB||Up to 7 MIGs @ 10GB||Up to 7 MIGs @ 5GB||Up to 7 MIGs @ 10GB||4 GPU instances @ 6GB each
2 GPU instances @ 12GB each
1 GPU instance @ 24GB
|Interconnect||NVIDIA® NVLink® Bridge for 2 GPUs: 600GB/s **
PCIe Gen4: 64GB/s
PCIe Gen4: 64GB/s
|PCIe Gen4: 64GB/s
Third-gen NVLINK: 200GB/s**
Koi Computers is a 2021 NVIDIA Preferred Solution Provider. Having deployed hundreds of NVIDIA Solutions to the Federal Government, Koi Computers is a trusted and qualified partner in delivering NVIDIA solutions accelerating Artificial Intelligence, Deep Learning, and HPC Applications.
Whether you need help strategizing or designing your next data center solution, Koi Computers can help! Our expert engineering team can plan, design, validate, and size the right solution for scalability, optimal performance, and rapid efficiency.
Koi Computers’ integration team can rack and stack a complete turkey solution saving time and resources for your organization. Using only quality components and a rigorous burn-in and testing process, we ensure your data center solution is reliable.
Our engineer team can deliver fully integrated and tested rack solutions that are ready to deploy. Eliminate uncertainty with our team of professional technicians and installers, ensuring field reliability and consistency right out of the crate.
With access to our HPC Accelerate Lab and world-class Intel test tools, we can work with you to test and benchmark your application to ensure the solution meets your performance needs and lowers your total cost of ownership.