Supermicro® SystemsPowered by NVIDIA GPUsfor Best AI Inference Performance Using NVIDIA TensorRT: NVIDIA AI Software from the NGC Catalog for Training and Inference White Paper

2022-02-23
●Executive Summary
■Deep learning inferencingto process camera image data is becoming mainstream. With the availability of high-resolution network cameras, accurate deep learning image processing software, and robust, cost-effective GPU systems, businesses and governments are increasingly adopting these technologies. The use cases include retail inventory tracking, on-premise security, insurance claim damage assessment, medical image diagnosis, and many other applications.
■This document demonstrates the benefits of using NVIDIA NGC and NVIDIA TensorRT to get the best inference performance using Supermicro systemspowered by NVIDIA GPUs. It also shows how to set upNGC on a Supermicro server and how to use TensorRT for inference. The primary focus of this paper is about the key capabilitiesof Supermicro systemspowered by NVIDIA GPUs for inference. Benchmark data that Supermicro engineers collected, sizing recommendations, and server selection for inference deployment are also included in this paper.

SUPERMICRO

SYS-6029U-TR4SYS-2029GP-TRSYS-4029GP-TVRT

More

Part#

server

More

retail inventory tracking ]on-premise security ]insurance claim damage assessment ]medical image diagnosis ]Retail self-checkout ]Self-driving cars ]monitoring ]

More

White Paper

More

More

Please see the document for details

More

More

English Chinese Chinese and English Japanese

2020/11/11

Rev6

000_WP-Template_Rev6

533 KB

- The full preview is over. If you want to read the whole 14 page document,please Sign in/Register -
  • +1 Like
  • Add to Favorites

Recommend

All reproduced articles on this site are for the purpose of conveying more information and clearly indicate the source. If media or individuals who do not want to be reproduced can contact us, which will be deleted.

Contact Us

Email: