NIM - NVIDIA Inference Microservices - Setup and Walkthrough, Utilizing Dell PowerEdge XE9680

This time we tackled the newly announced NVIDIA Inference Microservices. In this blog, we show what is included in NIM and more importantly, how easy it is to stand one up.
The purpose of NIM is to simplify the deployment of the required stack to handle inference workload.