Finding NVIDIA-card compatible NIM models and running their docker containers locally

Поділитися
Вставка
  • Опубліковано 18 гру 2024

КОМЕНТАРІ • 1

  • @FreemanSoft
    @FreemanSoft  3 місяці тому

    I made a mistake when I recorded the video and corrected it with some annotations. TP1, TP2, TP4, TP8 are measures of Tensor Parallelism and not tensor core generations. I have one video card so in general I look at the TP1 models.