Nvidia's New Software Tames LLMs and Improves AI Inference
Nvidia has announced the release of TensorRT-LLM, a new AI inference software that optimizes performance and improves AI inference for large language models (LLM).
Tag
Nvidia
NVIDIA's GH200: The Ultimate Platform for Generative AI
NVIDIA has unveiled its next-generation GH200 Grace Hopper Superchip platform, which is the first to use HBM3e memory technology.