Tag: tensor parallelism

Tensor Parallelism 101: Multi-GPU Inference for Large Language Models

Learn how Tensor Parallelism enables large LLM inference by splitting model weights across GPUs. Discover why NVLink is critical, how to implement it with vLLM or TGI, and when to avoid it.