What is GPU Cluster?
AI InfrastructureLast updated:
A group of interconnected servers with multiple GPUs used for training and serving large AI models.
GPU clusters provide the compute power needed for training frontier models and serving high-throughput inference. They use high-speed interconnects like NVLink and InfiniBand to coordinate across thousands of GPUs, with costs running millions of dollars.