YH002 Mezzanine Server 768GB
A GPU server designed for large-scale model applications, supporting the latest Intel® Xeon® Scalable processors, with high-capacity memory and ultra-high-speed I/O interfaces.Each server is equipped with eight YH002 GPU card modules and four switch interconnect chips, supporting a massive aggregate bandwidth of 12.8 TB/s via full interconnection of eight TP16 cards.
CPUs
2x Intel 8558（48 ядер，2.1ГГц）
RAM
1,5ТБ (24x 64ГБ)
Accelerators
8x YH002 Module 96GB
Storage
2x 960G SATA SSD + 4x 3.84T NVME SSD
Pre-order
Product status
CPU & Memory
CPU
2x Intel 8558（48 ядер，2.1ГГц）
RAM
1,5ТБ (24x 64ГБ)
RAM Type
-
Storage Configuration
SSD Model
-
Total Storage
2x 960G SATA SSD + 4x 3.84T NVME SSD
Disk Interface
-
GPU Configuration
GPU Vendor
YH
GPU Model
YH002 Module 96GB
GPU Count
8
Total VRAM
768ГБ HBM3e
Interconnect
YHLink 1200ГБ/c
Network & Virtualization
Network Interfaces
DH E310 (2*25Гбит/с) + 8x DH E316 (2*200Гбит/с) или MLX CX7(2*200Гбит/с)
Virtualization (MIG)
-
CUDA Compatibility
Не зависит от совместимости с CUDA, нативно поддерживает основные фреймворки
Power & Thermal
Power Supply
-
TDP
8 600 - 11 200
Cooling Type
Пассивное
Server Specifications
Technical ID
YH002 Mezzanine Server
Platform
YH
Form Factor
8U
Warranty
3
Primary Tasks
Обучение LLM,распределённое обучение, высоконагруженный inference, построение масштабируемых AI-кластеров
Price
On request