AMD Instinct MI300X GPU Accelerator

AMD Instinct MI300X GPU Accelerator

Brand: AMD | Category: GPUs

SKU: AMD-100000001076 | Part #: 100-000001076 | MPN: 100-000001076

Contact for Pricing — Request a Quote

Request a Quote Contact Us

About the AMD Instinct MI300X GPU Accelerator

The AMD Instinct MI300X is a next-generation CDNA 3 architecture GPU accelerator purpose-built for AI/HPC workloads at massive scale. Featuring 192GB of HBM3 memory with 5.3TB/s aggregate bandwidth, the MI300X delivers exceptional throughput for LLM training, fine-tuning, and inference operations while minimizing data movement bottlenecks that constrain model performance. The processor integrates 304 compute units with support for FP8, BF16, FP16, and FP32 precision modes, enabling flexible optimization across model architectures from dense transformers to mixture-of-experts configurations. Its substantial memory capacity and bandwidth advantage positions it as a direct competitor to NVIDIA's H100 in supporting trillion-parameter model workloads and complex multi-GPU training topologies.

Ideal for

  • Large language model (LLM) pre-training and continued training for models exceeding 70 billion parameters
  • Real-time inference serving for generative AI applications requiring sub-100ms latency at enterprise scale
  • Multi-model fine-tuning and domain-specific adaptation of foundation models across organizational silos
  • High-performance computing (HPC) molecular dynamics, climate modeling, and computational fluid dynamics simulations
  • Recommendation system training and inference for e-commerce and social media platforms processing billions of daily interactions
  • Batch processing and synthetic data generation for machine learning pipeline acceleration in regulated industries

Technical specifications

ManufacturerAMD
Product LineInstinct MI300X
ArchitectureCDNA 3
GPU Memory192GB HBM3
Memory Bandwidth5.3TB/s
Memory Interface12-channel HBM3
Compute Units304 CUs
Stream Processors19,456
Peak FP8 Performance1.46 exaFLOPS
Peak FP16 Performance728 TFLOPS
Peak FP32 Performance364 TFLOPS
Peak FP64 Performance182 TFLOPS
L3 Cache384MB
TDP750W
Interconnect200Gbps per direction (8x links)
PCIe Interface5.0 x16
Manufacturing Process5nm
ECC SupportFull single/double-bit detection and correction
Supported Precision ModesFP8, BF16, TF32, FP16, FP32, FP64
Software StackAMD ROCm 5.6+, PyTorch, TensorFlow, MIGraphX
Form FactorDual-slot GPU accelerator card

Available from Omnixon Global. Submit an RFQ and our team will confirm configuration and availability for your order.

Technical Specifications

BrandAMD
CategoryGPUs
SKUAMD-100000001076
Part Number100-000001076
ConditionNew
Product LineInstinct MI300X
ArchitectureCDNA 3
GPU Memory192GB HBM3
Memory Bandwidth5.3TB/s
Memory Interface12-channel HBM3
Compute Units304 CUs
Stream Processors19,456
Peak FP8 Performance1.46 exaFLOPS
Peak FP16 Performance728 TFLOPS
Peak FP32 Performance364 TFLOPS
Peak FP64 Performance182 TFLOPS
L3 Cache384MB
TDP750W
Interconnect200Gbps per direction (8x links)
PCIe Interface5.0 x16
Manufacturing Process5nm
ECC SupportFull single/double-bit detection and correction
Supported Precision ModesFP8, BF16, TF32, FP16, FP32, FP64
Software StackAMD ROCm 5.6+, PyTorch, TensorFlow, MIGraphX
Form FactorDual-slot GPU accelerator card