AMD ROCm Code Suggests BFloat16 Support in Future GPU

A recent GitHub update for AMD's open-source ROCm software suggests that future AMD GPUs might support the increasingly popular BFloat16 numeric format for deep learning training, following in the footsteps of Google, Intel, and Arm.

The update on GitHub was a commit in the ROCm Software Platform Repository, AMD’s open-source HPC platform for GPU computing, titled “more BF16 TN sizes.” The reference to BF16, short for BFloat16 or bfloat16, suggests that AMD might implement it in hardware in a future GPU architecture.

To learn more about the format, head to our recent deep dive