NVIDIA AI unveils nGPT: Hypersphere-Based Transformer Boosts AI Training 20x Faster
Nvidia AI presents the Normalized Transformer (nGPT). The hypersphere-based transformer enhances the LLMs’ stability and makes training 4-20 times faster. NVIDIA researchers have created the...