- Phison’s SSD technique slashes AI coaching prices from $3 million to $100,000
- aiDAPTIV+ software program shifts AI workloads from GPUs to SSDs effectively
- SSDs might change expensive GPUs in huge AI mannequin coaching
The event of AI fashions has change into more and more expensive as their measurement and complexity develop, requiring huge computational sources with GPUs enjoying a central function in dealing with the workload.
Phison, a key participant in moveable SSDs, has unveiled a brand new answer that goals to drastically cut back the price of coaching a 1 trillion parameter mannequin by shifting a few of the processing load from GPUs to SSDs, bringing the estimated $3 million operational expense down to only $100,000.
Phison’s technique entails integrating its aiDAPTIV+ software program with high-performance SSDs to deal with some AI software processing duties historically managed by GPUs whereas additionally incorporating NVIDIA’s GH200 Superchip to boost efficiency and hold prices manageable.
AI mannequin progress and the trillion-parameter milestone
Phison expects the AI trade to achieve the 1 trillion parameter milestone earlier than 2026.
Based on the corporate, mannequin sizes have expanded quickly, shifting from 69 billion parameters in Llama 2 (2023) to 405 billion with Llama 3.1 (2024), adopted by DeepSeek R3’s 671 billion parameters (2025).
If this sample continues, a trillion-parameter mannequin could possibly be unveiled earlier than the tip of 2025, marking a major leap in AI capabilities.
RelatedPosts
As well as, it believes that its answer can considerably cut back the variety of GPUs wanted to run large-scale AI fashions by shifting a few of the processing duties away from GPUs to the largest SSDs and this method might carry down coaching prices to only 3% of present projections (97% financial savings), or lower than 1/25 of the same old working bills.
Phison has already collaborated with Maingear to launch AI workstations powered by Intel Xeon W7-3455 CPUs, signaling its dedication to reshaping AI {hardware}.
As corporations search cost-effective methods to coach huge AI fashions, improvements in SSD know-how might play an important function in driving effectivity features whereas exterior HDD choices stay related for long-term information storage.
The push for cheaper AI coaching options gained momentum after DeepSeek made headlines earlier this 12 months when its DeepSeek R1 mannequin demonstrated that cutting-edge AI could possibly be developed at a fraction of the same old value, with 95% fewer chips and reportedly requiring solely $6 million for coaching.
Through Tweaktown
