Phison Electronics Corp
群聯電子股份有限公司竹南分公司
Advanced GenAI Fine-tuning 6nm AI SSD solution
Winning Reason
With the use of memory to innovate existing AI computing architectures, the development of AI SSD SoC chips with computing capabilities is officially underway. These chips are manufactured using TSMC's advanced 6nm process technology, integrating cutting-edge storage technologies to accelerate inference speed (TTFT; Time To First Token) and token length processing. These advancements bring us closer to the democratization and widespread adoption of AI, accelerating the integration of AI across various industries to enhance competitiveness and fine-tune AI model training. They address challenges such as cost, data confidentiality, and customization, making them highly suitable for future edge AI applications.
Product Feature
Phison Advanced GenAI Fine-tuning 6nm AI SSD solution is the world's first cutting-edge SSD controller chip with basic computational power specifically designed for GenAI model training and edge AI applications.
It is built on leading TSMC 6nm process and Phison's exclusive patent for NAND flash serving as AI cache memory. The product is provided with basic computational power to offload GPU tasks, revolutionizing the current AI computing unit to greatly reduce High Bandwidth Memory (HBM) and DRAM usage and increase overall computing capability by 40%. It also shortens the hours of AI model training up to 50%, while also offering support of 5 different LLMs.
As a result, these features enhance AI model training and has the best cost-effective than current AI solutions.