You are currently viewing SemiWiki as a guest which gives you limited access to the site. To view blog comments and experience other SemiWiki features you must be a registered member. Registration is fast, simple, and absolutely free so please, join our community today!
A single remark from Jensen Huang was enough to jolt the global storage market. During his CES keynote, the Nvidia CEO described a new AI storage architecture that could become “the largest storage market in the world,” triggering a sharp rally across memory stocks. As traders rushed to interpret the implications, a photo circulating online appeared to show a Phison flash controller inside Nvidia’s next-generation Vera Rubin server—fueling speculation that a major supply-chain shift was underway.
Speaking directly from CES, Phison CEO K.S. Pua offered an exclusive and more nuanced response, cutting through the market noise. This piece unpacks what Huang’s comment really means, where the true storage opportunity lies, and why flash memory is becoming unavoidable in the future of AI—even if the biggest winners are not who the market initially expects.
I really do not understand why Micron does not have grander expansion plans. Are they not as competitive as Samsung and Hynix? Why is the manufacture in America not big for memory? Without memory there will be no need for logic.
Yup, data center disaggregated inference can benefit tremendously from new tiering of fast, high-capacity shared KV cache storage instead of leveraging the traditional CPU-oriented storage hierarchy/tiering.
AI‑native organizations increasingly face scaling challenges as agentic AI workflows drive context windows to millions of tokens and models scale toward trillions of parameters.
developer.nvidia.com
We’re seeing GPU-centric hardware turn into application-specific accelerators for transformer-based LLMs using specialized and co-optimized:
* Context/prefill hardware - Rubin CPX
* Shared KV cache storage (inference context memory)
* Decode - Groq (coming) ?
* Processor interconnect/networking/switching