Subscribe
Topic

Storage

Storage for AI clusters and LLM serving. Posts cover GPU cluster storage with GPUDirect Storage and NVMe-oF, multi-tier KV cache offloading across HBM, DRAM and NVMe, and Chinese NAND flash maker YMTC's IPO filing.

Articles

1-2
  1. GPU Cluster Storage in Production: GPUDirect Storage, NVMe-oF, Parallel File Systems, and Checkpointing Throughput

    Training frontier large language models and serving hundred-billion parameter checkpoints places extreme demands on storage subsystems. While compute clusters frequently deploy thousands of GPUs connected via high-bandwidth interconnects like NVLink and InfiniBand, storage architectures often become severe bottlenecks during two critical operational phases: distributed checkpointing and cold-start model weight loading. A standard 70-billion parameter model in BF16 precision generates approximat

    AI
    7 min read
  2. Chinese NAND Flash Maker YMTC Files for $4.9B Shanghai STAR Market IPO

    The Shanghai Stock Exchange has accepted the listing application for Yangtze Memory Technologies Corp (YMTC) and parent entity CCSH Corporation, setting up a 33 billion yuan ($4.9 billion) initial public offering on China's science and technology-focused STAR Market. The offering marks the third-largest float in the history of the STAR Market, trailing only foundry Semiconductor Manufacturing International Corporation (SMIC) and DRAM manufacturer ChangXin Memory Technologies (CXMT). Offering

    Hardware
    1 min read