$MRVL $COHR $LITE 🚨 MARVELL IS TURNING ITS CELESTIAL AI PHOTONICS INTO A MEMOR… · @carrioresearch · TwKit

@carrioresearch

$MRVL $COHR $LITE 🚨 MARVELL IS TURNING ITS CELESTIAL AI PHOTONICS INTO A MEMORY PRODUCT: ONE OPTICAL BOX SHARES UP TO 32 TB OF DDR5 ACROSS 16 AI SERVERS, AND ITS SIMULATION RUNS 6X THE CONVERSATIONS SUNNYVALE, Oct. 20 - Ravi Mahatme, a senior product director in the Photonic Fabric business unit at Marvell ($MRVL), told Optica's PECC Summit that AI inference has outgrown memory that sits inside a single server, according to Converge Digest's report from the room published Oct. 22. "The time has come to stop thinking of memory as a component," he said. - Photonic Fabric Memory Appliance: 128 standard DDR5 DIMM slots for 16 TB or 32 TB, plus about 1 TB of HBM3e used as a cache - Sharing: up to 16 servers or AI processors see one shared address space over fiber, at about 25 to 30 meters of reach, so across racks - Two ways in: a PCIe Gen6/CXL card at 2 Tbps and about 300 ns loaded latency, or a chiplet inside the processor package at more than 16 Tbps and about 230 ns - Simulation: about 300 concurrent conversations versus 50 at a similar time to first token, on the same compute What it stores is the KV cache, the context a model keeps so it doesn't recompute a conversation from scratch. Longer reasoning and agent sessions make that cache bigger than GPU memory can hold. I put the talk next to Marvell's Feb. 2 release closing the Celestial AI deal, which is where Photonic Fabric came from. That release targets first revenue in the second half of fiscal 2028, a $500 million annualized run rate in that year's fourth quarter, which ends around late January 2028, and $1 billion by the fourth quarter of fiscal 2029. The appliance specs Mahatme showed in Sunnyvale match the ones he presented at Hot Interconnects on Aug. 20, per Converge Digest's coverage of both talks, so the design has held for two months. Coherent, Lumentum and Nokia came to PECC to talk about laser supply. Marvell came to talk about what that light gets used for next, and its answer was memory.

曝光 580 · 评论 0 · 点赞 6 · 书签 3