Hi Damnang, appreciate your great in-depth analysis. My question is if eliminating DSP can save 10W per module, and if we assume 144 DSPs per rack of GB200 NVL72 which consumes 120-130kW, it's only 1% of the total power consumption? Isn't it so small to make power saving a compelling case for cpo adoption?
Yes, I agree. If we only look at one GB200 NVL72 rack, removing DSP power may save only around 1% of total rack power, so that alone is not a strong case for CPO.
But I do not think CPO should be framed as a simple rack level power saving story. The real value is in networking power per bit, bandwidth density, thermal headroom, signal integrity, and reliability as AI clusters scale.
So to me, CPO is less about saving 1% of today’s rack power and more about making the next generation of AI cluster networking physically and economically scalable.
I completely agree with your view on the more profound benefit that CPO will have on overall AI computing landscape! Just wanted to get your expert view on the power saving benefit since I heard some people framing power saving as the key benefit. Appreciate your insight!
Hi Damnang, appreciate your great in-depth analysis. My question is if eliminating DSP can save 10W per module, and if we assume 144 DSPs per rack of GB200 NVL72 which consumes 120-130kW, it's only 1% of the total power consumption? Isn't it so small to make power saving a compelling case for cpo adoption?
Yes, I agree. If we only look at one GB200 NVL72 rack, removing DSP power may save only around 1% of total rack power, so that alone is not a strong case for CPO.
But I do not think CPO should be framed as a simple rack level power saving story. The real value is in networking power per bit, bandwidth density, thermal headroom, signal integrity, and reliability as AI clusters scale.
So to me, CPO is less about saving 1% of today’s rack power and more about making the next generation of AI cluster networking physically and economically scalable.
I completely agree with your view on the more profound benefit that CPO will have on overall AI computing landscape! Just wanted to get your expert view on the power saving benefit since I heard some people framing power saving as the key benefit. Appreciate your insight!
매우 잘 읽었습니다. 좋은 글 감사합니다.
감사합니다 🥹
What’s your take on SIVE as a laser supplier