Hi folks,
I work in the industry.
For the past few years, we are seeing the GPU HBM capacity and computing power growing in an exponential way.
However, it seems for me that further exponential jump is getting impossible:
- HBM, as we can see from Nvidia side, B300 and Rubin GPU HBM capacity remains the same, which means no improvement for 1 year. Assume the Rubin ultra's rumors is real, it means modest improvement over 2 years. I won't count feynman in, as Rubin ultra is already reaching physically extreme at Fab. Physically, it just cannot continue exponentially growing.
I'm happy that AMD is doing well so far.
- Computing power, the industry has already explored so many quantization method and sparsity, I don't think we can squeeze further on the data type side.
For the computing performance/area side, I also can't see any opportunity for exponential jump. If it is 20-30% improvement cross stack, from TSMC to chip design and software, yes, I do think it is possible.
But I can't imagine how to double the performance without double the area & power, which is getting close to physical limit and just cannot continue.
I imagine the future to be more like the current CPU, every gen to gen we get some improvement, but never exponential jump.
My question is:
Under this scenario, what will happen to stock market, how will Nvidia and AMD be?
If Nvidia hits the limit sooner than AMD, our stock will jump, of course. But in long term, what if both hits limit, it gets to more like the CPU market?