Training and inference silicon with HBM, dense SRAM and aggressive clocks