6590 - Balancing Compute Memory and Networking for AI (Broadcom).pdf

《6590 - Balancing Compute Memory and Networking for AI (Broadcom).pdf》由會員分享，可在線閱讀，更多相關《6590 - Balancing Compute Memory and Networking for AI (Broadcom).pdf（11頁珍藏版）》請在三個皮匠報告上搜索。

1、FROM IDEAS TO IMPACT!SVP&GM,Core Switching GroupBroadcomRam VelagaCopyright 2025 Broadcom.All Rights Reserved.The term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.ComputeMemoryNetworkingBalancing compute,memory&networking for optimal performanceScale-up for AICompute,Memory&Networking fo

2、r AIXPUHBMCopyright 2025 Broadcom.All Rights Reserved.The term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.AI Scale-up and Scale-out NetworkingSpineLeafScale-upScale-outCopyright 2025 Broadcom.All Rights Reserved.The term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.XPUHBMHBMH

3、BMHBMXPUHBMHBMHBMHBMXPU Scale-up:High Bandwidth Memory Sharing Across XPUs4 x HBM3E(9.6Tbps)38.4Tbps8 x HBM4(12.8Tbps)102.4TbpsCopyright 2025 Broadcom.All Rights Reserved.The term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.XPU Scale-up RequirementsHigh bandwidthEfficient data transferRe

4、liable connectivity123XPUHBMHBMHBMHBMCopyright 2025 Broadcom.All Rights Reserved.The term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.Copyright 2025 Broadcom.All Rights Reserved.The term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.Addressing Scale-up NetworkingVery high bandw

5、idth per XPUReliable and power efficient interconnect(copper or fiber)Directly connecting 512+XPUsHigh bandwidth Ethernet switches:50Tbps 100Tbps 200Tbps Advanced semiconductor manufacturing 5nm 3nm 2nm+Increasing SerDes lane speeds:100G 200G 400GNot constrained to one rackCopper,CPC,lower power plu

6、ggables&CPOCopyright 2025 Broadcom.All Rights Reserved.The term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.Addressing Scale-up Networking(contd)Low-latencyLink level retryOptimized headersPFC or credit-basedflow controlEfficiencyReliabilityCopyright 2025 Broadcom.All Rights Reserved.The

7、 term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.Scale-up Ethernet Deployment ExamplesXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPU204.8TXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPUXPU204.8T204.8T204.8T64 XPU NodesCompute TraysCompute

8、TraysCompute Trays189161891617242532128 XPU NodesCopyright 2025 Broadcom.All Rights Reserved.The term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.OCP ContributionsDrive a broad ecosystem to build high performance,efficient and reliable scale-up systemsScale-up rack architectureScale-up a

9、ccelerator specificationXPUMemory Semantics Data link&Physical LayersRack Architecture Copyright 2025 Broadcom.All Rights Reserved.The term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.Ethernet for Scale-up and Scale-out Delivered SpineLeafScale-upScale-out13Broadcom Proprietary and Confidential.Copyright 2023 Broadcom.All Rights Reserved.The term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.|Copyright 2025 Broadcom.All Rights Reserved.The term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.Thank You