23.d2s3-8-RISC-V V 擴展軟硬一體優化提升應用性能_Final.pdf

1、RISC-V V 擴展軟硬一體優化提升應用性能芯來科技 胡進Nuclei Technology芯來矢量計算單元-Nuclei VPU2023/9/17Confidential 2023 Nuclei.All Rights Reserved.2 基于Verilog的代碼設計,PPA擁有較大的優勢，易于SoC集成 高主頻，可匹配主核CPU 強大的算力以及靈活的可配置選項 實現VLM Port&Vector Store Buffer，進一步提升VPU 訪存能力 IOCP 端口方便整合外部VPU 單元芯來900 Series Vector 擴展指令實現特點2023/9/17Confidential 2

2、023 Nuclei.All Rights Reserved.3芯來的900系列都支持Vector擴展指令且可配置，包括RV32 N900 和RV64 的NX900/UX900 都按Vector version1.0 實現，其實現的框圖和特色如下：Vector 指令分為三個Queue:常見運算指令;非常見指令;Ld/St 參數可配置 支持1.0 定義的所有Ld/St 指令 支持Vector Chaining 支持 8/16/32/64 整數;8/16/32/64 定點；16/32/64 浮點以及 BF16Nuclei VPU 靈活可配置2023/9/17Confidential 2022 Nu

3、clei.All Rights Reserved.4Nuclei VPU 進一步可配置，以滿足用戶不同場景的需要：P0P1128VLEN=128,DLEN=64VLEN=128,DLEN=128256VLEN=256,DLEN=128VLEN=256,DLEN=256512VLEN=512,DLEN=256VLEN=512,DLEN=512P0配置適合訪存/運算=2 的運算場景，比如FFT；P1 配置適合訪存/運算 2 的場景，比如矩陣乘。不同配置的頻率和面積的數據如下：02004006008001000120014001600vlen128_p0vlen128_p1vlen256_p0vle

4、n256_p1vlen512_p0vlen512_p1Freq(MHz)0500000100000015000002000000vlen128_p0vlen128_p1vlen256_p0vlen256_p1vlen512_p0vlen512_p1Area(um2)tsmc28_hpcp_9t_ssg0p81vm40c_ccs(rvt)1500MHz900系列VLM Port2023/9/17Confidential 2023 Nuclei.All Rights Reserved.5LSUD-Cache/DLMVPULSUVPU EXE UnitSoC Component/Accelerato

5、r/MemMemVector Local Memory Port(VLM):和主核LSU共享memory port性能提升需求可以配置單獨VLM portVLM port可單獨連接加速器及memoryVector Instruction Dispatch UnitMem PortVLM Port02468102562565125121024102420482048RVV?FFT?no?optno?optvpu(VLEN=128)vpu(VLEN=128)vpu(VLEN=512)vpu(VLEN=512)NUCLEI?VPU?2023/9/17Confidential 2022 Nuclei.

6、All Rights Reserved.60102030405060708090(128,?32)(128,?32)(256,?64)(256,?64)(512,?128)(512,?128)(1024,?128)(1024,?128)RVV?CONVno?optno?optvpu(VLEN=128)vpu(VLEN=128)vpu(VLEN=512)vpu(VLEN=512)051015202530(128,?32)(128,?32)(256,?64)(256,?64)(512,?128)(512,?128)(1024,?128)(1024,?128)RVV?FIRno?optno?optv

7、pu(VLEN=128)vpu(VLEN=128)vpu(VLEN=512)vpu(VLEN=512)010203040506016x1632x3264x64128x128RVV?GEMMno?optno?optvpu(VLEN=128)vpu(VLEN=128)vpu(VLEN=512)vpu(VLEN=512)y?:?X?:?y?:?X?:?y?:?X?:?y?:?X?:?NUCLEI?VPU?2023/9/17Confidential 2022 Nuclei.All Rights Reserved.7111111111.12108.0912.4817.0930.5615.51404.43

8、395.19429.2856.1107.5657.83050100150200250300350400450sincos1/xsqrtexplog幾個超越函數的RVV優化no optvpu(VLEN=128)vpu(VLEN=512)2023/9/17Confidential 2022 Nuclei.All Rights Reserved.8NUCLEI?VPU?Store?Buffer?00.511.522.533.5basevstore bufferNuclei VPU Store BufferVector Store BufferVector StoreVector LoadLoad指令

9、可以bypass更早的Store指令Vector StoreVector StoreVector LoadNUCLEI 900 IOCP方便整合外部VPU2023/9/17Confidential 2023 Nuclei.All Rights Reserved.900 Cluster WrapperCluster Debug ModuleJTAG/cJTAGCluster Interrupt ModuleECLIC/PLICUX9009UX90016-ways Cluster CacheIO Coherence Port(IOCP):保障加速器與CPU的緩存一致性讀?。簭腃ore的緩存讀取數據如果Miss則去系統級緩存讀取存寫：Invalidate每個Core的緩存數據存寫到系統級緩存靈活配置，接口數量可選方便整合外部加速器、VPU等UX900UX900Nuclei Bus FabricNuclei NAcc(NPU)IOCP PortTHANK YOU