SNIA-SDC23-Martin-Molgaard-SNIA-Computational-Storage-Standards.pdf

《SNIA-SDC23-Martin-Molgaard-SNIA-Computational-Storage-Standards.pdf》由會員分享，可在線閱讀，更多相關《SNIA-SDC23-Martin-Molgaard-SNIA-Computational-Storage-Standards.pdf（22頁珍藏版）》請在三個皮匠報告上搜索。

1、1|2023 SNIA.All Rights Reserved.Virtual ConferenceSeptember 28-29,2021SNIA Computational Storage StandardsBill MartinJason Molgaard2|2023 SNIA.All Rights Reserved.AgendaCurrent status of SNIA Computational Storage StandardizationOverview of SNIA CS ArchitectureOverview of SNIA CS APISNIA and NVMe Co

2、mputational StorageCS and SDXI3|2023 SNIA.All Rights Reserved.Current Progress of TWG Output Architectural Document v1.0 Released August 2022 Received the Most Innovative Memory Technology award at FMS 2022 v1.1 under developmentSecurity enhancements for multiple tenants(complete)Sequencing of Comma

3、nds(in-progress)API v0.8 public review version was available June 2022 v0.9 public review version availableIn SNIA Membership vote towards v1.04|2021 Storage Developer Conference.Insert Company Name Here.All Rights Reserved.Architecture Overview2023 Flash Memory Summit.All Rights Reserved5|2023 SNIA

4、.All Rights Reserved.Computational Storage ArchitectureComputational Storage ProcessorComputational Storage ArrayComputational Storage DriveHost 1Host nCSDriverI/OMGMTDevice MemoryComputational Storage Resource(s)Computational StorageEngine(CSE)CSEECSEECSFCSFResource RepositoryCSFCSEECSEECSFFDMAFDMA

5、FDMFabric(PCIe,Ethernet,etc)CSDriverCSDriverCSDriverComputational Storage Processor(CSP)Host 1Host nCSDriverI/OMGMTStorage ControllerDevice StorageDevice MemoryComputational Storage Resource(s)Computational StorageEngine(CSE)CSEECSEECSFCSFResource RepositoryCSFCSEECSEECSFFDMAFDMAFDMFabric(PCIe,Ether

6、net,etc)CSDriverCSDriverCSDriverComputational Storage Drive(CSD)Host 1Host nCSDriverI/OMGMTStorage ControllerStorage Deviceor CSDDevice MemoryComputational Storage Resource(s)Computational StorageEngine(CSE)CSEECSEECSFCSFResource RepositoryCSFCSEECSEECSFFDMAFDMAFDMFabric(PCIe,Ethernet,etc)CSDriverCS

7、DriverCSDriverArray ControlStorage Deviceor CSDTransparent StorageAccessProxiedStorageAccessComputational Storage Array(CSA)CSx=Computational Storage Device CSP or CSD or CSA6|2023 SNIA.All Rights Reserved.A Deeper Dive of the CSx ResourcesCSR-Computational Storage Resources are the resources availa

8、ble in a CSx necessary for that CSx to store and execute a CSF.CSF-A Computational Storage Function is a set of specific operations that may be configured and executed by a CSE in a CSEE.CSE-Computational Storage Engine is a CSR that is able to be programmed to provide one or more specific operation

9、(s).CSEE-A Computational Storage Engine Environment is an operating environment space for the CSE.FDM-Function Data Memory is device memory that is available for CSFs to use for data that is used or generated as part of the operation of the CSF.AFDM-Allocated Function Data Memory is a portion of FDM

10、 that is allocated for one or more specific instances of a CSF operation.7|2023 SNIA.All Rights Reserved.Security Considerations for v1.0 Assumptions The environment consists of a single physical host or virtual host with one or more CSxes The host is responsible for the security of the ecosystem th

11、at the CSxes operate within CSx security requirements are comparable to the security requirements common to SSDs/HDDs Privileged Access Elevated privileges necessary for operations8|2023 SNIA.All Rights Reserved.Security Considerations for v1.1 AssumptionsThe environment consists of multiple physica

12、l hosts or multiple virtual hosts with one or more CSxesCSx security requirements are comparable to the security requirements common to SSDs/HDDs in multi-tenant environment Trust Relationships Elements required for a trust relationship are1.IdentificationExchanged between participating parties2.Aut

13、henticationIs done following identificationExchange of authentication information is done with the same element as Identification3.AuthorizationIs done following authenticationAuthorizes specific actions on specific resourcesMay be done at a lower-level element than the element that was authenticate

14、d4.Access ControlControls access to elements of the CSx that are within the scope of the authorizationMay be access to a CSE,a CSEE,or a CSF Different elements of the trust relationship may be at different levelsIdentification and Authentication may be at the CSxAuthorization may be at the CSEE with

15、in the CSxAccess Control may be at the CSF activated in the CSEE9|2023 SNIA.All Rights Reserved.Sequencing of Commands Enables sequences of CSFs to execute in succession Sequence executes in-order Allows multiple CSFs to execute with minimal host involvement Aggregator CSF Manages execution of the s

16、equence Tracks completion status of each CSF May be downloaded or Pre-installed Fixed Sequence or Variable Sequence defined by parameters passed by the host Error Handling May be handled by the host or the aggregator CSF10|2021 Storage Developer Conference.Insert Company Name Here.All Rights Reserve

17、d.API Overview2023 Flash Memory Summit.All Rights Reserved11|2023 SNIA.All Rights Reserved.SNIA Computational Storage APIs One set of APIs for all CSx types APIs hide device details Hardware,Connectivity Abstracts device details Discovery Access Device Management Memory Management alloc/free/init St

18、orage/Memory Access Download Execute CSFs APIs are OS agnosticDevice StorageDevice MemoryCSFCSEECSFStorage ControllerI/OMGMTResourceRepositoryComputational Storage Engine(CSE)Cloud Computing AppsStorage AppsData Analytics AppsDevice driverSNIA CS API LibraryfabricUser-spaceKernel spaceComputational

19、Storage Drive(CSD)SW functionHW functiondecryptdecompresschecksumsearchcomparesortDB-searcheBPFRTLASICtransformcustomcustomPluginPluginPluginHost SWCSxApplications12|2023 SNIA.All Rights Reserved.Computational Storage APIFor more information about the SNIA CS API,please attend:“Programming Computati

20、onal Storage with the SNIA API”by Oscar Pinto13|2021 Storage Developer Conference.Insert Company Name Here.All Rights Reserved.SNIA and NVMeComputational Storage2023 Flash Memory Summit.All Rights Reserved14|2023 SNIA.All Rights Reserved.NVMe Computational Storage Architectural Components Compute Na

21、mespacesCompute EnginesPrograms Programs operate on data in Subsystem Local MemoryAllocated as Memory Range SetIncludes program input,output NVM NamespacesPersistent storage of dataNVMZNSKV Data is transferred between NVM Namespaces and SLM using the Memory Copy commandThis presentation discusses NV

22、Me work in progress,which is subject to change without notice.Memory Range Set15|2023 SNIA.All Rights Reserved.SNIA Terms Computational Storage Engine Computational Storage Engine Environment Resource Repository Downloaded CSF and CSEE Pre-loaded CSF and CSEE Activation Function Data Memory(FDM)Allo

23、cated FDM(AFDM)Device StorageNVMe Terms Compute Engine/Compute Namespace Virtual(Not currently defined).Programs Downloaded programs Device-defined programs Activation Subsystem Local Memory(SLM)Memory Range Set NVM NamespacesCorrelation of SNIA/NVMe terms16|2023 SNIA.All Rights Reserved.NVMe Comput

24、ational StorageFor more information about NVMe Computational Storage,attend:“NVMe Computational Storage Standards”by Kim Malone and Bill Martin17|2021 Storage Developer Conference.Insert Company Name Here.All Rights Reserved.CS and SDXI Collaboration2023 Flash Memory Summit.All Rights Reserved18|202

25、3 SNIA.All Rights Reserved.SDXI(Smart Data Accelerator Interface)Smart Data Accelerator Interface(SDXI)is:A SNIA standard for a memory to memory data movement and acceleration interface Extensible Forward-compatible Independent of I/O interconnect technology Provides data transformation featuresv1.0

26、 was published November 2022 https:/www.snia.org/sdxi19|2023 SNIA.All Rights Reserved.Combined SDXI+CS Architecture SDXI used for data movement with Computational Storage used for compute Multiple SDXI producers in a CS Architecture SDXI enables data movement across multiple AFDM regionsI/OMGMTStora

27、ge ControllerDevice StorageDevice MemoryComputational Storage Resource(s)Computational Storage Engine(CSE)CSEECSEECSFCSFResource RepositoryCSFCSEECSEECSFFDMAFDMAFDMSDXI Driver+CS ExtensionsFuture CS,SDXI APISDXISDXIHostCS APISDXI Driver+CS ExtensionsStorage Driver+CS ExtensionsHostHostMemoryI/OMGMTS

28、torage ControllerDevice StorageDevice MemoryComputational Storage Resource(s)Computational Storage Engine(CSE)CSEECSEECSFCSFResource RepositoryCSFCSEECSEECSFFDMAFDMAFDMFabric(PCIe,Ethernet,etc)CS APISDXI Driver+CS ExtensionsShared Memory PoolMemoryMemoryFuture CS,SDXI APISDXISDXISDXISDXISDXISDXISDXI

29、 Driver+CS ExtensionsStorage Driver+CS ExtensionsHostMemorySDXISDXISDXISDXISDXICSEE,CSF is SDXI ProducerHost is SDXI ProducerSDXISDXISDXISDXISDXI20|2023 SNIA.All Rights Reserved.CS+SDXIFor more information about CS+SDXI,please attend:“Envisioning a Computational Storage Architecture with an SDXI Dat

30、a Mover:Early Efforts”by Shyam Iyer and Jason MolgaardFor more information about SDXI,please attend:“SNIA SDXI Specification v1.0 and Beyond”by Shyam Iyer21|2023 SNIA.All Rights Reserved.Interested?Join Us!Join SNIA:https:/www.snia.org/member_com/join-SNIAJoin the Computational Storage TWG:https:/members.snia.org/workgroup/index22|2023 SNIA.All Rights Reserved.Please take a moment to rate this session.Your feedback is important to us.