生成式 AI：炒作與現實的結合 新一波AI浪潮已經出現.pdf

1、Generative AI:Hype meets RealityMohannad AbuissaCTO-Cisco Middle East&AfricaTurkey,Romania and CiSCisco ConfidentialScarcityAbundanceCisco Confidential8 BILLION80 BILLIONCisco ConfidentialPublic&Private Data CentersAI-Ready Data CentersEvolving Apps&InfrastructureFoundation for Generative AI Reality

2、Cisco ConfidentialCisco AI Readiness Index 2024Foundational Technologies-LLM/deep learning/automationCompanies that leverage foundational technology to build products and services Businesses deploying these AI powered services to achieve specific outcomesEnd users HypeThe Real Impact1234AI:Hype vs R

3、ealityWhat we set out to achieveMeasure ReadinessAddress Gaps in readinessWhat challenges,if any,they are facing as they address these?Current and future ROI on AI InvestmentsStrategyInfrastructureDataTalentGovernanceCultureThe foundational building blocksAI Readiness:Feel that urgency to deploy AI/

4、AI-powered technologies has increased in the past six months98%Companies say CEO and the leadership team are top drivers of urgency to deploy AI50%The urgency to deploy AI continuesAI Readiness:The CEO and the Leadership team are driving the urgency,closely supported by the Board of Directors and Bu

5、siness Unit Leaders.Global AI Readiness is flatlining/decliningCompanies are investing,but gains arent meeting expectationsThe pressure to succeed is relentlessKey takeawaysAI Readiness:Limited PreparednessGlobal AI Readiness1%23%48%28%6%48%31%15%15%43%29%13%9%49%26%16%6%46%33%16%17%43%32%9%3%51%33%

6、13%OverallStrategyInfrastructureDataGovernanceTalentCultureUnpreparedModerate PreparednessFully PreparedGap85%59%13%Between urgency and ability is especially startlingFeel they have 18 months to show value or lose competitive advantage59%give it only 12 monthsOf companies are fully ready to capture

7、AIs potential(down from 14%)Networks are not equipped to meet AI workloadsData CenterComputeCybersecurityTop 3 challengesLack of TalentCybersecurity RisksLong lead timesTop areas where businesses are deploying AICybersecurity42%of companies at full/advanced deploymentIT Infrastructure39%of companies

8、 at full/advanced deploymentData Analytics&Management36%of companies at full/advanced deploymentAI Readiness123Whats NextWhat can organizations do to boost AI Readiness?Look long-term and think bigBuild infrastructure for the futureBreakdown data silosKeep people at the coreDeploy timely internal po

9、licies&protocolsOptimize the modelUse the modelModel the worldEvery organizations AI approach and needs are differentBuild the modelUse the modelBuild the modelModel the worldEvery organizations AI approach and needs are differentOptimize the modelUse the modelBuild the modelModel the worldEvery org

10、anizations AI approach and needs are differentOptimize the modelUse the modelBuild the modelModel the worldEvery organizations AI approach and needs are differentOptimize the modelOptimize the modelUse the modelModel the worldEvery organizations AI approach and needs are differentBuild the modelPods

11、 of plug-and-play data center fabricsCisco 6000 Series switchesCisco Nexus Hyperfabricfor AIAI Cluster in partnership with NVIDIACloud-managed operationsVisibility into full stack AIDemocratize AIBuilt on Cisco Silicon One and Optics innovationsNVIDIA GPU/DPU/NICBlueField-3NVIDIAAI Enterprise NIMCis

12、co UCSAcceleratedVAST StorageCisco UCSAcceleratedBuilding high-density GPU servers to the Cisco UCS family&to Ciscos AI solution portfolioUCS Accelerated UCS C885A M8Nvidia HGX with8 Nvidia H100 GPUs AMD Mi300X2 AMD 4th GenEPYC ProcessorsDiscover data-intensive use cases like model training and deep

13、 learningUse the modelBuild the modelModel the worldEvery organizations AI approach and needs are differentOptimize the modelData Center Networking Blueprint for AIAvailable NowAI PODs NexusUCSNexus Dashboard and IntersightNVAIE|NIMSEdge Inferencing(7B-13B Parameter)RAG Augmented Inferencing(13B+Par

14、ameter)Large Inferencing Cluster(Inferencing Multiple Models)Large Scale RAG Augmented Inferencing(70B+Parameter)AI toolingKubernetesAccelerated computeConverged infrastructureAutomationLarge language modelsOperationsLAN and SAN networkingDownload the Cisco AI Readiness ReportTake the Cisco AI Readiness Assessment