3365 Watsonx and PowerVS - techXchange.pdf

1、October 21-24,2024Mandalay Bay Convention CenterLas Vegas,NevadaSession 3365Kavita Sehgal,Program Director,AI and Cyber Security Product Management LeaderManoj Kumar,Chief Engineer,OpenShift,AI on PowerMaria Ward,Power Virtual Server Product ManagerAccelerate AI and Hybrid Cloud on Power Virtual Ser

2、ver with watsonx#IBMTechXchange2What you will learn in this sessionIBM TechXchange|2024 IBM Corporation01020304050607PowerVSIBM watsonx(Gen)AI and IBM Power clientsWhy Power Virtual Server(PowerVS)and watsonxHybrid-Cloud Journey and ModernizationDemo -banking use case Simplify AI Infusion Client wan

3、ts flexible consumption with no minimum commit/contract No investment in data center space and energy Data sovereignty required in country with no IBM Public Cloud Regulated/sensitive data or workload requirements for on premises Workload has ultra short latency requirements with other on-premises i

4、nfrastructureIBM owned and managed cloud infrastructure enabling hybrid workload placementSecurity&Compliance by designIBM PowerVSwith IBM CloudPower in public cloudIBM PowerVSPrivate CloudCloud at Customer3IBM CloudSame user experience and control planeIBM Power Virtual ServerIntentional workload p

5、lacement with a consistent experience Extension of the Power Platform High-density content421Public data centers across the globe(and growing)now with a private data center option650+Customers deployed with Production,HA/DR,and Dev/Test use casesIBM Power Virtual ServerMarketMomentum8Consecutive qua

6、rters of double-digit revenue growth.Triple digit signings growth The only distributed hybrid infrastructure with a single pane of glass management for workload placement on-and off-premises for Power AIX,IBM i and Linux workloads providing frictionless migration to cloud with the same architecture

7、and support for scale up and scale out providing one consolidated bill with completely flexible consumption The PowerVS Value Hybrid Cloud Journey enabled with PowerVS Create a safe off-prem backup with Cobalt IronSecure automated backup-as-a-service with Compass by Cobalt Iron for AIXNew Solution G

8、uidesOracleDB2SAPDR AutomationPowerHAModernize your workloadsClient LocationCreate a secure off-prem backup?Migrate production workloads to PowerVS?PowerVSBackup to PowerVSMigrate to PowerVSPowerVS to PowerVS BackupSetup HA or DR1.Backup and save to Cloud object Store 2.Set up a Dev/Test environment

9、 in PowerVS3.Migrate production to PowerVS 4.Setup secure automated backup or HA/DR5.Modernize and take advantage of watsonx and other cloud services Setup Test/Dev Environment?Public or PrivateTry it outBackupTestMigrateDRModernizeCreate a Virtual Server Instance/restore backup for test/dev 6The wa

10、tsonx valueScale and accelerate the impact of AI across your businessSelect and tune AI models to fuel your business growthIBM models trained in targeted domainsCurated library of third-party,open-source modelsStudio to train,validate,tune,and deploy modelsScale AI use cases fasterData store to acce

11、ss and share all your data Choice of infrastructure,from on premises to the cloudAI assistants to accelerate adoptionExpertise to take AI from pilot to productionImplement AI with trustAI lifecycle governance,from training and tuning to deploymentModel guardrails and IBM model indemnificationData go

12、vernance,from quality to privacy and compliance#IBMTechXchange8Infuse AI in Mission Critical Workloads with PowerVS&watsonxIBM TechXchange|2024 IBM Corporation Accelerate and optimize your AI transformation efforts to gain competitive edge Improve Client Experience to drive increased consumer demand

13、 with resultant revenue growth Safeguard AI Workflows with world-class data privacy,data protection and cybersecurity technology Embed Responsible AI Governance and Operations Modernize with GenAI services and get faster insights from your mission critical dataGenerative AI goes to work in 202465%of

14、 respondents report that their organizations are regularly using gen AI,2X the percentage from our previous survey just ten months ago.75%predict that gen AI will lead to significant or disruptive change in their industriesAI adoption worldwide has increased dramatically in the past year,after years

15、 of little meaningful change.Generative AI UsageIBM Power 2024 IBM Corporation10What we just saw PowerVSIBM PowerEnterprise Transactional Applications&Datawatsonx SaaSwatsonx.aiLLM ModelsUsing mixtral-8x7b-instruct LLM ModelCore Banking App1Bank personnel types in a request in English to the Gen AI

16、Assistant2Gen AI Assistant calls watsonx.ai API with the user request3watsonx.ai returns the proper SQL statement for query4Gen AI Assistant runs SQL query and displays the resultant output in a table in the chat windowBank Personnel with no Data or AI Skills is more productive and able to gain new

17、insights on their clientsGen AI Assistant1SQL query2Natural Language(+DB Schema)Red Hat OpenShift43SQLExisting Enterprise EnvironmentIBM Power Infrastructure-as-a-service on PowverVS(IBM Cloud)Natura Language to SQL GenerationEnable users to gain insights from enterprise data without the need for le

18、arning/leveraging coding skills(like SQL)Db2 for iIBM i Apps(RPG,Node.js etc.)IBM iData and TransactionsIBM AIX AppsIBM AIX Data and TransactionsSAP ApplicationsSAPData and TransactionsIBM Db2GenAI AssistantUI(React.js/Angular/Carbon Design)API Layer(Python)DB Schema Layer(Python)DB Query Layer(Pyth

19、on)IBM Cloiud SaaSWatsonx.ai servicesAPI callNLP QuerySQL statementRun SQL query against DBWatson Machine Learning(Deploy tuned LLM as API)Foundation Model Library(Pre-packaged LLms IBM and Open-source)/Bring-Your-Own LLMPrompt Lab(Tune LLM)Infuse business application on IBM Power Virtual Server wit

20、h watsonx.ai GenAI assistant to query insights from enterprise DB using Natural Language(Architecture View)#IBMTechXchangeAugmenting models with enterprise dataLogistics Company Use Case?QuestionQuestion“How do I look up a How do I look up a shipping address shipping address using a phone using a ph

21、one numbernumber?”?”Knowledge baseKnowledge base(e.g.,web pages,PDFs,ERP data,forecast data,)(2)Lookup(2)Lookup(3)Relevant documents(3)Relevant documents“4.Address:Check Doc xxx”DomainDomain-specificspecificansweranswer“Check Doc xxx.”(5)Generate(5)Generate(1)Ask(1)AskLarge language Large language f

22、oundation modelfoundation model(e.g.,Llama2-13B,IBM Granite-13B,Flan-UL2,)(4)Question+(4)Question+Clients often use specialized Clients often use specialized Vector DBs Vector DBs on IBM Poweron IBM Power(in addition to Db2,ORACLE,SAP)-Milvus-Chroma-PGVector-Weaviate-OpenSearch-FaissAI-powered Quest

23、ion&Answer(Q&A)system that allows end-customers to ask questions about the product using relative docs as the primary knowledge base.Product support relatedInventory Management relatedProduct feature relatedQ&A App#IBMTechXchange14Drive Business Value with PowerVS and watsonxLeverage pre-built AI se

24、rvices from watsonx co-located with Power applications on PowerVS to drive better business outcomesIBM TechXchange|2024 IBM CorporationConsume AI FasterInfuse your PowerVS-based Business Applications with AI Determine fraud transactions without specialized coding Extract relevant information from po

25、licy documents Create summaries of reports,contracts,etc Complete set of GenAI SaaS services with the watsonx platform Create AI applications faster by leveraging the pre-built services platform and Assistants Leverage the most complete,secure and compliant AI services platform with access to best-o

26、f-breed infrastructure(like GPUs)for tuning GenAI models to your enterprise data.Get the Benefits of co-locating AI with your Enterprise applications and data Generate SQL queries faster to inspect your DB Get your Chatbot queries returned faster Respond to policy summary requests quickerIBM IBM Pow

27、erVSPowerVSwatsonxwatsonx(.ai)(.ai)15GenAI AssistantPowerVSwatsonx SaaS Serviceswatsonx.aiLLM ModelsIBM PowerEnterprise Transactional Applications&DataSQL QueryCo-located to watsonx services with IBM Power Datawatsonx.datawatsonxServices(RAG etc.)watsonx.govAccelerate AI Infusion into Power applicat

28、ionsextend your mission critical/enterprise workflows on Power by infusing GenAI using watsonxDiscover how AI AI withwith IBM PowerIBM Power can help transform your organization.GET BRIEFEDMeet with an IBM AI expert for custom demonstrations of AI with IBM Power capabilities,values,and roadmaps.Unde

29、rstand where AI can be leveraged to impact your organization.INFORM YOURSELFExplore AI with IBM Power yourself with blogs and demos delivered through the IBM Power Developer eXchange community.START PRODUCTIZING AIRequest a use case alignment workshop from your IBM sales representative to drive towa

30、rd your first proof-of-concept in a few weeks.2 4 hours1 4 weeks30 minutes or less16AI with IBM Power:Use Case Alignment WorkshopLets get your line of business and technical teams along with the IBM team in an interactive workshop experience to identify and understand your AI with Power use cases an

31、d align on the business outcome.Workshop Outcomes Generate prioritized list of use-cases Align Business and IT on a single use-case Business opportunity statement and potential valueWhat we need from you:Ideas for leveraging AI to support business priorities 4 to 8 workshop participants(ideally)span

32、ning Line of Business,IT/Development and LeadershipPotential Activities AI landscape Generative AI Creativity Matrix Business value prioritization Business&Technical Feasibility Assessment Use-case prioritization matrix Business opportunity statementIBM Power17Would you like to learn more?IBM Power|

33、Oct 2024We would love to discuss how you can add watsonx AI capabilities to your IBM Power Applications running in PowerVS.QR code:URL:https:/ibm.biz/powervs-watsonx-ibm-powerJoin us in defining the the future of AI with IBM Power.October 21-24,2024Mandalay Bay Convention CenterLas Vegas,NevadaQ&A19

34、IBM TechXchange|2024 IBM Corporation#IBMTechXchange20Thank YouIBM TechXchange|2024 IBM Corporation#IBMTechXchangeSpeakers 21Kavita SehgalProgram Director,AI and Cyber Security Product Management LeaderIBMManoj KumarChief Engineer,OpenShift,AI on Power IBMMaria WardPower Virtual Server Product Manage

35、rIBMIBM TechXchange|2024 IBM Corporation#IBMTechXchangeNotices and disclaimersCertain comments made in this presentation may be characterized as forward looking under the Private Securities Litigation Reform Act of 1995.Forward-looking statements are based on the companys current assumptions regardi

36、ng future business and financial performance.Those statements by their nature address matters that are uncertain to different degrees and involve a number of factors that could cause actual results to differ materially.Additional information concerning these factors is contained in the Companys fili

37、ngs with the SEC.Copies are available from the SEC,from the IBM website,or from IBM Investor Relations.Any forward-looking statement made during this presentation speaks only as of the date on which it is made.The company assumes no obligation to update or revise any forward-looking statements excep

38、t as required by law;these charts and the associated remarks and comments are integrally related and are intended to be presented and understood together.2024 International Business Machines Corporation.All rights reserved.This document is distributed“as is”without any warranty,either express or imp

39、lied.In no event shall IBM be liable for any damage arising from the use of this information,including but not limited to,loss of data,business interruption,loss of profit or loss of opportunity.Customer examples are presented as illustrations of how those customers have used IBM products and the re

40、sults they may have achieved.Actual performance,cost,savings or other results in other operating environments may vary.Workshops,sessions and associated materials may have been prepared by independent session speakers,and do not necessarily reflect the views of IBM.Not all offerings are available in

41、 every country in which IBM operates.Any statements regarding IBMs future direction,intent or product plans are subject to change or withdrawal without notice.IBM,the IBM logo,and are trademarks of International Business Machines Corporation,registered in many jurisdictions worldwide.Other product and service names might be trademarks of IBM or other companies.A current list of IBM trademarks is available on the Web at“Copyright and trademark information”at: TechXchange|2024 IBM Corporation22