3058ThefutureoftestautomationforIBMzOSHybridApplications.pdf

1、October 21-24,2024Mandalay Bay Convention CenterLas Vegas,Nevada3058The future of test automation for IBM z/OS Hybrid ApplicationsGerald MitchellIBM,Chief Z Test Tools ArchitectThe future of test automation for IBM z/OS hybrid applicationsIBM IBM TechXchangeTechXchangeSession#3058The future of test

2、automation for IBM z/OS hybrid applicationsGerald MitchellChief,IBM Z Test Tools Architect#IBMTechXchangeLearn more about mainframe program testing with me at#IBMTechXchangeIBMTechXchangeCreate mainframe Create mainframe program tests,from unit program tests,from unit to integration!to integration!H

3、ands on labHands on lab1955Monday 1:30 PM-3:00 PM South,Breakers H,Level 2Open Mainframe Open Mainframe ProjectProject:How is:How is Integration Testing in Integration Testing in Hybrid Cloud Possible?Hybrid Cloud Possible?SessionSession3727 Monday 4:00 PM-4:30 PM South,Jasmine F,Level 3Test Acceler

4、ator for Z Test Accelerator for Z enabling continuous enabling continuous improvement with improvement with DevOps DevOps Featured DemoFeatured Demo4116Wednesday 12:00-3:00 PMIBM Z and LinuxONE Sandbox#850The future of test The future of test automation for IBM automation for IBM z/OS Hybrid z/OS Hy

5、brid Applications Applications SessionSession3058 Thursday 8:00 AM-9:00 AMSouth,Mandalay Bay F,Level 2https:/ Gerald MitchellGerald M STSM-Test Tools Chief ArchitectTest Tools Chief ArchitectIBM Z Hybrid Cloud,DevX and AI IBM Z Hybrid Cloud,DevX and AI IBM Test Accelerator IBM Test Accelerator forfo

6、r Z ZIBM watsonIBM watsonx x Code Assistant Code Assistant forfor z z Validation AssistantValidation AssistantAgenda010203040506z/OS Hybrid Applications under TestA Testing PrimerTest Accelerator for ZUnit and component testingIntegration testingOn-demand environmentsIBM TechXchange|2024 IBM Corpora

7、tion#IBMTechXchange5What you will learn in this sessionIBM TechXchange|2024 IBM Corporation01 What to test on02 When to test to optimize value03 Why you shift left to test04 Who can test05 Where to test to get the most benefit06 How to test the hard-to-reach casesThe best of the mainframe and the in

8、novation of CloudSaaSPrivate cloudPublic cloudCLOUD CLOUD PAKSPAKS6Web Browserz/OS ApplicationsPrivate/Public CloudApplicationCICSBATCHIMSData Access LayerBusiness LayerPresentation/Integration LayerUI-3270API/WebserviceCICS/IMS Send MAPPipelines|z/OS Connect|HTTP(s)COBOL,PL/I modulesEXEC SQL|IMSz/O

9、SDb2IMS DBVSAM FilesOther z/OS Apps.TransactionsLE|CICS|IMS(?)MQMQSC?Open API,Soap over HTTP(s)Execution EnvironmentsCICSIMSBatchMobileWeb ApplicationsJDBC Type 4 Distributed web apps,thick clientsOther z/OS applicationsz/OS z/OS ApplicationsApplicationsTodays challenges while enhancing a Hybrid Clo

10、ud ApplicationBuild ProvisionDeployTestDeb can only test after deploymentHer workflow is interruptedHer changes are often impacted by other changes Debugging in shared environments is difficultToby cannot build automation for specific zos componentsCodeBuild(Early Development testing for z/OS)Provis

11、ion(On-demand Dev and Test Environment for z/OS)DeployTest(Integration test builder for z/OS)Hybrid Cloud DevOps with IBM Test Accelerator for ZCommit LineAgenda010203040506z/OS Hybrid Applications under TestA Testing PrimerTest Accelerator for ZUnit and component testingIntegration testingOn-demand

12、 environmentsIBM TechXchange|2024 IBM CorporationThe Ice Cream ConeSlowFastCostlyCheapIBM Test IBM Test Accelerator for ZAccelerator for ZSystemSystemUnit TestingUnit TestingComponent Integration TestingComponent Integration TestingUser User AcceptanceAcceptanceTesting Testing The Testing PyramidAct

13、ual users test the software to ensure the change meets business requirement Testing to verify various aspects of the system-performance,functional,and integrationIntegration tests that verify the integration between components i.e.various programs A way of testing a smallest piece of code or applica

14、tion that can be practically isolated at a program levelTypes of testing:Types of testing:Integration TestingResourcesSlowFastCostlyCheapCommit LineThe Testing Story today.CodeIBM Developer for z/OSEnterprise Edition(IDz EE)Eclipse or VS CodeBuild and TestPre deploymentIBM Infosphere Optim productsO

15、ptim Test data ManagementOptim Test data fabricationOther Optim productsProd/Prod-CloneTest DataGalasa test automation frameworkProvisionDeployPost deploymentIBM Z with deployed AppTestIBM DevOps Test portfolio(RPT,RFT,RIT,RTVS)System testUser Acceptance testEnd user testTestUnit TestingApplication

16、Integration Test(Isolated integration test)IDz EE Dependency Based Build(DBB)IBM Test Accelerator for z IBM Test Accelerator for z(TAZ)(TAZ)z/OS Isolated Testing Environments IBM TAZ On-demand Dev and Test for z/OS(ODTz)Integration to Test and CI/CD pipeline 2024 IBM12The idea of early stubbed tests

17、Makes a code change for Program A part of a CICS transaction ABCDInvokes transaction ABCD to test the change Test FailsChecks in codeDeploys changes to the CICS regionDid the tests fail due to my change?Maybe its an existing issue with another program in the transactionShould I run more tests?Should

18、 I run with a debugger?Is someone else making changes to my program?Maybe its the environment?Continuous TestingStubbed integration tests New version of application packaged ready for deploymentApplication deployedFull integration tests executedDeployment package generatedApplication deployed to tes

19、t environmentsIntegration tests executedRELEASEBetter quality happier customersAny branch,stream or workspace(useful for shift left testing)Unit tests executed against the build output PDSE libraryCode checked out from SCMCode built and unit tests executedStubbed integration tests executedIntegratio

20、n to Test and CI/CD pipeline 2024 IBM14Agenda010203040506z/OS Hybrid Applications under TestA Testing PrimerTest Accelerator for ZUnit and component testingIntegration testingOn-demand environmentsIBM TechXchange|2024 IBM CorporationIBM Test Accelerator for ZIBM Test Accelerator for Z17#IBMTechXchan

21、geEarly Development Testing Early Development Testing for z/OSz/OS unit testing&component integration testingIntegration Integration TestTest BuilderBuilder for z/OSz/OSOnOn-demand Dev demand Dev and Test Test environment for z/OSz/OSTest Test Accelerator Accelerator for for Z ZDetect earlier.Resolv

22、e faster.18#IBMTechXchangeTest Test Accelerator Accelerator for for Z ZDetect earlier.Resolve faster.Capability Automation frameworks for unit and integration tests Recording data capture,along with unit test data generation,to accelerate test creation and improve test code coverage Supports mainten

23、ance of tests in a modern SCM Flexibility to spin up temporary z/OS environments Enables teams to adopt continuous integration practices for z/OS applicationsUse Cases Pre-commit,pre-deployment testing,without middleware Regression testing Post-commit,post-deployment testing and flexible infrastruct

24、ureBenefits Less time testing and fixing leads to increased release velocity Increased code quality Lower cost and risk Agenda010203040506z/OS Hybrid Applications under TestA Testing PrimerTest Accelerator for ZUnit and component testingIntegration testingOn-demand environmentsIBM TechXchange|2024 I

25、BM CorporationWeb BrowserCloud Applicationz/OS ApplicationComponent/Transaction20Unit Testing Unit Testing Early Integration Early Integration TestingTestingWeb BrowserCloud Applicationz/OS ApplicationTests a single unit “program”Web BrowserCloud Applicationz/OS ApplicationWeb BrowserCloud Applicati

26、onz/OS ApplicationWeb BrowserCloud Applicationz/OS ApplicationComponent/TransactionUnitWeb BrowserCloud Applicationz/OS ApplicationWeb BrowserCloud Applicationz/OS ApplicationWeb BrowserCloud Applicationz/OS ApplicationComponent/TransactionTests the component integration of programs together within

27、a transaction or batch job Provides reusable unit and component integration testing Tests run independently from middleware-prior to deployment,enabling a quick feedback loopIBM Test Accelerator for ZEarly Development Testing for z/OSpowered by IBM Dynamic Test Engine for z/OS21UnitUnitTestingTestin

28、g Provides reusable unit and component integration testing Tests run independently from middleware-prior to deployment,enabling a quick feedback loopIBM Test Accelerator for ZEarly Development Testing for z/OSIn DevelopmentUnit Tests are an adjunct to the source code that they test.They are typicall

29、y stored in a dedicated location in the project source tree.Ideally,they are shared and tracked in the Source Code Management repository for the project.Developers may create,edit and run the Unit Tests during the development phase.This ensures that any code changes are validated against reusable te

30、st cases.Code Coverage may also be used to validate that any changes are tested by the corresponding Unit Tests.Web BrowserCloud Applicationz/OS ApplicationWeb BrowserCloud Applicationz/OS ApplicationWeb BrowserCloud Applicationz/OS ApplicationWeb BrowserCloud Applicationz/OS ApplicationComponent/Tr

31、ansactionUnit22UnitUnitTestingTesting Provides reusable unit and component integration testing Tests run independently from middleware-prior to deployment,enabling a quick feedback loopIBM Test Accelerator for ZEarly Development Testing for z/OSIn a pipelineAs code changes move through a modern DevO

32、ps pipeline,Unit Tests may be run to provide extra validation of various phases.Commonly,Unit Tests will execute during the build phase that results from a series of code deliveries(e.g.,Git Pull Requests).Some build tooling(e.g.,IBM Dependency Based Build)can determine the Unit Tests to run for a s

33、pecific code change by examining the test artifacts for their relevance to the delivered parts.During this phase,code coverage can also be collected and aggregated,to allow tracking of test quality.Web BrowserCloud Applicationz/OS ApplicationWeb BrowserCloud Applicationz/OS ApplicationWeb BrowserClo

34、ud Applicationz/OS ApplicationWeb BrowserCloud Applicationz/OS ApplicationComponent/TransactionUnit23Unit TestingUnit Testing Provides reusable unit and component integration testing Tests run independently from middleware-prior to deployment,enabling a quick feedback loopIBM Test Accelerator for ZE

35、arly Development Testing for z/OSz/OS ApplicationWeb BrowserCloud Applicationz/OS ApplicationComponent/TransactionUnit56%44%40%40%16%40%40%4%I can this branch record easilybut the rest I can not record.BEFOREAFTERI want a test for each path,but I want a test for each path,but some paths are hard to

36、reach.some paths are hard to reach.Test Data Generationbuilt in partnership with IBM ResearchAutomatically generate data to drive hard-to-test pathsto ensure test coverage increase coverage by creating tests for different paths within the program.To reach these paths,I need toTo reach these paths,I

37、need to automate data generation to simplify the creation of negative tests and scenarios.Agenda010203040506z/OS Hybrid Applications under TestA Testing PrimerTest Accelerator for ZUnit and component testingIntegration testingOn-demand environmentsIBM TechXchange|2024 IBM Corporation25EarlyEarlyInte

38、gration TestingIntegration TestingWeb BrowserCloud Applicationz/OS ApplicationComponent/TransactionWeb BrowserCloud Applicationz/OS ApplicationWeb BrowserCloud Applicationz/OS ApplicationWeb BrowserCloud Applicationz/OS ApplicationComponent/Transaction Provides reusable unit and component integratio

39、n testing Tests run independently from middleware-prior to deployment,enabling a quick feedback loopIBM Test Accelerator for ZEarly Development Testing for z/OSComponent Testing for DevelopersComponent Testing for Developers Tests integration of programs together within a transaction or batch jobTes

40、ts integration of programs together within a transaction or batch jobApplication-level testing commonly occurs in a dedicated test environment where the environment must be established and maintained with databases,files and other test collateral.Tester scenarios,using the full application,and pass

41、to development as reusable Tester scenarios,using the full application,and pass to development as reusable tests that can be run outside of the dedicated test environment.tests that can be run outside of the dedicated test environment.Developer to debug or test an application scenario,No need to acc

42、ess the test environment nor set up test conditions dataRun during the development phase as a regression testsensure that code changes or compiler upgrades do not affect the application#IBMTechXchangeEnterprises need a way to detect issues early in the development cycle to improve qualityTodays expe

43、rienceTypically,first level of testing occurs post deployment in a shared dev/test LPAR Perform testing by recreating test data and manually validating results Difficulty in improving code coverage“It takes me hours to perform unit testing for my code and I dont get true feedback on my code until it

44、s deployed”Does an ALTER table in Db2 always need a REORG?“I can generate reusable tests and try my code changes against those tests until the code is ready to be deployed”A new experience A new experience with Early development testing for z/OSEarly development testing for z/OSCreate unit and compo

45、nent integration tests to test your program logic without the need for an environment and before the change is integrated into a shared environment Leverage Test Data Generation to accelerate creation of unit tests by generating data for hard to test scenariosSimplify debugging of complex issues by

46、replaying recorded tests in isolation Perform regression testing for a compiler upgradeAgenda010203040506z/OS Hybrid Applications under TestA Testing PrimerTest Accelerator for ZUnit and component testingIntegration testingOn-demand environmentsIBM TechXchange|2024 IBM Corporation#IBMTechXchange28In

47、tegration TestingIntegration Testing verifies the integration betweenprograms,components,and applicationsUnit and Component Integration Test are early and mock the systems to isolate the testing.Automated testing Manual testing lines up with integration testing,so it is easy to match behaviorally wi

48、th existing usage and testing.Records and runs the test using standard interfaces as manual tests;Functional Testing Able to test function,with a focus on business needs in application behavior Tests the application as a distinct entity.Verify the test passed by inspecting the program response to th

49、e interfaces and the systems of recordTop-down test-driven development(TDD)Use cases can match to Test cases Test cases can be used to record tests for Early Integration and Unit Test scenarios.Modifications of test cases can be used to drive Test Driven Development(failure of tests until they meet

50、functional objective of application)29 Provides reusable integration testing Tests run with middleware-after deploymentIBM Test Accelerator for ZIntegration Test Builder for z/OS powered by IBM Dynamic Test Engine for z/OS and IBM Distribution for GalasaIntegrationIntegration Test Builder for z/OSTe

51、st Builder for z/OS Recording function to create Galasa tests quickly using IBM Dynamic Test Engine for z/OS Tests generated from recordings and are fully compatible with other created Galasa tests.Supports Db2 JDBC Type 4 license jar to remotely connect to Db2 for z/OS.IBM Distribution for Galasa I

52、BM Distribution for Galasa Local isolated MVP core version of Galasa IBM Technical Support eligibilityGalasa(Open Mainframe Foundation)Galasa(Open Mainframe Foundation)Open-source Extensible test automation framework Scalable test scheduling,execution and reporting Deep integration with z/OS,IBM mid

53、dleware,and a range of open-source test tools Integrates with CI/CD pipelines30Integration Testing Integration Testing Provides reusable integration testing Tests run with middleware-after deploymentIBM Test Accelerator for ZIntegration Test Builder for z/OS1 12 23 34 4BMS1.Record the flow for the f

54、unctional business scenario being tested.2.Generate reusable Galasa tests from the recording.3.Run the tests against the deployed application and assert observed behavior and the subsystem interactions.4.Scale test usage with automated test buckets and pipeline inclusion.5.Edit,maintain,and manage t

55、he tests like code and extend the automation to include other application platforms.31What is Galasa test automation framework-Open-source integration test framework-Based on proven technology,donated by internal IBM teams,and used to test IBM Z products-Helps eliminate repetitive manual and semi-au

56、tomated testing-Provides scalable test scheduling,execution and reporting-Ships with interactions to z/OS,IBM Middleware and a range of open-source test tools out of the box-Easy integration with common CI/CD pipeline products-More routine or complex aspects of tests are abstracted into reusable com

57、ponents called galasa.dev repeatable,reliable,automated tests and deliver software changes faster,with confidenceTest hybrid cloud applications,leveraging first class integration with z/OSAgenda010203040506z/OS Hybrid Applications under TestA Testing PrimerTest Accelerator for ZUnit and component te

58、stingIntegration testingOn-demand environmentsIBM TechXchange|2024 IBM CorporationDeveloper sandboxes on Linux on Z and x86Unified experience across target platforms:One Provisioning Tool One Orchestration view One z/OS Stock image(portable)One LicenseGain deployment and provisioning efficiency enha

59、nced tools:IPL preparation tool Cloud preparation toolOn-demand Dev and Test Environment for z/OS Augment development and test environments when needed and minimize complexity caused by shared environments Provide on-demand development and testing horizontal elasticity Custom and fit-for-purpose as

60、needed z/OS environmentsAgenda010203040506z/OS Hybrid Applications under TestA Testing PrimerTest Accelerator for ZUnit and component testingIntegration testingOn-demand environmentsIBM TechXchange|2024 IBM CorporationIBM Test Accelerator for ZDetect earlier.Resolve faster.Address multiple phases Ad

61、dress multiple phases of z/OS application testingImprove code coverage Improve code coverage with unit test data generation for hard to test pathsAccelerate integration test creation Accelerate integration test creation for z/OS application functional tests.Pipeline integration Pipeline integration

62、for continuous unit and integration testing inclusionSpinSpin-upup development and test z/OS environments,Linux on Z or Intel x86Automate developer testsAutomate developer tests while bypassing middleware overhead.#IBMTechXchange36But what is the further future of test automation?Lets discuss.(Q&A)I

63、BM TechXchange|2024 IBM CorporationGerald MitchellIBM,Chief Z Test Tools A(https:/ more:Learn more:Visit the IBM Test Accelerator for Z Product PageRead the executive blogRead the technical blogJoin the Automated Testing communityLearn more about IBM DevOps Acceleration Team (DAT)Request a briefing

64、from your IBM representativeGet ready to accelerate your application testing journey Want to attend an in-personIBM z/OS Academy?Learn,Interact and Network with IBMers and peersTraining and presentations include topics on new z/OS capabilities,best practices,career tips,and much more!Attendees will

65、be eligible to earn a Credly Badge.Join our IBM Community:https:/ibm.biz/zOSAcademyQuestions?Contact us at zOS.Academy.USA or zOS.Academy.EThese free events are designed for early tenure z/OS system programmers(2-10 years),but all are welcome!Week of Nov 18,2024IBM BblingenGermanyWhat if we re-imagi

66、ned the z/OS experience from the ground up?How can z/OS help you be more successful at your job?Public surveyPlease forward this to your mainframer colleagues and friends,too!ibm.biz/nextgen-zos-surveyExperience more here at IBM TechXchangeIBM TechXchange/Session 244540Come to our IBM Z and LinuxONE

67、 Sandbox#850 Come to our IBM Z and LinuxONE Sandbox#850 Experience the world famous plexi and lego!Engage our SMEs,demos,AMAs,community&skills A snapshot of some of the great topicsA snapshot of some of the great topicsAI for mainframe app dev:#2341,3059New chip set,simplification&zNext:#3761Mainfra

68、me AI assistant for ops:#3767,3060Threat detection&Cyber Vault:#2559,3773OTel,IntelliMagic&Instana:#3768,3762All things Data&AI:#3799,3213DevOps,testing&more#1186,3212Skills#3214,1889IBM Z and LinuxONE content in TechXchange catalog#IBMTechXchange41Thank YouGerald MitchellIBM,Chief Z Test Tools A ht

69、tps:/ TechXchange|2024 IBM Corporation#IBMTechXchangeNotices and disclaimersCertain comments made in this presentation may be characterized as forward looking under the Private Securities Litigation Reform Act of 1995.Forward-looking statements are based on the companys current assumptions regarding

70、 future business and financial performance.Those statements by their nature address matters that are uncertain to different degrees and involve a number of factors that could cause actual results to differ materially.Additional information concerning these factors is contained in the Companys filing

71、s with the SEC.Copies are available from the SEC,from the IBM website,or from IBM Investor Relations.Any forward-looking statement made during this presentation speaks only as of the date on which it is made.The company assumes no obligation to update or revise any forward-looking statements except

72、as required by law;these charts and the associated remarks and comments are integrally related and are intended to be presented and understood together.2024 International Business Machines Corporation.All rights reserved.This document is distributed“as is”without any warranty,either express or impli

73、ed.In no event shall IBM be liable for any damage arising from the use of this information,including but not limited to,loss of data,business interruption,loss of profit or loss of opportunity.Customer examples are presented as illustrations of how those customers have used IBM products and the resu

74、lts they may have achieved.Actual performance,cost,savings or other results in other operating environments may vary.Workshops,sessions and associated materials may have been prepared by independent session speakers,and do not necessarily reflect the views of IBM.Not all offerings are available in e

75、very country in which IBM operates.Any statements regarding IBMs future direction,intent or product plans are subject to change or withdrawal without notice.IBM,the IBM logo,and are trademarks of International Business Machines Corporation,registered in many jurisdictions worldwide.Other product and service names might be trademarks of IBM or other companies.A current list of IBM trademarks is available on the Web at“Copyright and trademark information”at: TechXchange|2024 IBM Corporation42