Create a Data Pipeline with Data Transforms in Autonomous Database Data Studio [PRSH2978].pdf

1、Create a Data Pipeline with Data Transforms in Autonomous Database Data StudioJayant Mahto,Autonomous Database Product ManagementSeptember 10,2024Oracle CloudWorld Copyright 2024,Oracle and/or its affiliates1AgendaOracle CloudWorld Copyright 2024,Oracle and/or its affiliates2Introduce Data Transform

2、sData sourcesHigh performance architectureODI to Data Transforms migration serviceDemoHow to create data pipelineGlimpse of immediate futureModern Data Platform pillars3DataVirtualizationAmazon GlueData CatalogsData Lake File FormatsData integrationsourcesData SharingSecure object store accessModern

3、 Data Platform pillars4Data integrationsourcesDataVirtualizationAmazon GlueData CatalogsData Lake File FormatsData SharingSecure object store accessOracle CloudWorld Copyright 2024,Oracle and/or its affiliates5Load data from any sourceTransform data to support any business needBuilt-in tool in Auton

4、omous DatabaseAlso available in OCI GoldenGateserviceData sources and targetsOracle CloudWorld Copyright 2024,Oracle and/or its affiliates6Classifying data sources for simplificationData source type and formatsDatabasesApplicationsFiles/formatsWeb Services/REST/CustomBulkIncrementalRealtimeStreaming

5、InitialData movement mode Target platformSorry,it was hard to fit all the data sources in one slide.AutonomousData WarehouseAutonomousTransactionProcessing ATPExadataCloudAny on-premises Oracle DB 11.2.0.4+Any GoldenGate on-premisesOCI MySQL DB ServiceOCI StreamingAutonomousJSON DBOCI Object Storage

6、ADW Stage-Mergew/Obj StoreAny on-premises Oracle DB 11.2.0.4+OCI GoldenGate DeploymentsOCI Object StorageReal-time Sources/TargetsReal-time TargetsBulk Data Transforms Sources&TargetsData sources and targetsNote:Data Transforms integrates with GoldenGate service for real-time requirementData process

7、ing architecture:Extract-Load-Transform(E-L-T)Oracle CloudWorld Copyright 2024,Oracle and/or its affiliates8E-L-T provides a flexible architecture for optimized performanceBenefitsLeverages set-based transformationsFewer network hops.None required for transformation alone!Improves performance for lo

8、adingTakes advantage of existing infrastructure:hardware and softwareNext Generation Architecture“E-L-T”TransformTransformExtractLoadTransformExtractLoadConventional ETL architectureOracle CloudWorld Copyright 2024,Oracle and/or its affiliates9Connection to all kinds of data sourcesRich transformati

9、on capabilityHigh performanceOption for existing Oracle Data Integrator(ODI)customers to migrateOracle CloudWorld Copyright 2024,Oracle and/or its affiliates10Option for existing ODI customers to migrate Provided by Oracle Cloud Engineering Services Tool to Scan current ODI repository and assess the

10、 coverage Convert compatible objects automatically Convert remaining objects manually Announced in July 2024 BlogNote:ODI continues to be developed 11DEMOLoad data from any sourceTransform data with drag and drop UICreate and schedule workflowSome exciting features coming soonVector embedding for si

11、milarity searchLoading to Iceberg tablesSQL to graphical dataflowBuild and Expand Your Modern Data Platform12Autonomous Database Get StartedExplore video and blog resources to get started with Autonomous databaseLearnFree hands-on lab Data Studio-Self-service tools for everyone using Oracle Autonomo

12、us DatabaseReadBlogVarious blogs on Data TransformsRead our BlogsNews and best practices for autonomous database from product teamDatawarehosueInsiderhttps:/ Transforms workshop in LivelabsData Transforms blogs13Oracle CloudWorld Copyright 2024,Oracle and/or its affiliatesTry Everythingfor FREEAI So

13、lutions HubOracle LiveLabsOracle Database F these steps to earn your free swag!1.Scan the QR code and complete our survey2.Visit us at the Demogrounds3.Show your survey confirmation4.Claim your FREE SWAG!We value your feedback!Oracle CloudWorld Copyright 2024,Oracle and/or its affiliates14Complete these steps to earn your free swag!1.Scan the QR code and complete our survey2.Visit us at the Demogrounds3.Show your survey confirmation4.Claim your FREE SWAG!We value your feedback!Oracle CloudWorld Copyright 2024,Oracle and/or its affiliates15Of people love free swag!99%Thank you16