Use Data Preparation and Modeling to Improve Analytics [LRN1196].pdf

1、Use Data Preparation and Modeling to Improve Analytics(LRN1196)September 9-12,2024Las Vegas,NVOracle CloudWorld Copyright 2024,Oracle and/or its affiliates1The following is intended to outline our general product direction.It is intended for information purposes only,and may not be incorporated into

2、 any contract.It is not a commitment to deliver any material,code,or functionality,and should not be relied upon in making purchasing decisions.The development,release,timing,and pricing of any features or functionality described for Oracles products may change and remains at the sole discretion of

3、Oracle Corporation.The materials in this presentation pertain to Oracle Health,Oracle,Oracle Cerner,and Cerner Enviza which are all wholly ownedsubsidiaries of Oracle Corporation.Nothing in this presentation should be taken as indicating that any decisions regarding the integration of any EMEA Cerne

4、r and/or Enviza entities have been made where an integration has not already occurred.Oracle CloudWorld Copyright 2024,Oracle and/or its affiliates2Safe harbor statement3PresentersOracle CloudWorld Copyright 2024,Oracle and/or its affiliatesGregHollandInformation Architect,OIT Business AnalysisUnive

5、rsity of Texas at ArlingtonBretGrinsladeVice President,Product ManagementOracle AnalyticsLuisRivasDirectorOracle AnalyticsIntro to Oracle Analytics PlatformUTAs Path to World-Class AnalyticsDatasets in OAC OverviewDemoQ&AAgenda4Oracle CloudWorld Copyright 2024,Oracle and/or its affiliatesOracle Anal

6、yticsOracle CloudWorld Copyright 2024,Oracle and/or its affiliates5Converged Analytics Platform for all Personas,Workloads and DataOpen ConnectivityOracle Cloud|Third Party Cloud|On-PremisesDashboardsDistributedPixel-Perfect Reports1Data VisualizationSelf-Service Data PreparationSemantic ModelsQuery

7、 FederationStorytellingDirect ConnectivityBriefing BooksData ExportCollaborationMobileVoice&ChatbotNatural LanguageData Profiling&EnrichmentGen AIAutomated InsightsMachine LearningGoverned AnalyticsLOB Self-Service AnalyticsAugmented AnalyticsOracle AnalyticsOracle CloudWorld Copyright 2024,Oracle a

8、nd/or its affiliates6Data Platform and CatalogConnectPrepareModelExploreShareConsumeData VirtualizationSemantic ModelsConverged Analytics Platform for all Personas,Workloads and DataGoverned AnalyticsLOB Self-Service AnalyticsAugmented AnalyticsLiveConnectivityQueryFederationIn-Memory AccelerationSe

9、curedRemote AccessDatasetsEnrichmentsRecommendationsData FlowsSequencesML ModelsData ProfilerTransformationML/AI PlatformsRemote ScriptsBriefing BooksReport BurstingAnnotationsExport OptionsSimplified ACLSocial IntegrationDashboardsReportsMobileStoriesEmbeddedPodcastsAPIsWorkbooksDashboardsReportsAn

10、alysisExplainAuto InsightsScenariosOne-Click AAAnalytics ExperiencesOracle CloudWorld Copyright 2024,Oracle and/or its affiliates7Analytics Data PlatformComprehensive Data Virtualization and Data Preparation platform enabling high-performance business-facing semantics on top of Heterogeneous Data So

11、urces and AI/ML assets.In-Memory Data EngineDatasetsSemanticModelsSequences Remote Data GatewayData FlowsData SourcesQuery GenerationML/AI Platforms and ServicesAccessLayerConnectivityData FlowsOracle CloudWorld Copyright 2024,Oracle and/or its affiliates8Extend you dataset modelling with advanced d

12、ata preparation and data flows.Lightweight ETLJoin and Union data togetherBranch to create multiple output datasetsAggregate data without complex SQL statementsAdvanced DB AnalyticsTrain and/or apply ML models in low code environment(time series forecasting,binary classifier,clustering,etc.)Data Vir

13、tualization with Semantic Modeling9Oracle CloudWorld Copyright 2024,Oracle and/or its affiliatesLive queries to federated and heterogeneous data sourcesBusiness semantics model for Analytics users Hide physical data sources complexityOpen SMML standard(Semantic Model Markup Language)Enable code deve

14、lopers and scriptingGit integrationVersion control,compliance,team developmentOur path to world-class analyticsOracle CloudWorld Copyright 2024,Oracle and/or its affiliates10UTA OAC BackgroundBegan using OAC/OBIEE in 2019 to give users across the university a new option for back-office/operational r

15、eporting.Built an OBIA-based data warehouse to store data from PeopleSoft FMS,HCM,and Campus Solutions.Data warehouse now has many customizations and has expanded to include data from our LMS(Canvas),Endpoint Management systems,advising scheduling(MS Bookings),and several other tools.Began using mor

16、e advanced features of OAC including Datasets and Data Flows a couple years ago.Now have over 200 regularly used workbooks and several hundred users.11Oracle CloudWorld Copyright 2024,Oracle and/or its affiliatesUsing DatasetsOracle CloudWorld Copyright 2024,Oracle and/or its affiliates12UTA uses Da

17、tasets and Data Flows within OAC extensively.Data is modelled in Datasets using a combination of RPD-based subject areas,direct connections to source systems when data is not available in our warehouse,and uploaded files which can help augment data used in a Dataset.The ability to mix warehouse-base

18、d RPD subject areas with data not yet available in the warehouse through connectors in OAC has been a game changer.We no longer have to wait until warehouse development to add missing data is complete to continue development for a user,we can prototype it out using the source connection and get a wo

19、rkbook in the users hands much more quickly.After the missing data has been added to the warehouse,adjustments are made in the workbook to reflect that and pull away from using the source system as heavily.This allows us to get new reports in front of users in days and not weeks or months.Using Data

20、 Flows13Oracle CloudWorld Copyright 2024,Oracle and/or its affiliatesData Flows are used as essentially a mini-ETL tool to apply business logic and aggregation at a level that would be time-consuming to develop in the warehouse.The step-by-step availability of data throughout the course of a Data Fl

21、ow allows us to create complex reports pulling from multiple sources not other wise connected to provide value to our departments.One example of this is a payroll vs budget salary report that shows the amount budgeted on a position and the total amount paid on it.This report accounts for multiple pe

22、ople holding a position,it becoming vacant,or having budget changes throughout the year.With Data Flows were able to calculate these amounts throughout the processto give an accurate accounting of spend on a position which allows our departments to know their exact budget availability without manual

23、 calculations.1Datasets were created using source system connections to provide the data needed for this request which included enrollment,student degree plans,and application statuses.234A department needed to monitor several enrollment metrics in near-real time to compare against performance in th

24、e previous year.Using Data Flows,we were also able to build an effective dated view of the same data set as-of the same point in time the previous year.Data Flows were then built around this data to provide a dataset that is updated every 30 minutes providing near real-time enrollment metrics that r

25、equire no additional hands-on work to create.Recent Example14Oracle CloudWorld Copyright 2024,Oracle and/or its affiliatesRecent Example15Oracle CloudWorld Copyright 2024,Oracle and/or its affiliatesRecent Example ContinuedThis allowed us to have a day-by-day comparison of these metrics that our exe

26、cutive team could use in almost real time to make business decisions.Data Flows are scheduled to run every 30 minutes to reduce strain on source databases,the only hit for those is when these Data Flows are ran and not every time a user refreshes a workbook.Without the OAC Datasets and Data Flow fea

27、tures we could not have made this series of workbooks as useful or effective as they have proven to be.65716Oracle CloudWorld Copyright 2024,Oracle and/or its affiliatesOracle CloudWorld Copyright 2024,Oracle and/or its affiliates17DatasetsEasy,Powerful Data ModelingOracle CloudWorld Copyright 2024,

28、Oracle and/or its affiliates18Get your dataConnect to SourcesDirect Connectivity to dozens of sourcesOracle SaaS-ERP,CX,HCM,EPM,NetSuiteData Stores ADW,Oracle DB,SQL Server,other RDBMS,NoSQL,Big Data,Essbase,JDBC,OCI Object StorageApps and Services-Salesforce,REST APIs,Dropbox,Google Analytics.Filte

29、r Source DataFilter data for each participating tableFilter data for each participating fileDefine participating columns and their orderManage Access Mode(Live or Cached)Use computation power data source with live modeTune performance with various caching optionsWrite custom SQL to Join and or aggre

30、gate tablesScheduled full or incremental reloadsVRecently AddedOCI Object Store Google Analytics v4Delta ShareComing SoonDatabricksOData4TrinoJoin your dataCombine Data from Multiple SourcesRelational tables,subject areas,Oracle Applications,files and more.Rich Join SemanticsSupports Inner,Left,Righ

31、t,Full Outer JoinsQuery SemanticsPreserve GrainAlways Include in QueryDimensional ModelingDefine factsExtend facts with dimensionsOracle CloudWorld Copyright 2024,Oracle and/or its affiliates19Coming SoonFree Form Diagram(Demo)Semantic Data ProfilingOracle CloudWorld Copyright 2024,Oracle and/or its

32、 affiliates20New DatasetsProfiling andClassificationKnowledge ServiceValueImmediate SmartInsights Semantic TypeDiscoveryData Quality AssessmentData Repair,Transform and Enrichment REcommendationsRecognizedTypesData QualityInsightsORDER DATEPAYMENT TYPESystem and Custom Knowledge+Recently AddedUpdate

33、d System KnowledgeSupport for Digit KeysComing SoonSupport for Date KeysOracle CloudWorld Copyright 2024,Oracle and/or its affiliates21Instant Visuals of ContentsBar graphs for textHistograms for Dates and Numbers Scrollable Mini Map for PerspectiveData Quality BarAlerts users about data quality iss

34、uesBased on nulls,data type,and semantic typesFilters to see invalid dataInteractive and ResponsiveTemporarily filter data by clicking on bars Replace values using barsInsights are continuously refreshedQuick Column Renames Understand your data with Data Quality InsightsOracle CloudWorld Copyright 2

35、024,Oracle and/or its affiliates22Identifies and recommends remediation of sensitive dataIntelligently recommends Knowledge-based transforms and enrichmentsSmart data repair recommendationsWide array of date part and numbered part extraction recommendationsAge duration calculation recommendationsIde

36、ntify and Remediate Sensitive DataKnowledge Driven Enrichment RecommendationsSmart Data Repair RecommendationsAgingRecommendationsEnrich your data with Semantic RecommendationsRecently AddedTreat As Rx Wizard(Demo)Date Part Extraction RecommendationsOracle CloudWorld Copyright 2024,Oracle and/or its

37、 affiliates23Data Type Specific TransformsText TransformsCase,Grouping,Replace,ConcatenateNumber TransformsVarious Math functions,BinningOracle CloudWorld Copyright 2024,Oracle and/or its affiliates24Data Type Specific TransformsText TransformsCase,Grouping,Replace,ConcatenateNumber TransformsVariou

38、s Math functions,BinningDatesFormatting,date part extracts,agingOracle CloudWorld Copyright 2024,Oracle and/or its affiliates25Data Type Specific TransformsText TransformsCase,Grouping,Replace,ConcatenateNumber TransformsVarious Math functions,BinningDatesFormatting,date part extracts,agingOracle Cl

39、oudWorld Copyright 2024,Oracle and/or its affiliates26Data Type Specific TransformsText TransformsCase,Grouping,Replace,Concatenate Number TransformsVarious Math functions,BinningDatesFormatting,date part extracts,agingRecently AddedDate Duration Wizard(Demo)Advanced TransformsOracle CloudWorld Copy

40、right 2024,Oracle and/or its affiliates27Regular Expression ReplaceSupport of regular expression for powerfulpattern based search and replace transforms Expression Editor for Complex CalculationsCreate complex calculations using expression elements such as SQL Operators,conditional expressions,and a

41、 wide array of functionsSecure your data with role-based filtersOracle CloudWorld Copyright 2024,Oracle and/or its affiliates28Expression Filters on OAC Application RolesCreate expression filters to ensure consumers onlysee data relevant to their roleFilters Enforced at Query TimeFilters are enforce

42、d at query time in workbooksand dashboardsRaw,Transformed,or Enrichment ColumnsFilters can be based on raw,transformed,or enrichment columnsSupport for System VariablesFilters can include system variables such as user()to create filters specific to logged in user|Oracle CloudWorld Copyright 2024,Ora

43、cle and/or its affiliates29Finalize your data productQuick column renamesConvenient ManagementData TypesTreat As PropertyAggregation TypeHide PropertyMake bulk changes with multi-select capabilitySample Values ViewOracle CloudWorld Copyright 2024,Oracle and/or its affiliates30Enrich your data in Wor

44、kbooksAvailable to Workbook authors in Data Elements TreeSimilar to Date Part ExtractionsEliminates dependence on dataset authorWorks for both System and Custom Knowledge enrichmentsCan be turned on/off in inspector for individual datasetsSystem Flag to Enable/Disable globally|Recently AddedOn Deman

45、d EnrichmentsTime Series FunctionsGrouping Calculation WizardDemoOracle CloudWorld Copyright 2024,Oracle and/or its affiliates31Oracle Analytics RoadmapCloud&ServerCurrentUpcomingFutureCalc within CalcData Action target open as customization(dialog,new tab,same tab)Data Action in Embedded ContentNew

46、 and updated visualization(Sankey,Legend)Parameters:Bind parameters to request variablesDashboard filter bar styles:filter chipsConvert Canvas filters to Dashboard filter barMaps:Reference layersMaps:Vector based map backgroundData Action lunch options(same tab,new tab,dialog)Attribute grouping in W

47、orkbook editorGeospatial datatypes in calculations and mapsWorkbook translation supportResponsive LayoutsVector based map layersConditional formatting for Totals and SubtotalsOCI Object Store supportIncremental refresh of DatasetsNew connector to OCI Data Flow,Delta Share,Google Analytics v4REST API

48、 connector and Auth SupportAdvanced connection propertiesAgo function performance optimizationOAC Public JSON APIOracle Analytics AI Assistant(initial deployment)OCI Language AI Custom Models SupportOCI Face DetectionADW Auto ML Model Quality OAS 2025Fully flexible shapesUnified CatalogRest API for

49、OAS Anonymous/public access workbook publishingUpdate cycle selectionSemantic Modeler EPM/Essbase support Dataset Editor Diagram improvements New and updated connectors(Databricks,Trino,OData 4)Support for dates as keys in Custom KnowledgeOracle Analytics AI Assistant(full deployment)Gen AI BYO-LLM

50、integration(OpenAI)Contextual dashboard InsightsContextual dashboard Insights for Subject AreasFilter awareness for auto insightsOCI Document AI Custom Models SupportUpdated home page catalog experienceSaved canvas layoutsSelection StepsMultiple saved Personalization states(bookmarks)Customized tool

51、tipsFolder organization for My CalcsHome page customgroupsShared Watchlists(ACLs)New and updated visualization(Gauge,Gantt)Custom ThemesEmail delivery for Excel exports Actions on toolbar on selectionConditional formatting data via attributesWatchlists based canvas constructionShow/Hide Visualizatio

52、n in canvasHome page customized pagesNew Visualizations(Org Chart)New Dataset diagram capabilitiesNavigation canvas controlsWorkbook in App ModeHidden columns in visualizationsInteractive tooltip toolbarVisualization toolbar redesignMicrosoft Teams integrationAd hoc sets support for subqueries and u

53、nion in workbooks.Time Hierarchies in multi-table datasetsDataset Semantics and presentation organizationDataset hierarchiesDatasets as a source for Subject AreasNew Connectors(SharePoint,OneDrive)Lineage integration with Intelligent Data LakeCatalog integration with Intelligent Data LakeOCI Video A

54、IGen AI BYO-LLM integration(Cohere,llama 3)AI enhanced home page search and AskSimilarity analysis based on Vector AIGen AI Dataset descriptionsGen AI column descriptionsAdditional Gen AI features33Oracle CloudWorld Copyright 2024,Oracle and/or its affiliatesQ&AYoutubebit.ly/OACtubeBlogbit.ly/OABlogPostsIdeaLabbit.ly/OAIdeaLabUser Forumbit.ly/OAUserForumThank youOracle CloudWorld Copyright 2024,Oracle and/or its affiliates34