《Linux基金會：2024年OpenSearch 認知與感知報告（英文版）（30頁）.pdf》由會員分享，可在線閱讀，更多相關《Linux基金會：2024年OpenSearch 認知與感知報告（英文版）（30頁）.pdf（30頁珍藏版）》請在三個皮匠報告上搜索。

1、OpenSearch Awareness and Perceptions ReportStephen Hendrick,The Linux Foundation Adrienn Lawson,The Linux FoundationForeword by Jonah KowallOctober 202448%of users would like to see OpenSearch training and certification courses.73%of users believe that OpenSearch is delivering search capabilities ve

2、ry or extremely well.25%of organizations have experience with OpenSearch.89%of users state that ensuring the long term viability of OpenSearch is important.40%of OpenSearch users want better visibility into how the product drives business value.46%of users license OpenSearch as a managed service.65%

3、report that the benefits of open source software exceed the costs.89%of organizations say that tools to address search,observability,and security analytics are important.91%of OpenSearch users use the product for its search capabilities.88%of organizations view open source softwareas important.87%of

4、 users would like to see better integration of openSearch with other open source projects.92%of organizations rely on open source software.Copyright 2024 The Linux Foundation|October 2024.This report is licensed under the Creative Commons Attribution-NoDerivatives 4.0 International Public LicenseOpe

5、nSearch Awareness and PerceptionsContentsForeword.04Introduction.05The Open Source Difference.07The use and importance of open source software.07Confirming the cost benefit of open source software.08Experience with OpenSearch.10Experience with technology areas relevant to OpenSearch.10Experience wit

6、h OpenSearch.11Experience across OpenSearch technology areas.12OpenSearch usage patterns.13Deployment patterns that OpenSearch users adopt.13User Perceptions of OpenSearch.14User feedback on product capabilities and strategies.14User feedback on product capabilities and strategies of concern.15User

7、feedback on selected OpenSearch product capabilities and strategies.16User feedback on pivotal OpenSearch strategies.18How OpenSearch should increase its adoption.19How OpenSearch can improve its visibility.20Clarifying the difference between OpenSearch software and the Amazon OpenSearch service.21U

8、ser opinions of OpenSearch.22Conclusions.23Continued investment in product capabilities is necessary to retain product momentum and drive adoption.23Product development,offering training&certification,better documentation,and how OpenSearch drives business value,are key to driving product visibility

9、 and adoption.24OpenSearch should transition to oversight by a vendor-neutral foundation.24Methodology.25About the survey.25Data.World access.26Respondent demographics.27About the authors.28Acknowledgements.29About OpenSearch.30About Linux Foundation Research.30ForewordOpen Source is essential to al

10、l,as this important research study confirms.The findings validate why we created the OpenSearch project and subsequently established the OpenSearch Foundation under the Linux Foundation.The importance of this project is now enshrined as an immutable software foundation,but it requires the contributi

11、ons of peoples time along with sponsoring organizations to make it happen.When we created the OpenSearch project three years ago,we wanted to create a pillar for creators to build upon.The community will always be focused on user-centric development.The OpenSearch project has had a focus on deliveri

12、ng use cases around observability,security,search,and building the next generation of AI-assisted experiences.While these could each be different projects,the unified nature of OpenSearch is a strength and will continue to create a platform to solve multiple use cases with the same data.This unifica

13、tion is a trend we see across observability,specifically regarding logging and security.This is reinforced in the research findings as a key area of focus for most users.The community has created and continued to build on these important features and capabilities.With the changes in the foundation,w

14、e will continue to deliver better integration and interoperability with key open source technologies along with broadening the contributors to this important foundational technology.As we go forward,the key tenets of the project will remain in focus:keeping APIs consistent with a limited amount of b

15、reaking changes while advancing on scalability and efficiency.These core goals of the project are well reflected in this research as we listen and work with the community.OpenSearch will enable builders and creators to imagine what is possible.Doing this at scale with lower costs is a key finding of

16、 this research aligned with the future of OpenSearch.Thank you to all the contributors and sponsors who have made this project possible.Heres to continued innovation and building.JONAH KOWALL OpenSearch Leadership Committee42024 OPENSEARCH REPORTIntroductionModern systems rely on microservices archi

17、tecture and containerization to package and run software applications.As Docker initially popularized it in 2013,open source containerization gained significant traction with Googles release of an open source container orchestration platform named Kubernetes in 2015.Industry adoption of Kubernetes q

18、uickly accelerated,leading to CNCFs acceptance of Kubernetes and a significant buildout of the Kubernetes ecosystem,resulting in Kubernetes becoming the de facto standard for container orchestration.Some of the operational benefits of container-based systems include resource efficiency,portability,s

19、calability,better security,and cost efficiency.The development of container-based infrastructure as open source projects drives additional benefits that include engagement across the sizable open source community,development in the open,and a combination of collaboration and knowledge sharing that r

20、esults in faster innovation.The use of containers and microservices represents a more granular approach to resource development and allocation and involves the use of many and often ephemeral containers to support scalability requirements.The complexity of these environments demands far more sophist

21、icated approaches to resource management and the tools to monitor and manage system operations.The design of observability tools provides insight into the internal state and behavior of systems,typically within the context of software applications and infrastructure.They help developers,operators,an

22、d engineers understand how a system is performing,diagnose issues,and ensure reliability.The use of container-based systems is not without its challenges.Systems are complex,resource management is complicated,security is difficult,and observability is critical to ensuring both performance optimizati

23、on as well as incident/event management.Real-time application monitoring,distributed search,security analytics,and visualization are core to monitoring,analyzing,and managing complex container-based systems and applications.Like most cloud service providers,Amazon Web Services(AWS)recognized the nee

24、d to deliver a unified product with the following capabilities to manage container-based applications and systems:Search:to find relevant data across applications,websites,and data lakes to monitor and debug applications and infrastructure Observability:to detect,diagnose,and remedy issues that affe

25、ct the performance,scalability,or availability of applications or infrastructure Security analytics:to address security information and event management(SIEM)and help detect,analyze,and respond to security threatsThe solution was the development of OpenSearch.First announced in January 2021,the Open

26、Search project is an open source fork of Elasticsearch and Kibana.Released for production under the Apache License,version 2.0(ALv2),it is open to contributions from the OpenSearch community.Use cases for OpenSearch include search applications,log-an-event data analysis,business intelligence,securit

27、y information and event management,and time series data analysis.For more information on OpenSearch,see https:/opensearch.org.52024 OPENSEARCH REPORTThe OpenSearch Project engaged Linux Foundation Research in 2023Q4 to develop and execute an empirical research study to understand the awareness,perce

28、ption,and competitive characteristics of OpenSearch.The target audience included respondents who met the following criteria:Must be a Linux Foundation subscriber,member,or contributor Must be familiar with the Linux Foundation(to ensure understanding of or involvement with open source)Must work full

29、 time or part time in the information technology field Must be in an IT role aligned with development,deployment,operations,or support Must have familiarity with one or more areas or tools that address search,observability,or security analyticsLinux Foundation Researchs survey development occurred i

30、n 2023Q4,and the survey happened in 2024Q1,yielding 689 completed surveys.For more information about the survey methodology and survey demographics,see the About the survey chapter at the end of this report.62024 OPENSEARCH REPORTThe Open Source DifferenceThe use and importance of open source softwa

31、reOrganizations use of open source software is pervasive,and its importance is uniformly high.The top chart in Figure 1 shows that 92%of organizations use open source software at some,high,or extremely high levels.The addition of organizations that report a slight use of open source software drives

32、this value to 98%.The use of open source software has remained consistently high over the last several years.Linux Foundations research into SBOMs and cybersecurity readiness back in 2022 also shows open source use at 98%.1The bottom chart in Figure 1 also shows that 88%of organizations view open so

33、urce software as either extremely important,very important,or important.Adding the 9%that identify open source software as slightly important to this total means that 97%of organizations view open source software as being important.The success and steadily increasing adoption of open source software

34、 over the last decade originated because of its cost-effectiveness,open standardization,and avoidance of vendor lock-in.More recently,open source has benefited from increasing developer support and collaboration,organization-sponsored contributions,Internet maturity,and the advent of cloud computing

35、.FIGURE 1:THE USE AND IMPORTANCE OF OPEN SOURCE SOFTWAREHow much does your organization rely on open source software?(select one)Extremely high useHigh useSome useSlight useNo use2024 Search&Analytics Survey,Q13,Sample Size=689,DKNS responses excluded from the analysisHow important is open source so

36、ftware to the organization you work for?(select one)Extremely importantVery importantImportantSlightly importantNot important at all2024 Search&Analytics Survey,Q39,Sample Size=689,DKNS responses excluded from the analysis22%32%37%33%32%23%6%9%1.“Software Bill of Materials and Cybersecurity Readines

37、s,”Stephen Hendrick,January 2022.72024 OPENSEARCH REPORTConfirming the cost benefit of open source softwareOne of the most important attributes of open source software is that it is free to use.Cost benefits can also compound when factoring in free maintenance,upgrades,support,and added instances ba

38、sed on scalability requirements.Figure 2 examines the cost benefits of using open source software across organizations in our sample.It shows that 65%of organizations reported that open source benefits exceed costs,compared to 11%that reported that costs exceeded benefits.When decomposing Figure 2,w

39、e see that the 29%of organizations that reported that the benefits of open source greatly exceed the costs were 9.6x the 3%where the costs of open source greatly exceed the benefits.Similarly,the 36%of organizations where benefits exceeded the costs was 4.5x the 8%that experienced costs that exceede

40、d benefits.Some of the reasons why open source costs can exceed benefits originated from complex integration requirements with existing and proprietary software,lack of professional support,and insufficient documentation.FIGURE 2:COST-BENEFIT CHARACTERISTICS OF OPEN SOURCE SOFTWAREWhich of the follo

41、wing statements best characterizes your organizations experience using open source software?(select one)Benefits greatly exceed the costsBenefits exceed the costsCosts and benefits are about the sameCosts exceed benefitsCosts greatly exceed the benefits2024 Search&Analytics Survey,Q38,Sample Size=68

42、9,DKNS responses excluded from the analysis8%29%36%24%82024 OPENSEARCH REPORTWhen we asked survey respondents more specifically about the importance of tools needed to support modern system operations,the results were nearly identical to the distribution of open source importance shown in Figure 1.F

43、igure 3 shows that 89%of organizations view these tools and capabilities as either extremely important,very important,or important.The addition of those organizations that view these tools and capabilities as slightly important increases the total to 98%.The importance of these tools stems from the

44、mission-critical nature of the systems they support combined with the added complexity of managing highly granular and ephemeral container-based systems.FIGURE 3:THE IMPORTANCE OF TOOLS THAT SUPPORT MODERN SYSTEM OPERATIONSHow important are tools that address search,observability,and security analyt

45、ics/SIEM to the organization you work for?(select one)Extremely importantVery importantImportantSlightly importantNot important at all2024 Search&Analytics Survey,Q37,Sample Size=689,DKNS responses excluded form the analysis9%32%32%26%92024 OPENSEARCH REPORTExperience with OpenSearchTo avoid bias,we

46、 made no references to OpenSearch during recruitment or fielding of the 2024 Search and Analytics Survey.During screening,we evaluated candidate experience with technology areas leveraged by OpenSearch to avoid naming the open source project.Experience with technology areas relevant to OpenSearchRes

47、pondents to the 2024 Search and Analytics Survey needed to have experience in one or more of the three technology areas currently addressed by OpenSearch and commercial products that are alternatives to OpenSearch.Figure 4 shows one of the initial questions in the survey,which identifies if a respon

48、dent had experience in one or more of these three areas(search,observability,and security analytics).This question also included a proxy for each of these areas in case respondents were unfamiliar with OpenSearch terminology.Figure 4 shows that out of a sample size of N=689 completes,90%had experien

49、ce in search,67%in observability,and 42%in security analytics.FIGURE 4:SEGMENTING RESPONDENT EXPERIENCE IN SEARCH,OBSERVABILITY,AND SECURITY ANALYTIC TOOLSDo you have experience working in any of the following areas or with tools having these capabilities?(select all that apply)Search(Full text,stru

50、ctured,vector,geospatial,ranking.Log or infrastructure monitoringObservabilityService meshesSecurity analyticsSecurity information and event management(SIEM tools)90%=Search,N=62442%=Security analytics,N=28867%=Observability,N=4592024 Search&Analytics Survey,Q2,sample size=689,valid cases=689,total

51、mentions=1,888For search,observability,and security categories;counts&percentages reflect the selection of one or more categorical responses43%82%61%28%29%31%102024 OPENSEARCH REPORTWhat is your experience with the open source OpenSearch software?(select one)Have not heard of itHeard of it,but thats

52、 allHave experimented with itHave some experience using it in a production environmentVery experienced in using it in a production environment25%,N=1762024 Search&Analytics Survey,Q15,Sample Size=689,respondents with OpenSearch experience based on Q15&Q18 32%43%9%8%8%Experience with OpenSearchDevelo

53、pment of OpenSearch began in earnest at the beginning of 2022.This makes OpenSearch about 2.5 years old.Figure 5 shows respondent experience with the OpenSearch project,with 32%of respondents never having heard of OpenSearch and 43%having heard of OpenSearch but never having had any direct experienc

54、e with it.This leaves just 25%(N=176)who have experience or have experimented with OpenSearch.This is a compelling penetration rate for a young project entering into a variety of maturing markets.The first mention of OpenSearch was in Q15(Figure 5),where we asked respondents if they had experience w

55、ith OpenSearch.Figure 5 shows that 75%of organizations have no experience with OpenSearch,and 25%have various degrees of experience.Of the 25%that had experience,9%had only experimented with OpenSearch,8%had some experience using OpenSearch,and 8%were very experienced using OpenSearch.For more infor

56、mation on the methodology behind identifying respondents with OpenSearch experience,see the methodology section in this report.FIGURE 5:EXPERIENCE WITH OPENSEARCH112024 OPENSEARCH REPORT2024 Search&Analytics Survey,Q18,sample size=176,respondents with OpenSearch experience based on Q15&Q18 What Open

57、Search capabilities do you have experience with?Very experiencedSome experienceExperimentedNo experienceDont know or not sureSearchObservabilitySecurity analytics3%6%34%31%29%13%39%36%26%27%27%26%Experience across OpenSearch technology areasFor those respondents who reported experience or experiment

58、ation with OpenSearch,we then asked how much experience the respondent had in each of the three core areas currently supported by OpenSearch.Figure 6 shows that most OpenSearch users begin with search,presumably to support observability functions such as log monitoring and event data analysis.Figure

59、 6 shows that 70%had experience with search,and 65%had experience with observability.Experience with security analytics is significantly less at 39%because most organizations already have identity and access management and/or SIEM tools in place.However,observability and security analytics are rapid

60、ly expanding,and evolving market segments can provide an important avenue for OpenSearchs future growth.FIGURE 6:RESPONDENT EXPERIENCE WITH OPENSEARCH CAPABILITIES122024 OPENSEARCH REPORTOpenSearch combinatorial usage patternsSearch observability,and security analyticsSearch&observabilitySearchSearc

61、h&security analyticsObservabilityObservability&security analytics2024 Search&Analytics Survey,Q18,Sample Size=176,respondents with OpenSearch experience based on Q15&Q181%2%2%6%28%60%What type of OpenSearch deployments have you used?(select all that apply)I use the Amazon OpenSearch Service,which is

62、 a managed service running on AWSI use OpenSearch in a self-service modeI dont use OpenSearch now but have used it in the pastI provide OpenSearch as a managed serviceI use a managed service version of OpenSearch running on other third party clouds2024 Search&Analytics Survey,Q17,Sample Size=176,res

63、pondents with OpenSearch experience based on Q15&Q18,Total Mentions=221,DKNS responses excluded from the analysis46%38%18%13%13%OpenSearch usage patternsOpenSearch offers seven different combinatorial ways to use its three core capabilities(see Figure 6).Figure 7 shows that nearly all OpenSearch use

64、rs(94%)use two or more capabilities,with most users(68%)using all three capabilities.Figure 7 also shows that 96%of users rely on search,but just 6%use search alone.The reason for this is that search is a foundational capability for activities such as observability and security analytics.FIGURE 7:OP

65、ENSEARCH COMBINATORIAL USAGE PATTERNSDeployment patterns that OpenSearch users adoptThe patterns organizations use to consume OpenSearch typically involve one of two methods:consuming it as software as a service(SaaS)(59%)or as an application running their data center(38%).Figure 8 shows that 46%of

66、organizations use the Amazon OpenSearch service,a managed service running on AWS.An additional 13%of organizations consume OpenSearch running as a managed service on another cloud.Despite the multiple response structure of Q17 in Figure 8,the distribution of responses other than those focused on Ope

67、nSearch consumption implies that organizations consume OpenSearch in just one way.FIGURE 8:OPENSEARCH DEPLOYMENT PATTERNS132024 OPENSEARCH REPORTUser Perceptions of OpenSearchThis section of the report focuses on user feedback regarding product characteristics and opportunities(Figures 9 to 12)as we

68、ll as key questions regarding product positioning(Figures 13 to 16).Figures 9 to 12 were matrix questions,which scored attributes and strategies from not important or well(score=1)to extremely important or well(score=5).We can find the mean score for each attribute or strategy at the right of each c

69、hart.The data in the chart is in descending order based on the percentage of organizations responding extremely important/well and very important/well.User feedback on product capabilities and strategiesFigure 9 shows the count of positive scores(extremely well and very well),which is far greater th

70、an the number of negative scores(not well and not well at all).Leading product attribute scores include high marks for observability features(76%positive and a mean score of 4.1)and the delivery of search solutions(73%positive and a mean score of 4.0).Additional product attributes,including scalabil

71、ity,flexible data ingestion,and visualization tools,also have a high rating of around 70%positive and a mean score of 3.9.Even the lowest score for GenAI workloads included feedback that was 49%positive and only 11%negative,with a mean score of 3.5,which is above average.Especially interesting was t

72、he 36%of organizations that scored cost-effectiveness as extremely well.This was the highest score in the extremely well category,and while we have come to expect open source products as being cost-effective,the cost leadership exhibited here suggests capabilities that deliver benefits of high value

73、.Feedback from Figure 9 collectively shows that users are pleased with the capabilities offered by OpenSearch,although areas such as GenAI support,community engagement,and OpenSearchs plug-in architecture could benefit from more attention.How well is OpenSearch delivering on the following capabiliti

74、es?Observability features(logs,traces,metrics,events)Delivering search solutionsScalabilityFlexible data ingestionOpenSearch Dashboardvisualization toolkitSignificant ongoinginvestments by AWSPerformanceSecurity features like authentication,authorization,and encryptionCost effectivenessInnovationVec

75、tor database functionalityDelivering security analyticscapabilitiesEngaged user communityBroad plugin architectureGenAI workloadsExtremely wellVery wellAverageNot wellNot well at all2024 Search&Analytics Survey,Q19,sample size=176,respondents with OpenSearch experience based on Q15&Q18,DKNS response

76、s excluded form the analysis4.14.03.93.93.93.83.83.83.93.83.73.83.83.73.532%26%26%24%21%22%23%36%22%18%18%24%22%15%43%41%44%44%45%48%45%44%31%44%46%42%35%35%34%21%23%25%27%25%23%27%28%25%28%27%33%38%33%39%2%6%5%3%5%7%6%4%7%6%6%8%9%8%Mean Score3%34%FIGURE 9:USER FEEDBACK ON SELECT PRODUCT CAPABILITIE

77、S AND STRATEGIES142024 OPENSEARCH REPORTUser feedback on product capabilities and strategies of concernThe identification of product capabilities and strategies shown in Figure 10 occurred during discussions with the OpenSearch project team.This list includes those areas where the OpenSearch team be

78、lieved users might express concern.While the positive scores,across Figure 10,ranged from 65%to 54%,our interpretation of this chart is that product capabilities and strategies that need additional attention are those with lower positive scores and higher negative scores.Using this criterion,the are

79、as that require emphasis on the part of OpenSearch include reducing the product learning curve,better promotion of the product to achieve market recognition,improved documentation,and improved migration tools.FIGURE 10:USER FEEDBACK ON PRODUCT CAPABILITIES AND STRATEGIES OF POTENTIAL CONCERNHow well

80、 is OpenSearch delivering on the following capabilities?Increased demands of search solutionsPlugin compatibilitySupport for large language models and GenAI workloadsOperational challenges like configuration,monitoring,and maintenanceProduct maturity and stabilityProduct learning curvePromoting and

81、achieving market recognitionAdequate documentationProvides an easy migration from alternative productsExtremely wellVery wellAverageNot wellNot well at all2024 Search and Analytics Survey,Q20,sample size=176,respondents with OpenSearch experience based on Q15&Q18,DKNS responses excluded from the ana

82、lysis21%22%16%17%22%16%17%16%20%44%40%45%44%39%41%37%38%34%31%33%29%31%36%35%32%37%35%2%4%5%7%2%7%11%7%10%3.83.83.63.73.83.73.63.63.6Mean Score152024 OPENSEARCH REPORTUser feedback on selected OpenSearch product capabilities and strategiesThe OpenSearch project team was also interested in having use

83、rs review and score a variety of product capabilities and strategies to determine which ones might take precedence.Figure 11 displays the importance that users attach to these actions.Positive scores range from 67%to 87%,and mean scores range from 3.9 to 4.4.Therefore,many of these potential actions

84、 have a high ranking,and the differences between the importance attached to them are marginal.Leading strategies include integration with other open source projects(87%positive)and being an open source champion(84%positive).Integration with other open source projects represents a material opportunit

85、y because of the significant increase in scope that comes from bringing complementary projects together while avoiding the sizable investment in writing new code.Being an open source champion means having a deep commitment to the open source ethos and actively working to advance open source through

86、advocacy,contribution,and community involvement.Leading product capabilities include delivering search solutions(86%positive),delivering innovative new features(83%positive),and enhanced observability features(81%positive).The importance that users attach to nonspecific product-wide opportunities in

87、dicates a community that is not just deeply satisfied with OpenSearch but one seeking continued investment in core product areas to drive continued product success.162024 OPENSEARCH REPORTFIGURE 11:USER FEEDBACK ON THE IMPORTANCE OF PRODUCT CAPABILITIES AND STRATEGIESHow important is it for OpenSear

88、ch to deliver on the following?Mean ScoreIntegration with other opensource projectsDelivering searchsolutionsBeing an opensource championDelivering innovativenew featuresObservability features(logs,traces,metrics,events)Improving OpenSearch ease of use on publicclouds like AWS,Azure,GCP,OCI,and othe

89、rsMake an additional investment toadd more observability featuresSecuring broadcommunity involvementDelivering securityanalytics capabilitiesAdoption of OpenSearch by other vendorsand cloud service providersMake an additional investment toadd more security featuresMake an additional investment toadd

90、 more search capabilitiesEnsuring that OpenSearch training andcertification is being offeredExpansion across industries likehealthcare,finance,e-commerce4.34.34.44.24.44.24.24.34.14.24.14.04.03.9Extremely importantImportantNeutralNot importantNot important at all2024 Search and Analytics Survey,Q21,

91、sample size=176,respondents with OpenSearch experience Based on Q15&Q18,DKNS responses excluded form the analysis43%49%51%43%57%48%38%43%36%42%39%34%38%33%44%37%33%40%25%32%42%37%42%35%36%38%33%34%11%12%15%14%15%16%18%20%19%22%21%24%19%26%1%2%1%2%2%2%2%1%1%1%3%2%8%5%172024 OPENSEARCH REPORTUser feed

92、back on pivotal OpenSearch strategiesOver the last two years,AWS has made a significant and consistent investment in OpenSearch.Looking forward,AWS is exploring strategies that will define Opensearchs future road map.Figure 12 shows user feedback on some of these pivotal strategies.Figure 12 shows e

93、xtremely strong user sentiment in ensuring the long-term viability of OpenSearch,with 61%seeing this strategy as extremely important and 28%as important for a total of 88%.The strategy received the highest mean score(4.5)across Figures 9 to 12.The OpenSearch community clearly believes in the product

94、 and wants its strong open source ethos to persist.The open source user community also wants to see continuing investment in OpenSearch to address user needs and more effectively compete with other products.Investing in OpenSearch to better address the needs of users was extremely important to 46%of

95、 users and important to 43%for a combined total of 88%.Similarly,investment to compete with other products more effectively was extremely important to 43%of users and important to 41%for a combined total of 84%.One of the more fascinating findings in Figure 12 is that users are beginning to lean tow

96、ard stronger community-based open source governance.While most users(64%)want to see increased involvement in investment by AWS,7%do not see increased AWS involvement as important,and 5%report that this is not important at all.While increased AWS involvement by users is important,so is the objective

97、 to have OpenSearch join a vendor-neutral open source foundation,which was either extremely important or important to 81%of OpenSearch users.How important is it for OpenSearch to deliver on the following?Mean Score4.561%28%11%46%43%12%4.34.343%41%15%1%44%37%16%4.22%38%40%20%4.12%39%34%24%3%4.134%30%

98、24%3.87%Extremely importantImportantNeutralNot importantNot important at all2024 Search and Analytics Survey,Q22,sample size=176,respondents with OpenSearch experience Based on Q15&Q18,DKNS responses excluded form the analysisEnsure the long term viability of OpenSearchInvest in OpenSearch to better

99、 address the needs of its usersInvest in OpenSearch to more effectively compete with other productsHave OpenSearch join a vendor neutral open source foundationEstablishing a strong and compelling OpenSearch brand identityDeliver new capabilities faster than alternative productsIncrease Amazons invol

100、vement and investment in OpenSearchFIGURE 12:USER FEEDBACK ON PIVOTAL OPENSEARCH STRATEGIES182024 OPENSEARCH REPORTHow OpenSearch should increase its adoptionThe OpenSearch community is small but strongly engaged.This begs a question.How should OpenSearch increase the size of its user community?Figu

101、re 13 addresses this question,yielding results that are sometimes enlightening and unusual.The leading response in Figure 13,which 41%of users reported,was to improve the performance and scalability of OpenSearch.While Figure 9 shows scalability with a 70%positive score and performance with a 67%pos

102、itive score,performance and scalability are complex issues.Data volumes have and will continue to increase at an accelerating rateand this was before the advent of GenAI.Large language models are data intensive,with scalability key to handling large data volumes and distributed search and query opti

103、mization necessary for driving fast and accurate results.As organizations seek to harness the transformative capabilities of GenAI,optimizing scalability and performance will continue to be a key organizational objective.The second leading response to the question of how to increase search adoption

104、was to improve visibility into OpenSearch capabilities and business value,which 40%of users reported.One of the best ways to showcase product capabilities is by evaluating the business value that a product delivers to the organization.We can do this both qualitatively and quantitatively,and it is us

105、eful in explaining what a product can do for an organization and how effectively the product is performing this function.Product documentation(39%)as well as training and certification(37%)were also top of mind for OpenSearch users.Improved documentation helps make complex products more approachable

106、,and training and certification accelerate knowledge transfer and validate user competency.It is important to shortlist both of these actions,but training and certification should take priority because we can outsource them to third parties.What does OpenSearch need to do to increase adoption or be

107、adopted by your company?(select all that apply)2024 Search&Analytics Survey,Q23,Sample Size=176,respondents with OpenSearch experience based on Q15&Q18,Valid Cases=176,Total Mentions=692,DKNS responsesexcluded from the analysisImprove the performance and scalability of OpenSearchImprove visibility i

108、nto OpenSearch capabilities and business valueProvide more comprehensive documentationProvide training and certification by AWS and 3rd partiesEncourage more plugins and extensionsHave OpenSearch join a vendor neutral open source foundationAdd missing features and missing capabilities to better addr

109、ess customer user casesProvide more resources to help users deploy and operate on their ownEngage with developer relations at end user organizationsEngage more with the community membersProvide incentives for innovative developer contributionsEngage more with industry analystsOur company is already

110、a heavy user of OpenSearchOrchestrate more frequent releases41%40%39%37%35%34%31%30%25%24%23%19%17%15%FIGURE 13:HOW OPENSEARCH SHOULD INCREASE ITS ADOPTION192024 OPENSEARCH REPORTHow OpenSearch can improve its visibilityImproving visibility and awareness are key prerequisites to driving product adop

111、tion.Figure 14 explicitly looks at a variety of techniques for improving OpenSearch visibility.User feedback confirmed that providing OpenSearch training and certification courses(48%),increased visibility at open source community events(44%),having OpenSearch join a vendor-neutral open source found

112、ation(39%),and improving visibility into OpenSearch capabilities and business value(39%)were the leading ways to drive increased OpenSearch visibility.Providing OpenSearch training and certification was the leading way in Figure 14 to improve visibility,and as we saw earlier,it helped drive adoption

113、 in Figure 13.Increased visibility and open source community events have time and budget implications for AWS but are otherwise easily achievable.Having OpenSearch join a vendor-neutral open source foundation is another theme we saw surface in Figure 13.We see this theme again in Figure 14.Finally,i

114、mproving visibility into OpenSearch capabilities and business value is a recurring theme from Figure 13 but can be a cost-effective way to address visibility through marketing with resources that can reach a wide audience with a single investment.FIGURE 14:HOW OPENSEARCH CAN IMPROVE ITS VISIBILITYHo

115、w can OpenSearch improve its visibility?(select all that apply)2024 Search&Analytics Survey,Q24,Sample Size=176,respondents with OpenSearch experience based on Q15&Q18,Valid Cases=176,Total Mentions=665,DKNS excluded from the analysisProvide OpenSearch training and certification coursesIncrease visi

116、bility at open source community eventsHave OpenSearch join a vendor neutral open source foundationImprove visibility into OpenSearch capabilities and business valueEstablish meaningful partnerships with vendors,integrators,and consultantsIncrease visibility at AWS eventsClarify product positioning r

117、elative to alternative productsEngage more effectively with the developer communityEngage with developer relations at end-user organizationsEngage more with industry analystsMake OpenSearch messaging consistent across all channelsEncourage feedback and respond to all comments48%44%39%39%36%35%33%31%

118、26%25%22%18%202024 OPENSEARCH REPORTClarifying the difference between OpenSearch software and the Amazon OpenSearch serviceAWS has found that in some cases,there is confusion between OpenSearch the product and OpenSearch the service.This survey investigated to what extent there was this confusion an

119、d,when this confusion existed,what ways users were recommending to resolve it.The top panel of Figure 15 queried users to determine if they understood the difference between OpenSearch software and the AWS OpenSearch service.The result was that 81%understood the difference while 19%did not.This conf

120、usion undoubtedly stems from users not appreciating that the OpenSearch software is also an open source project,meaning that the software is free for anyone to download.However,AWS has implemented the OpenSearch SaaS,which is an AWS SaaS product offering for those wanting to bypass OpenSearch manage

121、ment and maintenance.The bottom panel of Figure 15 indicates that the primary solution to the issue,which 55%of users identified,is for Amazon to provide a more visible and clear explanation of OpenSearch in self-service mode or as a managed service.Secondary recommendations include providing an eas

122、y-to-find comparison table comparing self-service and managed service alternatives(41%),having OpenSearch join a vendor-neutral foundation and let them explain it(36%),and finally having Amazon and the OpenSearch project explain the differences(36%).What should be done to clarify the differences bet

123、ween OpenSearch and the Amazon OpenSearch Service?(select all the apply)managed service similarities and differencesOther(please specify)0%Dont know or not sure18%2024 Search&Analytics Survey,Q26,Sample Size=22,respondents answering“No”or“DKNS”to Q25,Valid Cases=22,Total Mentions=41Do you understand

124、 the difference between the open source OpenSearch software and the Amazon OpenSearch Service?(select one)YesNoDont know or not sure81%9%10%2024 Search&Analytics Survey,Q25,Sample Size=176,respondents with OpenSearch experience based on Q15&Q18Provide an easy to find comparisontable of the self serv

125、ice and managedservice versions of OpenSearch41%Explain the similarities,pros,and cons ofusing both the self service and managedservice versions of OpenSearch55%Have OpenSearch join a vendor neutralfoundation and let the foundation explain theself service and managed service similaritiesand differen

126、ces36%Amazon and the open source OpenSearchproject should explain the self service and36%FIGURE 15:CLARIFYING THE DIFFERENCE BETWEEN OPENSEARCH AND OPENSEARCH SERVICES212024 OPENSEARCH REPORTUser opinions of OpenSearchThe design of the final question asked to OpenSearch users was to elicit recommend

127、ations on whether OpenSearch should be one expansive product or several products for use either independently or together.The most compelling user feedback shown in Figure 16 was that 47%of users believe that the combination of search,observability,and security analytics is important to provide toge

128、ther,which is what OpenSearch does now.While this might cause a casual observer to infer that 53%of users were in favor of breaking the product apart,this is not the case.Other responses in Figure 16 include 34%who believe that the wide scope of OpenSearch capabilities is important to show its versa

129、tility,28%who only use select OpenSearch capabilities but like having the capabilities available in a single product when needed,and 26%who said the more OpenSearch capabilities the better.Looking across all the above responses,we find that 81%of OpenSearch users in this sample selected one or more

130、of these four responses,which all suggest keeping its capabilities together in one product.FIGURE 16:USER OPINIONS OF OPENSEARCHWhat is your opinion on the capabilities offered by OpenSearch?(select all that apply)The combination of search,observability,and security analytics is important to provide

131、together like OpenSearch does nowThe wide scope of OpenSearch capabilitiesis important to show its versatilityThe wide scope of OpenSearchcapabilities make it a challenge to learnI only use select OpenSearch capabilities now,but like having the other capabilities availablein a single product if/when

132、 I need themThe more OpenSearch capabilities the betterOpenSearch should do a better job ofmaking its capabilities more cohesiveI only use select OpenSearch capabilitiesand find that the other capabilities get in theway of making the product easy to use47%34%30%28%26%25%20%2024 Search&Analytics Surv

133、ey,Q27,Sample Size=176,respondents with OpenSearch experience based on Q15&Q18,Valid Cases=176,Total Mentions=358,DKNS responses excluded from the analysis 222024 OPENSEARCH REPORTConclusionsContinued investment in product capabilities is necessary to retain product momentum and drive adoptionFrom a

134、 product functionality standpoint,OpenSearch scored extremely well in both the user perceptions analysis and market analysis.This is significant given the brief tenure of OpenSearch in the market(2.5 years).In the user perceptions analysis,Figure 9 showed high positive scores(the sum of extremely we

135、ll and very well responses)for observability features(76%),delivery of search solutions(73%),scalability(70%),and flexible data ingestion(70%).In the market analysis,OpenSearch scored consistently well in each of its core domainssearch,observability,and security analyticsdespite the limited time in

136、the market for OpenSearch compared to other products.This suggests an excellence in product engineering that we should recognize and sustain.Achieving product leadership and penetration requires effective product development and marketing.According to our sample,OpenSearch has already solved what we

137、 consider to be the hardest problem:achieving product excellence.Areas where users commented that OpenSearch could improve its functional capabilities,as discussed in Figure 10,include reducing the product learning curve,better promotion of the product to achieve market recognition,improved document

138、ation,and improved migration tools.When asked for feedback on a variety of OpenSearch products and market growth strategies,the leading user responses from Figure 11 were integration with other open source projects(87%positive),delivering search solutions(86%positive),being an open source champion(8

139、4%positive),delivering innovative new features(83%positive),and enhanced observability features(81%positive).Users are also in favor of keeping all of OpenSearchs key capabilities within one product.Figure 16 shows that 47%of users believe that the combination of search,observability,and security an

140、alytics is important to provide togetherwhich is what OpenSearch does now.Figure 16 also shows that 34%believe that the wide scope of OpenSearch capabilities is important to show its versatility,28%only use select OpenSearch capabilities but like having the capabilities available in a single product

141、 when needed,and 26%said the more OpenSearch capabilities the better.Looking across all the above responses,we find that 81%of OpenSearch users in this sample selected one or more of these four responses,which all suggest keeping its capabilities together in one product.232024 OPENSEARCH REPORTProdu

142、ct development,offering training&certification,better documentation,and how OpenSearch drives business value,are key to driving product visibility and adoptionImproving the performance and scalability of OpenSearch was the leading response to how OpenSearch could increase product adoption,as shown i

143、n Figure 13.This is a continuation of the above theme of maintaining product excellence through continuing the current pace of R&D investment.Improving visibility into OpenSearch capabilities and business value,providing more comprehensive documentation,and providing training and certification were

144、also all leading activities to drive OpenSearch adoption.When asked how OpenSearch could increase its visibility,the leading response from users in Figure 14 was to provide OpenSearch training and certification courses,increase involvement at open source events,and improve visibility into OpenSearch

145、 capabilities and business value.Maintaining the pace of product investment,providing training and certification,better documentation,and an increased focus on how OpenSearch drives business value are important recurring themes that are critical to ensuring OpenSearchs continuing success.OpenSearch

146、should transition to oversight by a vendor-neutral foundationAnother objective of this survey was to provide an opportunity for users to weigh in on the future of OpenSearch.One early indication came in Figure 11,where 84%of users reported that it was either extremely important or important that who

147、ever had oversight on OpenSearch should be an open source champion.Being an open source champion requires a deep commitment to the open source ethos and actively working to advance open source through advocacy,contribution,and community involvement.Figure 12 then asked how important it was for OpenS

148、earch to join a vendor-neutral foundation.User response showed that 81%believed it was either extremely important or important to transition OpenSearch to a vendor-neutral foundation.Figure 13 and Figure 14 confirmed this finding by ranking having OpenSearch join a vendor-neutral foundation as a lea

149、ding way to drive both visibility and adoption.242024 OPENSEARCH REPORTMethodologyAbout the surveyA web survey that Linux Foundation Research and its partners conducted from February to March 2024 provided the basis for this study.The surveys goal was to understand the awareness,perception,perspecti

150、ve,and product experience of respondents with search,observability,and security analytics experience.In this section,we present the study methodology and context regarding how we analyzed the data followed by the demographics of the respondents.From a research perspective,it was important to elimina

151、te any perception of sample bias and ensure high data quality.We handled the elimination of sample bias by sourcing our usable sample from Linux Foundation subscribers,members,partner communities,and social media.We addressed data quality through extensive prescreening,survey screening questions,and

152、 data quality checks to ensure that respondents had sufficient professional experience to answer questions accurately on behalf of the organization they worked for.We collected survey data from industry-specific companies,IT vendors and service providers,and nonprofit,academic,and government organiz

153、ations.Respondents spanned many vertical industries and companies of all sizes,and we collected data from several geographies,including the Americas,Europe,and Asia-Pacific.The 2024 Search and Analytics Survey comprised 43 questions that addressed screening,respondent demographics,OpenSearch user pe

154、rceptions,and respondent product experience.For information about access to the 2024 Search and Analytics Survey,its dataset,and survey frequencies,see the Data.World access information below.The high-level design of the survey is as follows:PagesQuestionsQuestion categoriesWho answers the questions

155、P1-IntroductionAll respondentsP2Q1 Q6Tell us about yourselfAll respondents(N=689)P3 P4Q7 Q8Involvement in ITStudents only(N=27)P4Q9 Q15Tell us about the organization that you work forAll respondents except students(N=689)P5 P6Q16 Q22Perceptions of OpenSearchRespondents with OpenSearch experience(N=1

156、76)P7 P8Q23 Q27Feedback to OpenSearchRespondents with OpenSearch experience(N=176)P9 P10Q28 Q30Perspectives on search toolsRespondents with search experience(N=555)P11 P12Q31 Q33Perspectives on observability toolsRespondents with observability experience(N=450)P13 P14Q34 Q36Perspectives on security

157、analytics toolsRespondents with security analytics experience(N=241)P15Q37 Q39Closing questionsAll respondents(N=689)P16Q40 Q43Interest in technology,training,and certificationStudents only(N=2)P17Q44 Q45LFR Panel and reward informationAll respondentsTABLE 1:SURVEY DESIGN252024 OPENSEARCH REPORTSurv

158、ey screening involved the use of five variables to validate the respondent:Must be a Linux Foundation subscriber,member,or contributor Must be familiar with the Linux Foundation(to ensure understanding of or involvement with open source)Must work full time or part time in the information technology

159、field Must be in an IT role aligned with development,deployment,operations,or support Must have familiarity with one or more areas or tools that address search,observability,or security analyticsA total of 689 respondents completed the survey.The margin of error for this sample size was+/-3.2%at a 9

160、0%confidence level and+/-3.8%at a 95%confidence level.We stratified the data collection by company size,geographic region,and organization type.We segmented the data primarily by geographic region,company size,and type of organization.Although there was a requirement for respondents to answer nearly

161、 all questions in the survey,we made a provision when a respondent was unable to answer a question by adding a“Dont know or not sure”(DKNS)response to the list of responses for every question.However,this created a variety of analytical challenges.One approach was to treat a DKNS just like any other

162、 response to know the percentage of respondents that answered DKNS.The advantage of this approach is that it shows the exact distribution of data collected.The challenge with this approach is that it can distort the distribution of valid responses,i.e.,responses where respondents could answer the qu

163、estion.Some of the analyses in this report exclude DKNS responses.This is because we can classify the missing data as either missing at random or missing completely at random.Excluding DKNS data from a question does not change the distribution of data(counts)for the other responses,but it does chang

164、e the size of the denominator used to calculate the percent of responses across the remaining responses.This has the effect of proportionally increasing the percentage values of the remaining responses.Where we have elected to exclude DKNS data,the footnote for the figure includes the phrase“DKNS re

165、sponses excluded.”The percentage values in this report may not total to exactly 100%due to rounding.Data.World accessLinux Foundation Research makes each of its empirical project datasets available on Data.World.This dataset includes the survey instrument,raw survey data,screening and filtering crit

166、eria,and frequency charts for each question in the survey.You can find Linux Foundation Research datasets,including this project,at data.world/thelinuxfoundation.Access to Linux Foundation datasets is free but does require you to create a data.world account.262024 OPENSEARCH REPORTRespondent demogra

167、phicsThese demographics provide you with a profile of the 2024 Search and Analytics Survey respondents.We have regrouped all the demographics in Figure 17 to facilitate a more insightful analysis.For the original source data and study frequencies,please see the data.world access described above.FIGU

168、RE 23:RESPONDENT DEMOGRAPHICSExperienceDo you have experience working in any of the following areas or with tools having these capabilities?SearchObservabilitySecurity analytics90%67%42%2024 Search&Analytics Survey,Q2,sample size=689Organization typeWhat type of organization do you work for?57%27%6%

169、11%IT vendor/ServiceproviderEnd-user organizationNon-profit,academic,govagencyStudent or other2024 Search&Analytics Survey,Q3,sample size=689RoleWhat title best describes your role?40%16%11%11%6%16%Software developerSystem adminManager/Director/VPConsultantC-level executiveOther2024 Search&Analytics

170、 Survey,Q5,sample size=689IndustryWhat best describes your organizations primary industry?34%11%8%5%5%4%28%X-industry IT vendorFinancial servicesTelecommunications/ISPGovernmentEducationBusiness servicesOther2024 Search&Analytics Survey,Q10,sample size=689Geographic regionWhat geographic region is y

171、our organizations headquarters location in?48%21%18%13%The AmericasAsia PacificEuropeRest of World2024 Search&Analytics Survey,Q11,sample size=689Company sizePlease estimate how many total employees are in your organization?48%23%32%2024 Search&Analytics Survey,Q11,sample size=6891 to 9991,000 to 9,

172、99910,000 or more272024 OPENSEARCH REPORTAbout the authorsSTEPHEN HENDRICK is vice president of research at the Linux Foundation,where he is the principal investigator on a variety of research projects core to the Linux Foundations understanding of how open source software is an engine of innovation

173、 for producers and consumers of IT.Steve specializes in primary research techniques developed over 30 years as a software industry analyst.Steve is a subject-matter expert in application development and deployment topics,including DevOps,application management,and decision analytics.Steve brings exp

174、erience in a variety of quantitative and qualitative research techniques that enable deep insight into market dynamics and has pioneered research across many application development and deployment domains.Steve has authored over 1,000 publications and provided market guidance through syndicated rese

175、arch and custom consulting to the worlds leading software vendors and high-profile start-ups.ADRIENN LAWSON is a data analyst at the Linux Foundation.Adrienn obtained a masters degree in social data science from the University of Oxford.She is responsible for survey development,analysis,and report w

176、riting.Adrienn has previously conducted research at the University of Oxford,the Budapest Institute for Policy Analysis,and the U.K.s Office for National Statistics.She has a strong fascination with the collective power of open source collaboration within geographically dispersed communities.Additio

177、nally,she is most interested in researching trends and solutions for challenges related to open source software funding,sustainability,and supporting developers in their pursuit of responsible technological advancement.282024 OPENSEARCH REPORTAcknowledgementsWe thank all the participants of the surv

178、ey for kindly sharing their insights and experience in search and analytics.Special thanks to peer reviewers and Linux Foundation colleagues for their involvement in the various stages of the research process,including:Joshua Bright(AWS)Elizabeth BushardHilary CarterMia ChaszeykaEli Fish(AWS)Charlot

179、te Henkle(AWS)Anna HermansenMukul Karnik(AWS)James McIntyre(AWS)Carl Meadows(AWS)Christina OlivieroAparna Sundar(OpenSearch project)Daryll Swager(AWS)292024 OPENSEARCH REPORTAbout OpenSearch OpenSearch is a community-driven,open source search and analytics suite used by developers to ingest,search,v

180、isualize,and analyze data.OpenSearch consists of a data store and search engine(OpenSearch),a visualization and user interface(OpenSearch Dashboards),and a server-side data collector(Data Prepper).Users can extend the functionality of OpenSearch with a selection of plugins that enhance search,analyt

181、ics,observability,security,machine learning,and more.About Linux Foundation Research Founded in 2021,Linux Foundation Research explores the growing scale of open source collaboration,providing insight into emerging technology trends,best practices,and the global impact of open source projects.Throug

182、h leveraging project databases and networks,and a commitment to best practices in quantitative and qualitative methodologies,Linux Foundation Research is creating the go-to library for open source insights for the benefit of organizations the world over.Copyright 2024 The Linux FoundationThis report

183、 is licensed under the Creative Commons Attribution-NoDerivatives 4.0 International Public License.To reference this work,please cite as follows:Stephen Hendrick and Adrienn Lawson,“OpenSearch Awareness and Perceptions Report,”foreword by Jonah Kowall,The Linux Foundation,October GITHUB.COM/LF-ENGINEERING