HashiCorp State of Cloud Strategy Survey1 of 17Introduction
Our first-ever State of Cloud Strategy Survey uncovers some very clear results: a common multi-cloud operating model has become the de facto standard for IT organizations of all shapes and sizes to deliver on digital transformation. IT organizations are investing significant resources in multi-cloud deployments, and those investments are already paying off. At the same time, however, companies are still dealing with a variety of multi-cloud challenges and dependencies.
This site presents the key insights revealed in the 2021 HashiCorp State of Cloud Strategy Survey of more than 3,200 technology practitioners and decision makers from the HashiCorp opt-in contact database (see more about the survey in the Methodology section).
76
%
Are already multi-cloud
34
%
Call digital transformation a top multi-cloud driver
57
%
Say skills shortage is a top cloud challenge
47
%
Say security is a top cloud inhibitor
46
%
Say COVID-19 has not sped cloud adoption
Multi-cloud is the way to go. It’s that simple. — survey respondent
Multi-cloud is now an everyday reality. Already, ¾ of survey respondents employ a multi-cloud architecture (more than one cloud, public or private). In two years, almost 9 in 10 will do so.
The prevalence of Cloud Centers of Excellence (CCoE) is also growing, especially among organizations with larger cloud budgets. Almost ⅔ of companies with annual cloud budgets of $5 million or more operated a CCoE, compared to just 40% of all respondents.
Multi-cloud adoption is important for us ... It allows us to experiment with emerging technologies that [are] only available at certain providers while running the main load at the other provider. — survey respondent
Not surprisingly, multi-cloud adoption skews heavily toward larger enterprises, but that gap closes over time:
60%
(<100 Employees)
76%
(101 - 5,000 employees)
90%
(>5,000 employees)
Not surprisingly, multi-cloud adoption skews heavily toward larger enterprises, but that gap closes over time:
79%
(<100 Employees)
84%
(101 - 5,000 employees)
94%
(>5,000 employees)
AWS holds a commanding cloud market share across every region, industry, and organization size. Despite worries about vendor lock-in, that dominance isn’t expected to fade.
AWS was significantly less popular among consumer goods/retail companies: 27% said they had no plans to use the market leader in the next two years.
Use of non-AWS cloud providers is much higher outside North America, for example:
Just as with multi-cloud adoption, multi-cloud success correlates with organization size:
42%
50%
64%
We are a global company with 100K+ employees. No one cloud offers everything we need (services, regions, government requirements, etc.). — survey respondent
While digital transformation was the most-often-named multi-cloud driver, respondents found benefits in a wide range of ways.
Digital transformation
Avoid single cloud vendor lock-in
Cost reduction
Scaling
50%
51%
43%
41%
Multiple public cloud adoption enables us to overcome the limitations with single vendor lock-in, and allow us to take competitive benefits of different vendors. — survey respondent
In large organizations, multi-cloud usage is typically correlated with other initiatives such as infrastructure as code, container orchestration, application delivery automation, secrets management, service mesh, and more. And adoption of many of those correlated technologies is expected to almost double in the next year.
Infrastructure as code
Application delivery automation
Container orchestration
Secrets management
Infrastructure as code
Application delivery automation
Container orchestration
Secrets management
Service mesh adoption is expected to grow 2.5x — from 11% today to 28% in a year (with another 21% in process).
As cloud and multi-cloud become the standard, there are still inhibitors to cloud adoption, and challenges to operationalizing multi-cloud. Behind cost and security concerns (more on this in the next section) and skills shortages was workflow problems as a result of complexity.
Cost concerns
Security concerns
Lack of in-house skills
Hybrid cloud complexity
58%
45%
Specific cloud inhibitors and challenges vary widely across regions, industry, and company size, as well as by component of the technology stack.
Cost
54%
Security
59%
Lack of skills
53%
Security
52%
Lack of skills
51%
Cost
60%
Cost
53%
When it comes to the challenges hindering operationalizing multi-cloud, respondents had similar concerns.
Skills shortages
Inconsistent workflows across cloud environments
Silos/poor collaboration/complex processes
Budget constraints that affect headcount
Infrastructure not used efficiently or shared
Difficulty managing security and governance
Cloud challenges are consistent across industries and geographies, as well as provisioning, networking, application deployment, and security components — with staff/skilling issues cited as the top concern for each.
Staff/skilling issues
Manual processes
Speed/pace of change
Uncontrolled costs
Staff/skilling issues
Manual processes
Speed/pace of change
No real-time visibility/insight
Staff/skilling issues
Insufficient tooling
No real-time visibility/insight
Speed/pace of change
Staff/skilling issues
Speed/pace of change
Manual processes
Siloed teams
Large enterprises (37%) were more than twice as likely to be concerned about teams working in silos than were small businesses (17%).
Cloud security remains in the spotlight, and is both an adoption driver for multi-cloud and a barrier. As noted above, almost half of respondents named security concerns a top-three cloud inhibitor, but security and governance were mentioned in the top three multi-cloud drivers by 16% of respondents. Below are multiple data points that reveal the specific security issues respondents are worried about.
Data/privacy protection
Data theft
Regulatory compliance
Software vulnerabilities
Threat detection and remediation
What’s keeping organizations from solving those security threats? Again, staff/skilling issues top the list of security issues, but insufficient tooling was a bigger issue for security than for other cloud components.
Staff/skilling issues
Insufficient tooling
No real-time visibility/insight
Speed/pace of change
Manual process
Siloed teams
Pressure to change
Shift to remote work
Shadow IT
Uncontrolled costs
Cloud services allow more granular security controls. — Security engineer survey respondent
The COVID-19 pandemic has wreaked havoc around the world, and driven a huge boom in internet usage. But its effect on multi-cloud and other technology adoption has been surprisingly complex. The pandemic was cited as a multi-cloud driver by just 7% of respondents, yet more than half said COVID had accelerated their cloud or multi-cloud adoption. However, 46% of respondents said COVID didn’t impact their cloud efforts. Notably, 39% of respondents said COVID caused them to use more open source software.
High COVID-19 impacts were more than twice as prevalent in large enterprises (14%) than in small organizations (5%). Only 32% of large enterprises said COVID-19 did not impact their digital transformation timelines, compared to well over half of small businesses (58%).
Infrastructure as code
Container orchestration
Compliance and governance
Network infrastructure automation
Self-service infrastructure
A third of respondents are spending more than $2 million a year on multi-cloud initiatives, and 6% are investing more than $50 million a year.
North American organizations are relatively big spenders — 40% of respondents spend more than $2 million a year and 18% spend more than $10 million per year. But around a third of respondents in Latin America (37%), Europe (32%), and Asia-Pacific (30%) spend less than $100,000. Looked at by industry, software and services companies keep tighter reins on their budget, with 33% spending less than $100,000 on their multi-cloud initiatives. That may not be as surprising as it sounds, though, as this still may represent significant spend for startups and smaller organizations.
Cost concerns were cited by more than half (51%) of respondents as a primary cloud inhibitor, yet cost reductions were cited by 28% of respondents as a multi-cloud driver.
Cloud cost equations can be almost as complex as the technology itself. 39% of respondents said their organization overspent on the cloud, but much of that overspend was expected. And 9% of organizations spent less than projected.
12%
Underspent
49%
Within budget
39%
Overspent
Healthcare (19%) and telcos (18%) reported the most unexpected overspending, while the financial services (32%) and media (31%) firms had the most expected overspending.
Even more revealing, the biggest single drivers of cloud overspending were accelerated priorities and COVID-19. But for more than a quarter of organizations, cloud overspending was due to a combination of the lack of guardrails to efficiently manage resource utilization and lack of standardized tooling.
The bigger the organization's cloud budget, the more likely they were to overspend: Almost half (46%) of companies budgeting $2 - $10 million on cloud overspent, compared to just a quarter (27%) of companies budgeting less than $100,000.
Building on open source software is the most popular choice for infrastructure automation tools across all infrastructure categories. But running OSS security tools yourself — while still the number one option — is significantly less popular than for other cloud components. The security arena also had the highest percentage of respondents who buy commercial tools.
The market for security tools skews toward commercial products, with 25% of respondents buying and running commercial tools themselves and another 18% using commercial tools as a service.
Nearly all respondents ranked infrastructure automation tools “important” or “extremely important” to overcome challenges required to operationalize their multi-cloud environments. As you’d expect, companies spending more on cloud believe infrastructure automation tools are more important. Financial and entertainment/media firms found these tools more important than did public sector organizations.
Almost every organization is already using or planning to use infrastructure automation tools across all four cloud operations components, but provisioning and application deployment tools are the most widely used.
Tool usage is also highly correlated with cloud spending. For example, provisioning tools are currently used by just 65% of companies spending less than $100,000, but by 79% of companies spending $2 million or more — a pattern repeated to a lesser extent across all four cloud components. Regionally, European respondents consistently claim higher tool usage, while those in Asia-Pacific report the lowest tool usage. Software/services firms are the most avid users of networking tools (62%) while only 47% of the public sector use them. Security tools are most heavily used in the financial industry (56%), while only 41% of public sector respondents use them.
The need for infrastructure automation tools is even stronger for larger organizations and those who spend the most on their multi-cloud efforts.
Consistent and automated management helps companies operationalize their multi-clouds in many ways. And the top choices did not vary much across geographic regions or company size.
Better utilization of cloud resources
More flexible IT infrastructure
Self-service infrastructure
Better utilization of cloud resources was cited as helping cloud operations by almost half (48%) of all respondents, and more than half of consumer/retail shops, healthcare companies, telcos, and entertainment/media firms.
Moving to a cloud operating model is a complex process relying upon multiple vendors and key technologies. But which ones do organizations see as most strategic? In addition to the companies and technologies listed below, Microsoft, Atlassian (and its Bitbucket source code repository hosting service), Elastic, and New Relic earned significant numbers of write-in votes.
HashiCorp
Kubernetes
GitHub
GitLab
VMware
RedHat
ServiceNow
Splunk
Cisco
Datadog
MongoDB
Palo Alto
F5
Google Istio
Snowflake
NetApp
Note: Survey participants were practitioners and decision makers who had opted in to HashiCorp emails. A high ranking for HashiCorp tools isn’t surprising, but provides a useful benchmark for other responses.
The most popular cloud operating model tools were HashiCorp Terraform (25%) and Kubernetes (18%).
The 2021 HashiCorp State of Cloud Strategy Survey was conducted in February of 2021. HashiCorp reached out to ~300,000 people for whom we had opt-in email addresses. To encourage responses, we offered an incentive drawing.
We received 3,205 responses from around the world, though not all respondents answered all 34 questions.
Software or services
Financial services
Public sector
Healthcare or biotech
Consumer goods or retail
Entertainment or media
Telco
Transportation
Energy or utilities
Hospitality or travel
Agriculture or food production