Automation tends to be discussed in tandem with efficiency. To automate something is commonly said to make that thing more efficient, whether that means people and how they do their jobs, processes and their outcomes, or an overall business and its day-to-day operations.
Automation should also be commonly associated with another term: Simplicity. As in, simplifying people’s jobs, how processes produce intended outcomes, and how a business runs.
In the context of IT, this increasingly means simplifying increasingly complex systems and environments. Think of running containers at scale, managing hybrid cloud and multi-cloud infrastructure, and navigating a cloud-native landscape that seems to expand by the day. Automation is critical to keeping things as simple as possible when our environments – both internal and the world at large – are as inherently complex as ever.
That led the themes when we checked in with a variety of IT leaders and practitioners to share the automation trends they’re keeping tabs on as we approach 2021. Almost across the board, the major trends in IT automation can be boiled down to simplifying how people, processes, and tools work.
“2021 will usher in automation that is focused on making the internal customer’s job easier and less complex, especially with the [ongoing challenges] of the pandemic,” says Ravi Lachhman, evangelist at Harness.
[ How can automation free up more staff time for innovation? Get the free eBook: Managing IT with Automation. ]
What's next in automation
As highly specialized cloud-native operational expertise marches towards automation, Lachhman adds, IT leaders also gain some talent flexibility when people need to switch in and out of teams.
Let’s dig into this and other automation insights to monitor in 2021.
1. Automation used in new ways post-COVID
“2020 has brought in constraints in human-to-human interaction due to unforeseen health concerns, which has rocked the foundations of human interaction prior to COVID-19,” says E.G. Nadhan, chief architect and strategist, North America, Red Hat. “Contactless and touchless mechanisms of consumer and employee interaction will therefore gain more adoption in 2021. This trend extends the application of automation technologies to the areas requiring human-to-human contact which can refine the overall customer experience.
“It also serves as a catalyst expediting the automation of repetitive and routine tasks within and across the extended network of enterprises,” Nadhan notes. “Automation is meant for times like these.”
2. A big push to reduce complexity
2020 has been a challenging year for many individuals and organizations, to put it mildly. And that’s absolutely going to fuel automation and architecture strategies in the year ahead, Lachhman says. He thinks there will be a major push to leverage automation to remove complexity wherever possible, in part to address the realities of remote work and a great deal of ongoing uncertainty, and also because IT is fundamentally more complex than ever.
“With the big push into cloud-native and Kubernetes, it would not be uncommon for large organizations to have millions of lines of YAML in their enterprise,” Lachhman says. “As the cloud-native ecosystem exploded, so did the amount of choice and not far behind was complexity. The computer science adage is true: We are always just moving complexity around.”
[ Kubernetes terminology, demystified: Get our Kubernetes glossary cheat sheet for IT and business leaders and our shareable primer: How to explain orchestration in plain English. ]
Lachhman predicts that 2021 will be about reducing complexity rather than simply moving it from one stack to another, taking a page from the Site Reliability Engineering (SRE) playbook and favoring simplicity, repeatability, and automation in lieu of living on the “bleeding edge” simply for the sake of it. There are no points for enduring unnecessary pain.
Red Hat chief architect Emily Brand also sees more enterprises emphasizing the principles of SRE. “More enterprises are focused on SRE as a way to reduce toil through smart, targeted automation,” Brand says. “Choosing to invest in high-value automation with the least complexity will be the focus for most infrastructure and ops teams in 2021. Automating yesterday’s problems was yesterday’s problem. Automating tomorrow’s growth is today’s future.”
Lachhman specifically sees CI/CD pipelines as one key area of focus here. In particular, more teams will focus on how they are deploying (leveraging automation wherever possible) rather than what they are deploying.
“Complexity can come in many forms, but de-risking how changes are deployed is a big part of the complexity equation,” Lachhman says. “A big part of the learning curve when leveraging new technology is the operational complexity: how to deploy, how to patch, how to roll back when there is an issue, and how to validate and observe.”
Lachhman has been on several dev teams in his career, and his Java/JEE skills moved seamlessly with him wherever he went. But in every place he encountered a snowflake deployment pattern, often requiring the arcane knowledge of a handful of key team members to operate, especially when things didn’t go well. CI/CD pipelines are adapting to change that paradigm and bring more standardization to the nuts of bolts of deployments.
“CI/CD platforms are becoming more agnostic on what they are deploying and favoring how they are deploying,” Lachhman says. “If leveraging several disparate technologies, they can be deployed by an agnostic platform and the complex operational tasks such as rolling back or a canary deployment would be automated by a pattern. This is highly beneficial because I can tackle the iteration changes needed with more confidence if a problem were to arise.”
3. Not just more automation but more orchestration
“2021 is the year of orchestration of cross-domain automated workflows - to fill in one of the remaining gaps of a fully digitally transformed organization,” says Michael Cardy, Red Hat’s chief technology strategist and director, solution architecture, Canada. Orchestration is the automated configuration, management, and coordination of computer systems, applications, and services, he notes.
Orchestration, and orchestration tools like Kubernetes and enterprise Kubernetes platforms such as Open Shift, help IT to more easily manage complex tasks and workflows.
[ Read also: 3 reasons to use an enterprise Kubernetes platform. ]
“Automation and orchestration are different but related concepts,” Cardy adds. “Automation helps make your business more efficient by reducing or replacing human interaction with IT systems and instead using software to perform tasks in order to reduce cost, complexity, and errors.
“Orchestration works at a higher level and is expected to make decisions based on changing conditions and requirements.”
4. More maturation of tools around Kubernetes
Kubernetes is itself fundamentally an automation technology. As it matures and adoption continues growing, expect to see more automation built around Kubernetes and how teams use it.
“2021 will see more automation around Kubernetes, specifically around the deployment process,” says Eran Bibi, director of DevOps and cloud platform at Aqua Security. “These tools will ensure the application definitions, configurations, and environments will be declarative and version-controlled. And they will take care of the deployment and lifecycle management in an automated manner.”
[ Get straightforward definitions of Kubernetes that you can use with others: Read How to explain Kubernetes in plain English. ]
A big driver for this trend will be to simplify Kubernetes for developers and DevOps teams, especially those that are new to the platform (which is to say, most of them). Developers in particular are ideally focused on products and quality rather than learning the intricacies of Kubernetes deployments and operations. Automating more of the work required of the latter will keep devs focused on what they do best.
“What we’ll see in response to this is more automation around the creation and deployment of Kubernetes objects (there are now around 50 of them), configuration files, and application deployment itself,” says Bruno Andrade, CEO at Shipa. “The trend line is really moving towards automation that can enable developers and DevOps teams to leverage Kubernetes without any Kubernetes expertise.”
Let’s examine four more important automation trends:
