@DevOpsSummit Authors: Liz McMillan, Pat Romanski, Elizabeth White, Yeshim Deniz, Mehdi Daoudi

Related Topics: @DevOpsSummit

@DevOpsSummit: Blog Feed Post

DevOps 101 - Automation | @DevOpsSummit #DevOps #BigData #Microservices

Among 6 pillars of DevOps I have covered Management, Integration, Communication, and Collaboration

In my last few articles, I've begun the discussion on the 6 pillars of DevOps and have covered Management, Integration, Communication, and Collaboration:

The Fifth Pillar

Next on the list is Automation.  Automation is defined as:

"The technique, method, or system of operating or controlling a process by highly automatic means, as by electronic devices, reducing human intervention to a minimum."

Back in the day when deployment meant copying code to the one server you had connected directly to the internet, you could get away with manual processes, but it was still fraught with potential issues.  That is definitely not true with today's rats nest of wires, servers, virtual machines, proxies, load balancers, firewalls, and all the other components needed to host a scalable and secure network.

In the early 2000's when I developed iControl (F5's first web service based management interface), I saw the pain that developers and network ops faced when dealing with application deployment.  I talked about this in my "DevOps - A Brief History of Time"  article I wrote earlier this year.  Developers needed a better way to get their code pushed to the end user and Network ops needed a better way to understand how the applications worked and trust the development team to be a part of the deployment process.  I talked a lot about the brick wall the existed between Dev and Ops and that automation was critical in leveraging the talents from both sides.

Automation - The Glue That Binds Dev to Ops

It's taken over 10 years, but DevOps has been the catalyst to blowing up that brick wall and coordinating the two teams together.  But, network ops would never hand the keys to the network kingdom over to the developers so something was going to have to be put in place that was testable, reliable, and free from the risk of fat-fingering a config option that could take down the network.

Automation is the key to providing the trust and reliability into the equation and acts as the glue that binds the two teams together during the production phase.  Automation fits into all aspects of the deployment process including development, testing, deployment, and all of the sub-processes within.  Care needs to be made to ensure that all components in your system can be automated via software integrations or APIs.  The build system, the testing tools, and the network components (load balancers, firewalls, application delivery devices, security appliances, etc) all need to be able to be scripted or programmed.

When dealing with 2 or 2000 developers, tools are needed to ensure that the collaborative work done can be integrated with success to achieve the desired results.  Continuous Integration is the process of merging all development code into a shared codebase on frequent intervals.  Merges aren't complete with out validation to ensure the merge didn't break anything so integrated testing is also a critical component.  When merges occur, automated tests are triggered so that the developers will know right away if their work needs a little bit more TLC .  When check-ins occur to the revision control system, automated build servers compile the code and run the automated tests.  In addition to functional testing, performance and optimization testing is also occurring during this process.

Build tools

For the system to flow together, a centralized build system is needed that will interact with the various test and deployment systems.  Vendors/Tools in the "Build" space are

Automated Testing

Integrating testing into the development and build process both locally and at the central build server is done to ensure an issue-free code base.  Tools in this space include

Continuous Integration

CI should occur frequently enough that no errors can arise in the compilation or testing of the code without developers noticing and correcting them immediately.  Typical practice is to trigger a build every time code is committed to a revision control system, rather than periodic scheduled builds.  To achieve this, CI relies on a code repository, build automation, build self-testing, commits auto-build, and having a replica of the production environment to perform tests.  Vendors and tools in the CI space include:

Continuous Delivery

Continuous Delivery (CD) is the process of building a deployment pipeline where a set of tests are performed that must pass before a piece of software is allowed to be released.  Teams produce software updates in short cycles to ensure the software can be reliably released at any time.  CD builds on CI by adding regular deployments to production as part of the build process.  A healthy CD process aids in accelerated time to market, improved productivity, reliability, quality, and customer satisfaction.  Vendors in the CD space include:

It Doesn’t Stop There

Automation can take place at virtually every step of the application delivery process.  A successful implementation of automation within the DevOps methodology will lead to better products and thus much happier customers.  For those just tackling DevOps, start small by automating with scripts manual processes that are time consuming.  Then move into software solutions that assist with the build/test/deploy areas, then look on how to tie them together.   The hard part is going to be picking which solutions to use to achieve this goal but luckily there are many vendors and products in this space so it’ll be just a matter of you finding what works for your environment.

More Stories By Joe Pruitt

Joe Pruitt is a Principal Strategic Architect at F5 Networks working with Network and Software Architects to allow them to build network intelligence into their applications.

@DevOpsSummit Stories
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities - ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups.
Digital transformation is about embracing digital technologies into a company's culture to better connect with its customers, automate processes, create better tools, enter new markets, etc. Such a transformation requires continuous orchestration across teams and an environment based on open collaboration and daily experiments. In his session at 21st Cloud Expo, Alex Casalboni, Technical (Cloud) Evangelist at Cloud Academy, explored and discussed the most urgent unsolved challenges to achieve full cloud literacy in the enterprise world.
Daniel Jones is CTO of EngineerBetter, helping enterprises deliver value faster. Previously he was an IT consultant, indie video games developer, head of web development in the finance sector, and an award-winning martial artist. Continuous Delivery makes it possible to exploit findings of cognitive psychology and neuroscience to increase the productivity and happiness of our teams.
As DevOps methodologies expand their reach across the enterprise, organizations face the daunting challenge of adapting related cloud strategies to ensure optimal alignment, from managing complexity to ensuring proper governance. How can culture, automation, legacy apps and even budget be reexamined to enable this ongoing shift within the modern software factory? In her Day 2 Keynote at @DevOpsSummit at 21st Cloud Expo, Aruna Ravichandran, VP, DevOps Solutions Marketing, CA Technologies, was joined by a panel of industry experts and real-world practitioners who shared their insight into an emerging set of best practices that lie at the heart of today's digital transformation.
The standardization of container runtimes and images has sparked the creation of an almost overwhelming number of new open source projects that build on and otherwise work with these specifications. Of course, there's Kubernetes, which orchestrates and manages collections of containers. It was one of the first and best-known examples of projects that make containers truly useful for production use. However, more recently, the container ecosystem has truly exploded. A service mesh like Istio addresses many of the challenges faced by developers and operators as monolithic applications transition towards a distributed microservice architecture. A tracing tool like Jaeger analyzes what's happening as a transaction moves through a distributed system. Monitoring software like Prometheus captures time-series events for real-time alerting and other uses. Grafeas and Kritis provide security polic...