@DevOpsSummit Authors: Liz McMillan, Yeshim Deniz, Zakia Bouachraoui, Pat Romanski, Elizabeth White

Related Topics: @DevOpsSummit, Containers Expo Blog, @CloudExpo

@DevOpsSummit: Blog Post

The Biggest Performance Testing Stories of 2015 | @DevOpsSummit #APM #DevOps

We thought it'd be fun to offer a look back at some of 2015's biggest performance testing stories

We thought it'd be fun to offer a look back at some of 2015's biggest performance testing stories. Or in some cases, maybe all that was tested was our patience. Either way, here's a quick trip down memory lane.

Here we are - just a day away from 2016. It's hard to believe the year is over.

It's even harder to believe everything that happened this year. If you build and test software you probably powered through a ton during these past 12 months, to the point where you can't even understand where the time went. Yet if you pick your head up and think about all that's transpired, you might be surprised.

We thought it'd be fun to offer a look back at some of 2015's biggest performance testing stories. Or in some cases, maybe all that was tested was our patience. Either way, here's a quick trip down memory lane.

1. The line between mobile and web is almost gone
When the year started, we here at Neotys came up with a number of performance testing predictions for 2015. One of them was:

The line between mobile and web will almost disappear.

Looking back on 2015, we think it's safe to say that, "YES!" This has essentially happened. Maybe not everywhere, but in 2015 people learned from what Best Buy went through last Black Friday and began treating their infrastructure as truly device-agnostic. This means you don't test mobile traffic independently from web traffic. Testers recognize that computer users also have phones which are used interchangeably to accomplish tasks.

In fact, lots of teams have actually adopted so-called Mobile-First development practices, recognizing that in many cases mobile users represent the bulk of their traffic. Rather than scale an experience down to the phone, they design for the phone, and scale it up for the desktop.

The phone is clearly no longer an afterthought in the development process. The lines separating devices have gone away.

2. Spectacular crashes
As per the usual, Black Friday and Cyber Monday did not disappoint. There were outages at name brand companies like Neiman Marcus, PayPal, HiFi, and others. Here's another interesting datapoint: Target saw their online traffic double since last year. Let's pause on that - it doubled. That means that their peak traffic in 2014 was only HALF of what their peak traffic was this year. That's an amazing trajectory and if there is one thing we can learn it's that data traffic goes in only one direction: up. You always need to be prepared for extremes.

Then of course, there was the 2015 Star Wars phenomenon. Certainly there were a few spectacular crashes in the movie (no spoilers!), but from our perspective the most noteworthy crashes happened the day tickets went on sale. Both the Fandango and MovieTickets.com sites were brought down by the Empire. Or the Jedi. Or the Force. Be prepared for high load you must or website crashes you will experience.

3. Video mainstreaming
Without a doubt, video took off in a big way in 2015. Netflix and Hulu are stronger than ever - in fact, Netflix's stock price soared through the course of the year. This year we also saw the introduction of HBO Now, HBO's direct-to-consumer service that bypassed cable systems for the first time ever. Other companies are doing the same thing, like CBS and Fox, all experimenting with different business models. One thing is for sure though: viewers are tuning in.

Beyond more traditional programming, we've seen other interesting developments in video as well. One flash-in-the-pan example was Meerkat, made extremely popular for a very short time around the SxSW event this year. For a few short days, this self-broadcasting app was rumored to be the next big thing. Then it wasn't. Yet, Twitter launched a similar service called Periscope, and now even Facebook is experimenting with live videos

It just goes to show you - video is making its way into everything, and that's going to mean a lot more data flowing through our pipes.

4. Who broke the Internet?
Nothing broke the Internet this year like Kim Kardashian did in 2014. Wait... check that. Kim didn't break the Internet in 2014. So... nothing broke the Internet this year.

Yet in that spirit there were a few events that certainly warrant some acknowledgement: hugely social, viral, consuming events that caused people to respond in all sorts of ways, across all kinds of media.

Our short list?


5. That white & gold / black & blue dressdress
Finally... can you believe that the infamous white & gold / black & blue dress happened this year?

This one picture spawned so many conversations, jokes, marketing campaigns, and outright arguments, it's just worth noting for its place in 2015 popular culture. What a brewhaha. We will miss you 2015.

Happy New Year!

As 2015 draws to a close, we wanted to wish all our readers, customers, and testers everywhere a very Happy and Healthy New Year. We'll see you in 2016!

More Stories By Tim Hinds

Tim Hinds is the Product Marketing Manager for NeoLoad at Neotys. He has a background in Agile software development, Scrum, Kanban, Continuous Integration, Continuous Delivery, and Continuous Testing practices.

Previously, Tim was Product Marketing Manager at AccuRev, a company acquired by Micro Focus, where he worked with software configuration management, issue tracking, Agile project management, continuous integration, workflow automation, and distributed version control systems.

@DevOpsSummit Stories
With more than 30 Kubernetes solutions in the marketplace, it's tempting to think Kubernetes and the vendor ecosystem has solved the problem of operationalizing containers at scale or of automatically managing the elasticity of the underlying infrastructure that these solutions need to be truly scalable. Far from it. There are at least six major pain points that companies experience when they try to deploy and run Kubernetes in their complex environments. In this presentation, the speaker will detail these pain points and explain how cloud can address them.
While DevOps most critically and famously fosters collaboration, communication, and integration through cultural change, culture is more of an output than an input. In order to actively drive cultural evolution, organizations must make substantial organizational and process changes, and adopt new technologies, to encourage a DevOps culture. Moderated by Andi Mann, panelists discussed how to balance these three pillars of DevOps, where to focus attention (and resources), where organizations might slip up with the wrong focus, how to manage change and risk in all three areas, what is possible and what is not, where to start, and especially how new structures, processes, and technologies can help drive a new DevOps culture.
When building large, cloud-based applications that operate at a high scale, it's important to maintain a high availability and resilience to failures. In order to do that, you must be tolerant of failures, even in light of failures in other areas of your application. "Fly two mistakes high" is an old adage in the radio control airplane hobby. It means, fly high enough so that if you make a mistake, you can continue flying with room to still make mistakes. In his session at 18th Cloud Expo, Lee Atchison, Principal Cloud Architect and Advocate at New Relic, discussed how this same philosophy can be applied to highly scaled applications, and can dramatically increase your resilience to failure.
As Cybric's Chief Technology Officer, Mike D. Kail is responsible for the strategic vision and technical direction of the platform. Prior to founding Cybric, Mike was Yahoo's CIO and SVP of Infrastructure, where he led the IT and Data Center functions for the company. He has more than 24 years of IT Operations experience with a focus on highly-scalable architectures.
CI/CD is conceptually straightforward, yet often technically intricate to implement since it requires time and opportunities to develop intimate understanding on not only DevOps processes and operations, but likely product integrations with multiple platforms. This session intends to bridge the gap by offering an intense learning experience while witnessing the processes and operations to build from zero to a simple, yet functional CI/CD pipeline integrated with Jenkins, Github, Docker and Azure.