Welcome!

@DevOpsSummit Authors: Elizabeth White, Pat Romanski, Derek Weeks, Liz McMillan, Steve Wilson

Related Topics: @DevOpsSummit, Java IoT, @CloudExpo

@DevOpsSummit: Blog Feed Post

How Fast Is Fast Enough? By @Lounibos | @DevOpsSummit #APM #DevOps

How do you know when the site or app you’re building has achieved mythical “fast enough” status?

When It Comes to Delivering the Best Possible User Experience, How Fast Is Fast Enough?

Last month I spoke at the Conversion Conference, and after my talk I met a developer who had been tasked with single handedly making her company’s site faster. We talked for quite a while, and she expressed good-humored frustration at the vagueness of this directive.

Some of the things we talked about:

  • What does “faster” mean?
  • Who defines “fast” within an organization?
  • How do you know when the site or app you’re building has achieved mythical “fast enough” status?
  • And how do you respond when the same people who tell you to make the site faster are also adding images, features, and scripts that are killing performance?

Today I’m going to try to answer these questions… and hopefully help lay to rest any anxiety you’ve been feeling if you’ve been given a similarly vague directive.

What’s the ideal page load time?
Depending on whom you ask, you’ll get a different answer…

100 milliseconds?

Usability expert Jakob Nielsen has been testing people’s reactions to varying response times since 1993. The results are unchanging over the years: load times of 1oo milliseconds or less give us the most satisfying illusion of instantaneous response. This illusion is crucial to maintaining “flow” — a task state of maximum productivity coupled with personal well-being. (“Flow” is a concept popularized by psychologist Mihaly Csikszentmihalyi, who explains it really well in this TED talk.)

1 second?

Google has been pursuing a slightly less aggressive — but still ambitious — goal of pushing that pages should render in 1000 milliseconds or less. This is largely driven by the need to serve faster, less bandwidth-intensive pages to mobile users.

2 seconds?

User surveys are interesting, because they serve as a barometer of what people believe they want. For instance, according to one Akamai survey, 47% of consumers expect web pages to load in 2 seconds or less.

web performance and user expectations

More?

Similarly, if you ask the people responsible for creating and maintaining websites how fast they think their pages should be, you’ll get a mixed bag of responses. In this thread on a discussion board for marketing professionals, one commenter said that “I myself wouldn’t consider it very important. Granted if page is too slow it’s loses users, but I believe if page is loading in 5 or 6 seconds it doesn’t make much difference

There’s no single right answer
That’s because there’s no one-size-fits-all number that applies to every user and every website. Your own patience threshold varies throughout the day, depending on whether or not you’re in a hurry, how tired or hungry you are, what kind of site you’re on, how distracting your environment is, and countless other variables.

Here are a few examples to illustrate the variability of user expectations…

People are more willing to be patient with specialty sites than with sites selling general merchandise.

We looked at data from two ecommerce sites: one of which sells specialty goods and the other of which sells general merchandise. As the graphs below illustrate, when pages slow down, both bounce rate and conversions suffer much more for the general merchandise retailer than for the specialty shop.

website performance monitoring: speciality versus general merchandise

website performance monitoring: general versus specialty ecommerce

People are more patient at some points in the sales funnel than they are at others.

Looking at more real user data, we can see that for a typical ecommerce site, the conversion rate drops by up to 50% when the load time for “browse” pages increases from 1 to 6 seconds:

website performance monitoring: load times while browsing

But looking at the same set of user data, we see that the impact on conversion rate is much less when checkout pages degrade in speed:

website performance monitoring: checkout load times

Visitors in some countries are more patient than visitors in others.

Breaking down user data by geography, we found that, when faced with slower load times, people in Australia were much less likely to bounce than visitors in the US.

website performance monitoring: bounce rate by geography

Sometimes, making the user interface TOO fast is a problem.

Admittedly, this is so rare that I hesitate to mention it, but according to Jakob Nielsen, about 1% of the time the user interface is too fast. In the example that Nielsen cites, UI elements loaded so quickly that the user didn’t notice that they were still loading as she tried to interact with the page. As a result, she repeatedly clicked on the wrong page element as her intended target kept moving.

The Sophie’s choice of performance optimization
All the examples I just cited serve to illustrate that, while having the goal of making every page as blazingly fast as possible is simple and makes you feel like a performance superhero, it may not always be necessary — or even helpful. If, for example, you know that your Australian shoppers don’t seem to care whether pages render in 2 seconds or 5 seconds, why invest in optimizing pages for that audience, when you’d be better served by investing in your much less patient US shoppers?

Yes, there’s the idealistic, altruistic argument that we should serve the best, fastest user experience to all visitors. But sometimes you have to make a Sophie’s choice about where to invest your limited resources. You need data to help drive those hard choices.

So how do you determine what’s “fast enough” for your site?
The only way to answer the question “how fast is fast enough?” is to come up with a set of metrics for “fast enough” that work for your company and your visitors. Here’s a quick guide to getting started.

1. Measure
I’ve read scores of case studies about the impact of performance on business and user experience metrics for great companies, ranging from retail mega-entities like Walmart to smaller “mortal” companies like Smartfurniture.com and Edmunds.com. I love these case studies because they shine tons of light onto the business value of performance. But none of these case studies shine light on your website and your visitors. That’s why you need to collect and analyze your own user data.

The best tool for measuring (and then proceeding to the next steps: correlating and monitoring) your website’s performance is a real user monitoring solution, which gathers data about every user who visits your site. In addition to the usual page metrics — such as load time, etc. — real user monitoring can teach you a great deal about how people use your site, uncovering insights that would otherwise be impossible to obtain. There are a number of paid and open-source RUM tools on the market, though I’m partial to mPulse.

Read the original blog entry...

More Stories By SOASTA Blog

The SOASTA platform enables digital business owners to gain unprecedented and continuous performance insights into their real user experience on mobile and web devices in real time and at scale.

@DevOpsSummit Stories
When you focus on a journey from up-close, you look at your own technical and cultural history and how you changed it for the benefit of the customer. This was our starting point: too many integration issues, 13 SWP days and very long cycles. It was evident that in this fast-paced industry we could no longer afford this reality. We needed something that would take us beyond reducing the development lifecycles, CI and Agile methodologies. We made a fundamental difference, even changed our culture.
As many know, the first generation of Cloud Management Platform (CMP) solutions were designed for managing virtual infrastructure (IaaS) and traditional applications. But that’s no longer enough to satisfy evolving and complex business requirements. In his session at 21st Cloud Expo, Scott Davis, Embotics CTO, will explore how next-generation CMPs ensure organizations can manage cloud-native and microservice-based application architectures, while also facilitating agile DevOps methodology. He will explain how automation, orchestration and governance are fundamental to managing today’s hybrid cloud environments and are critical for digital businesses to deliver services faster, with better user experience and higher quality, all while saving money.
In his opening keynote at 20th Cloud Expo, Michael Maximilien, Research Scientist, Architect, and Engineer at IBM, discussed the full potential of the cloud and social data requires artificial intelligence. By mixing Cloud Foundry and the rich set of Watson services, IBM's Bluemix is the best cloud operating system for enterprises today, providing rapid development and deployment of applications that can take advantage of the rich catalog of Watson services to help drive insights from the vast trove of private and public data available to enterprises.
Most companies are adopting or evaluating container technology - Docker in particular - to speed up application deployment, drive down cost, ease management and make application delivery more flexible overall. As with most new architectures, this dream takes a lot of work to become a reality. Even when you do get your application componentized enough and packaged properly, there are still challenges for DevOps teams to making the shift to continuous delivery and achieving that reduction in cost and increase in speed.
SYS-CON Events announced today that CA Technologies has been named "Platinum Sponsor" of SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business - from apparel to energy - is being rewritten by software. From planning to development to management to security, CA creates software that fuels transformation for companies in the application economy. With CA software at the center of their IT strategy, organizations can leverage the technology that changes the way we live - from the data center to the mobile device. CA's software and solutions help customers thrive in the new application economy by delivering the means to deploy, monitor and secure their applications and infrastructure.
Given the popularity of the containers, further investment in the telco/cable industry is needed to transition existing VM-based solutions to containerized cloud native deployments. The networking architecture of the solution isolates the network traffic into different network planes (e.g., management, control, and media). This naturally makes support for multiple interfaces in container orchestration engines an indispensable requirement.
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devices - computers, smartphones, tablets, and sensors - connected to the Internet by 2020. This number will continue to grow at a rapid pace for the next several decades. With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo in Silicon Valley. Learn what is going on, contribute to the discussions, and ensure that your enterprise...
While some vendors scramble to create and sell you a fancy solution for monitoring your spanking new Amazon Lambdas, hear how you can do it on the cheap using just built-in Java APIs yourself. By exploiting a little-known fact that Lambdas aren’t exactly single-threaded, you can effectively identify hot spots in your serverless code. In his session at @DevOpsSummit at 21st Cloud Expo, Dave Martin, Product owner at CA Technologies, will give a live demonstration and code walkthrough, showing how to overcome the challenges of monitoring S3 and RDS. This presentation will provide an overview of necessary Amazon Lambda concepts and discus how to integrate the monitoring data with other tools.
SYS-CON Events announced today that Elastifile will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Elastifile Cloud File System (ECFS) is software-defined data infrastructure designed for seamless and efficient management of dynamic workloads across heterogeneous environments. Elastifile provides the architecture needed to optimize your hybrid cloud environment, by facilitating efficient data access across cloud and on-premises boundaries - with all the advantages of public IaaS everywhere.
As DevOps methodologies expand their reach across the enterprise, organizations face the daunting challenge of adapting related cloud strategies to ensure optimal alignment, from managing complexity to ensuring proper governance. How can culture, automation, legacy apps and even budget be reexamined to enable this ongoing shift within the modern software factory?
There is only one world-class Cloud event on earth, and that is Cloud Expo – which returns to Silicon Valley for the 21st Cloud Expo at the Santa Clara Convention Center, October 31 - November 2, 2017. Every Global 2000 enterprise in the world is now integrating cloud computing in some form into its IT development and operations. Midsize and small businesses are also migrating to the cloud in increasing numbers. Companies are each developing their unique mix of cloud technologies and services, forming multi-cloud and hybrid cloud architectures and deployments across all major industries. Cloud-driven thinking has become the norm in financial services, manufacturing, telco, healthcare, transportation, energy, media, entertainment, retail and other consumer industries, and the public sector.
@DevOpsSummit at Cloud Expo taking place Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center, Santa Clara, CA, is co-located with the 21st International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that produce software that is obsolete at launch. DevOps may be disruptive, but it is essential.
SYS-CON Events announced today that Golden Gate University will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Since 1901, non-profit Golden Gate University (GGU) has been helping adults achieve their professional goals by providing high quality, practice-based undergraduate and graduate educational programs in law, taxation, business and related professions. Many of its courses are taught by faculty actively working in their field of expertise, providing students with skills that can be applied immediately. The new MS in Business Analytics, like most of its programs, is available fully online or in-person in downtown SF.
DevOps at Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that produce software that is obsolete at launch. DevOps may be disruptive, but it is essential.
With Cloud Foundry you can easily deploy and use apps utilizing websocket technology, but not everybody realizes that scaling them out is not that trivial. In his session at 21st Cloud Expo, Roman Swoszowski, CTO and VP, Cloud Foundry Services, at Grape Up, will show you an example of how to deal with this issue. He will demonstrate a cloud-native Spring Boot app running in Cloud Foundry and communicating with clients over websocket protocol that can be easily scaled horizontally and coordinate communication between multiple instances by using an additional message broker.
SYS-CON Events announced today that DXWorldExpo has been named “Global Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Digital Transformation is the key issue driving the global enterprise IT business. Digital Transformation is most prominent among Global 2000 enterprises and government institutions.
SYS-CON Events announced today that Grape Up will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct. 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company specializing in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market across the U.S. and Europe, Grape Up works with a variety of customers from emerging startups to Fortune 1000 companies.
21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterprises are using some form of XaaS – software, platform, and infrastructure as a service.
In his session at 20th Cloud Expo, Scott Davis, CTO of Embotics, discussed how automation can provide the dynamic management required to cost-effectively deliver microservices and container solutions at scale. He also discussed how flexible automation is the key to effectively bridging and seamlessly coordinating both IT and developer needs for component orchestration across disparate clouds – an increasingly important requirement at today’s multi-cloud enterprise.
DevOps at Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that produce software that is obsolete at launch. DevOps may be disruptive, but it is essential.
Vulnerability management is vital for large companies that need to secure containers across thousands of hosts, but many struggle to understand how exposed they are when they discover a new high security vulnerability. In his session at 21st Cloud Expo, John Morello, CTO of Twistlock, will address this pressing concern by introducing the concept of the “Vulnerability Risk Tree API,” which brings all the data together in a simple REST endpoint, allowing companies to easily grasp the severity of the vulnerability. He will provide attendees with actionable advice related to understanding and acting on exposure due to new high severity vulnerabilities.
SYS-CON Events announced today that Secure Channels, a cybersecurity firm, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Secure Channels, Inc. offers several products and solutions to its many clients, helping them protect critical data from being compromised and access to computer networks from the unauthorized. The company develops comprehensive data encryption security strategies that are tailored for the unique needs of each client; the team builds in an intuitive user experience to boost efficiency and effectiveness of its cyber security solutions.
"With Digital Experience Monitoring what used to be a simple visit to a web page has exploded into app on phones, data from social media feeds, competitive benchmarking - these are all components that are only available because of some type of digital asset," explained Leo Vasiliou, Director of Web Performance Engineering at Catchpoint Systems, in this SYS-CON.tv interview at DevOps Summit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
The goal of Continuous Testing is to shift testing left to find defects earlier and release software faster. This can be achieved by integrating a set of open source functional and performance testing tools in the early stages of your software delivery lifecycle. There is one process that binds all application delivery stages together into one well-orchestrated machine: Continuous Testing. Continuous Testing is the conveyer belt between the Software Factory and production stages. Artifacts are moved from one stage to the next only after they have been tested and approved to continue. New code submitted to the repository is tested upon commit. When tests fail, the code is rejected. Subsystems are approved as part of periodic builds on their way to the delivery stage, where the system is being tested as production ready. The release process stops when tests fail. The key is to shift test c...
Docker containers have brought great opportunities to shorten the deployment process through continuous integration and the delivery of applications and microservices. This applies equally to enterprise data centers as well as the cloud. In his session at 20th Cloud Expo, Jari Kolehmainen, founder and CTO of Kontena, discussed solutions and benefits of a deeply integrated deployment pipeline using technologies such as container management platforms, Docker containers, and the drone.io Cl tool. He also demonstrated deployment of a CI/CD pipeline using container management, as well as show how to deploy a containerized application through a continuous delivery pipeline.