Welcome!

@DevOpsSummit Authors: Yeshim Deniz, Pat Romanski, Liz McMillan, Zakia Bouachraoui, Elizabeth White

Related Topics: @DevOpsSummit, Microservices Expo, Containers Expo Blog

@DevOpsSummit: Blog Feed Post

Trend Shift Analysis | @DevOpsSummit #DevOps #APM #Monitoring

In performance monitoring, trend, or trend shift, is a key metric that is used to indicate change

Trend Shift Analysis
By Pradeep Thalanki and Ankur Vishwakarma

‘Trend’ is a pretty common business term, but its definition tends to vary by industry. In performance monitoring, trend, or trend shift, is a key metric that is used to indicate change.

Why is trend shift important?
Change is inevitable. Today’s websites must frequently update and change to keep up with competition and attract new users, but such changes can have a negative impact on the user experience if not managed properly. The dynamic nature of the Internet makes it necessary to constantly monitor different metrics. One of the biggest challenges in performance monitoring the lack of clarity when configuring alerts. Alerts that are set up using the wrong configuration can lead to an overabundance of false positive alerts or no alerts at all, which results in an increased MTTR.

Webpage response is an important metric that affects end-user experience. If the page takes too long to load, the user gets frustrated and will likely abandon the webpage. A high page load time can be caused by several issues, some of the common problems are:

  1. The server that delivers the page content is unable to handle a surge in requests
  2. The webpage has too many third-party ads/images
  3. The network is sluggish due to maintenance

Monitoring webpage response values or keeping track of the trend shift can help identify any unusual webpage behavior and to ensure a positive user experience.

This is just one of the many scenarios where analyzing trend shift can be valuable. Trend shift alerts are also useful in:

  • Detecting trend shifts on specific ISP or region or city
  • Multi hosting or multi CDN environment

When can you use trend shift?
Trend shift alerts can be set up for metrics that are prone to constant variations in their values. In the image below, a trend shift was detected on July 18 at around 16:00, which continued for about 24 hours. Later, it returned to normal, indicating that the root cause was identified and fixed.

When is trend shift irrelevant?
Trend shift can be detected when there is a sudden change (for a few consecutive runs) in the usual pattern. But if this change is gradual rather than sudden, then trend shift cannot detect the problem. In such cases, warning and critical alerts should be set up for a specific value.

In the image below, we see that the webpage response has increased gradually. The webpage response is around 2500ms in the beginning and increased to around 3500ms over two days’ time. Trend shift alert is not triggered here as the value increased gradually.

Trend shift alerts using Catchpoint
Clients can configure trend shift alerts using Catchpoint; the alerts will help them take necessary action so that end-user experience is not affected.

Below is where you will find the trend shift alerts displayed:

  1. Smartboard page
  2. Alert Log page

Trend shift alerts in the Smartboard page
The assistant widget section in the Smartboard page displays trend shifts. The Smartboard page has been developed using artificial intelligence (intense computing algorithms) that detects the trend shifts. It computes the trend shift for the test time metric (total time taken to complete the test). The Smartboard page does not require any additional configuration to display the trend shift information.

Trend shift alerts in alerts Log
A trend shift alert is triggered and displayed in the alerts log page only after it has been configured in the test properties. Trend shifts can be detected for:

  1. Timing metrics – test time, DNS, send, wait, DOM load, etc.
  2. Ping metrics – ping packet loss, ping RTT
  3. Request metrics – #Requests, #Connections, #Redirects, #Images, #Scripts, #CSS, etc.
  4. Zone metrics – self downloaded bytes, %Self Bottleneck, %Third party bottleneck, etc.

Configuring trend shift alerts
Alerts can be set up in the advanced alerts section in the test properties page as shown below. The default recipients will be notified by an email when a trend shift is detected for the metric it was configured.

Where to find trend shift alerts?
The alerts log page displays a list of alerts; it can be filtered for specific tests and alert types (metric based) for a specified time interval.

How is Trend Shift alert different from other alert types?
For regular alerts, the user should configure the values over/below which an alert should be triggered. In the case of trend shift, however, the user should select the metric to be monitored for trend shift. Trend shift is based on historical comparison, therefore there is no need to set any specific values.

Advantages of trend shift analysis
Let’s take a real scenario where trend shift analysis can be critical. Ecommerce companies rake in major business during the annual sales like Black Friday and Cyber Monday. On such days, these websites experience a rapid hike in traffic with customers rushing in to grab the best deals. The servers managing the website may slow down considerably with the influx of requests. In the image below, we can see that the webpage response shot up during a special discount sale.

Trend shift detects such spikes in the webpage response and helps businesses identify the root cause of the issue. It can provide a lot of data around the incident such as:

  1. Identifying the city with the most number of users
  2. Identifying whether the ISP (Internet Service Provider) was capable of handling the load
  3. Building a better infrastructure so that the load is distributed

Summary
Trend shift signals a change in the website performance. It provides a starting point to analyze the change (increase/decrease) in the metric being monitored. Performance analysts can use this data to identify the root cause and take corrective measures if necessary. Proactively identifying and fixing the issue will improve the user experience and have a positive impact on the company’s revenue.

The post Trend Shift Analysis appeared first on Catchpoint's Blog - Web Performance Monitoring.

Read the original blog entry...

More Stories By Mehdi Daoudi

Catchpoint radically transforms the way businesses manage, monitor, and test the performance of online applications. Truly understand and improve user experience with clear visibility into complex, distributed online systems.

Founded in 2008 by four DoubleClick / Google executives with a passion for speed, reliability and overall better online experiences, Catchpoint has now become the most innovative provider of web performance testing and monitoring solutions. We are a team with expertise in designing, building, operating, scaling and monitoring highly transactional Internet services used by thousands of companies and impacting the experience of millions of users. Catchpoint is funded by top-tier venture capital firm, Battery Ventures, which has invested in category leaders such as Akamai, Omniture (Adobe Systems), Optimizely, Tealium, BazaarVoice, Marketo and many more.

@DevOpsSummit Stories
Hackers took three days to identify and exploit a known vulnerability in Equifax’s web applications. I will share new data that reveals why three days (at most) is the new normal for DevSecOps teams to move new business /security requirements from design into production. This session aims to enlighten DevOps teams, security and development professionals by sharing results from the 4th annual State of the Software Supply Chain Report -- a blend of public and proprietary data with expert research and analysis.Attendees can join this session to better understand how DevSecOps teams are applying lessons from W. Edwards Deming (circa 1982), Malcolm Goldrath (circa 1984) and Gene Kim (circa 2013) to improve their ability to respond to new business requirements and cyber risks.
DXWorldEXPO LLC announced today that Nutanix has been named "Platinum Sponsor" of CloudEXPO | DevOpsSUMMIT | DXWorldEXPO New York, which will take place November 12-13, 2018 in New York City. Nutanix makes infrastructure invisible, elevating IT to focus on the applications and services that power their business. The Nutanix Enterprise Cloud Platform blends web-scale engineering and consumer-grade design to natively converge server, storage, virtualization and networking into a resilient, software-defined solution with rich machine intelligence.
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence. Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like "How is my application doing" but no idea how to get a proper answer.
This session will provide an introduction to Cloud driven quality and transformation and highlight the key features that comprise it. A perspective on the cloud transformation lifecycle, transformation levers, and transformation framework will be shared. At Cognizant, we have developed a transformation strategy to enable the migration of business critical workloads to cloud environments. The strategy encompasses a set of transformation levers across the cloud transformation lifecycle to enhance process quality, compliance with organizational policies and implementation of information security and data privacy best practices. These transformation levers cover core areas such as Cloud Assessment, Governance, Assurance, Security and Performance Management. The transformation framework presented during this session will guide corporate clients in the implementation of a successful cloud solu...
So the dumpster is on fire. Again. The site's down. Your boss's face is an ever-deepening purple. And you begin debating whether you should join the #incident channel or call an ambulance to deal with his impending stroke. Yes, we know this is a developer's fault. There's plenty of time for blame later. Postmortems have a macabre name because they were once intended to be Viking-like funerals for someone's job. But we're civilized now. Sort of. So we call them post-incident reviews. Fires are never going to stop. We're human. We miss bugs. Or we fat finger a command - deleting dozens of servers and bringing down S3 in US-EAST-1 for hours - effectively halting the internet. These things happen.