@DevOpsSummit Authors: Yeshim Deniz, Pat Romanski, Liz McMillan, Mehdi Daoudi, Elizabeth White

Related Topics: @DevOpsSummit, Linux Containers, Containers Expo Blog

@DevOpsSummit: Blog Feed Post

Third-Party Tags on #WebPerf | @DevOpsSummit @Catchpoint #APM #DevOps

Third-party tags, while providing value and necessary functionality, can lead to unexpected results

Impact of Third-Party Tags on Performance: Take II
By Dawn Parzych

Two years ago, we published an ebook on the True Impact of Third-party Tags. A lot can change in two years, especially when it comes to technology, so we felt it was time to revisit the sites we tested. In 2015, we analyzed sites across four verticals – US banking, ecommerce, news, and travel – to see what impact third-party tags have on page weight, response times, and the number of requests. We conducted the same analysis on these sites based on data from November 2016, during which over 600,000 test runs were analyzed.

If I said I had no assumptions going into the analysis, I would be lying. There are always assumptions or hypotheses involved in an analysis such as this. Here were a few of mine:

  • Average page sizes would  increase
  • Percentage of third party requests would increase
  • Response times would be the same or better

Now, let’s see whether I was right or wrong by exploring the results below.

Average Page Size

Given that the top 100 sites have seen their average page size increase by about 30% between March 2015 and November 2016, I expected to see similar increases across the sites we analyzed; however, the results surprised me.


Banking sites saw a massive increase nearly trebling in size; something didn’t make sense here. Looking at individual tests, I noticed that one banking site had an average page weight of over 10 MB during the time period, which would definitely bring the average up. After recalculating the averages without that outlier, the results were more in line with what I was expecting.



Now, what jumped out was the drop in average page size for news sites, and then I realized The Financial Times was one of the sites we analyzed. The Financial Times has written about their performance studies and spoken about their culture of performance. Teams are empowered to say “no” to items that can lead to the site slowing down. This change took place in early 2016, influencing our comparison. The Financial Times was the lightest home page in the banking category, weighing in at 865K. The next closest page in size was 1.9MB, more than double the size.  Excluding The Financial Times from the analysis, the average size of the news sites also increased.


Percentage of Third-Party Requests

Sites are always looking for additional insights into user behavior and new features to enhance the user experience, so I was expecting the percentage of third-party requests to increase. While two industries saw increases in the percentage of third-party content, two experienced drops.


The biggest surprise didn’t come from the increases or decreases in percentages, but rather seeing that one site did not include any third-party content. Apple does not load any content on their home page from third parties. This was definitely unexpected when other sites have greater than 50% of their requests being delivered from third parties.

Page Load Time

Maybe because I spend so much time reading, thinking, and writing about web performance, I assume that pages should be getting faster. By now, everybody knows the negative consequences of slow performing pages and that users are expecting pages to load faster than ever, right? That’s why I wasn’t expecting the results we saw. Across the board, response times increased and, in some cases, the average webpage load time doubled.


Parting Thoughts

After seeing the results, I wondered if using the month of November was not a good comparison due to the start of the holiday shopping season. Maybe sites were slightly slower then due to increased traffic. I went back and looked at the response times for ecommerce sites in October to compare; the average for October was 160 ms faster than November.

The two categories with the highest percentage of third-party content also have the slowest average page load times. Every DNS lookup, TCP connection, and request adds more time to the webpage load time. With studies regularly showing the negative impact slow page loads have on key business metrics, seeing response times jump so much in a short period of time was a shock.

Third-party tags, while providing value and necessary functionality, can lead to unexpected results.

The post Impact of Third-party Tags on Performance: Take II appeared first on Catchpoint's Blog.

More Stories By Mehdi Daoudi

Catchpoint radically transforms the way businesses manage, monitor, and test the performance of online applications. Truly understand and improve user experience with clear visibility into complex, distributed online systems.

Founded in 2008 by four DoubleClick / Google executives with a passion for speed, reliability and overall better online experiences, Catchpoint has now become the most innovative provider of web performance testing and monitoring solutions. We are a team with expertise in designing, building, operating, scaling and monitoring highly transactional Internet services used by thousands of companies and impacting the experience of millions of users. Catchpoint is funded by top-tier venture capital firm, Battery Ventures, which has invested in category leaders such as Akamai, Omniture (Adobe Systems), Optimizely, Tealium, BazaarVoice, Marketo and many more.

@DevOpsSummit Stories
DXWorldEXPO | CloudEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
@DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises - and delivering real results.
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.
DXWorldEXPO LLC announced today that Dez Blanchfield joined the faculty of CloudEXPO's "10-Year Anniversary Event" which will take place on November 11-13, 2018 in New York City. Dez is a strategic leader in business and digital transformation with 25 years of experience in the IT and telecommunications industries developing strategies and implementing business initiatives. He has a breadth of expertise spanning technologies such as cloud computing, big data and analytics, cognitive computing, machine learning and the Internet of Things.
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities - ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups.