Welcome!

@DevOpsSummit Authors: Elizabeth White, Zakia Bouachraoui, Pat Romanski, Liz McMillan, Yeshim Deniz

Related Topics: @DXWorldExpo, @CloudExpo, @ThingsExpo

@DXWorldExpo: Blog Feed Post

Unintended Consequences of the Wrong Measures | @ExpoDX #DX #AI #BigData #Analytics

Applying baseball sabermetrics lesson to healthcare

In an attempt to put the patient first in healthcare, Congress and President Obama in 2015 approved a bipartisan bill for United States healthcare reform. The bill is known as “Medicare Access and CHIP Reauthorization Act of 2015,” or MACRA. Among the major provisions of MACRA is the Quality Payment Program. Under the Quality Payment Program, physicians and nurses receive positive, neutral or negative Medicare payment adjustments based upon a “Patient Satisfaction Score,” that is, patient satisfaction scores have a direct impact on how physicians, physician assistants, nurses, and hospital’s get paid by Medicare.

Managing the broader healthcare goal of “Improving the Quality and Effectiveness of Patient Care” from a single, highly generalized measure is a major concern for physicians and hospitals. These “patient satisfaction scores” can drive unintended patient treatment consequences. For example, some patients may have preconceived expectations about treatments and medicines based upon what they read on sites like WebMD. Patients may become dissatisfied when physicians prescribe more relevant treatments and that patient dissatisfaction may be reflected in the patient satisfaction scores. As a result, physicians may feel pressured to consent to patient demands for unnecessary tests or to overprescribe pain medications to avoid being penalized on patient satisfaction surveys and receiving a lower reimbursement – a situation that may be contributing to today’s opioid epidemic.

My nephew is an Emergency Room doctor and he confirmed that there is lots of pressure on hospitals, physicians and nurses to do what the patient wants (in order to get higher patient satisfaction scores) versus doing what’s right for the patient (which might lead to lower patient satisfaction scores). I know that I get frustrated when my doctor tells me to exercise more and eat more healthy foods. I know that’s what’s right for me, but I could easily penalize the doctor for telling me “what I need to hear” versus “what I want to hear” (i.e., eat more Chipotle and watch more TV while lying on the couch).

Setting the right metrics is a tricky effort because as John Smale, former CEO of Procter & Gamble, used to say:

“You are what you measure, and ultimately, you measure what you reward.”

That is, people will do what they are paid to do. If hospitals, physicians and nurses are reimbursed to increase patient satisfaction, then doing what the patient wants is the rationale choice.

Baseball Analogy: Importance of the Right Measures
To understand how a healthcare organization could create measures that drive a more strategic “Improving the Quality and Effectiveness of Patient Care” business initiative, let’s take a look at how baseball measures the “value and effectiveness of a player.” Being able to quantify the value and effectiveness of a baseball player is critical to major league baseball success as it impacts decisions around contracts, contract extensions, reassignments and trades. Baseball and the use of sabermetrics provide good lessons in how to leverage data and analytics in an attempt to determine or predict a player’s value. And while sabermetrics has only been around formally since 1980, statistics and baseball have gone hand-in-hand for over a century.

Let’s say, for example, we are trying to determine the value of a hitter. Today, Mike Trout (California Angels) and Bryce Harper (Washington Nationals) are considered two of the best hitters in professional baseball. Their offensive performance statistics – both career-wise and for the current season – speak for themselves (see Figure 1).

Figure 1: Harper and Trout’s Offensive Performance

And while there is an extensive set of offensive productivity measures against which to judge a hitter’s performance, it isn’t just hitting that determines a player’s value. Fielding effectiveness is another consideration, and both Harper and Trout excel in that category as well:

Baseball has tried to create a single super metric – Wins above Replacement or WAR – that is, an attempt by the sabermetrics baseball community to summarize a player’s total contributions in one statistic. WAR is all-inclusive and provides a useful reference point for comparing players (see Figure 2).

Figure 2: Components of the Offensive WAR Calculation

However, even with WAR there is no single measure. There are many subcategories of offensive WAR including:

  • Offensive Wins above Replacement
  • Batting Runs from Weighted Runs above Average
  • Base-running Runs from Weighted Runs above Average
  • Runs above Replacement
  • Offensive Runs above Average
  • Offensive Wins above Average
  • W-L Percentage of Offensive Wins above Average
  • Average Team Runs per Game with Player

The sabermetrics community warns against using a single metric to evaluate the effectiveness and value of a player. No single measure can truly determine a baseball player’s value, and likewise no single measure can be used to determine the quality and effectiveness of patient care. Baseball gets it!

Applying Baseball Sabermetrics Lesson to Healthcare
Applying our sabermetrics lesson to healthcare, we’d want to capture a diverse set of measures that we could use to measure and drive progress in “improving the quality and effectiveness of patient care.” For example, we could create a “Quality of Care” score for each patient visit that could be comprised of the following sub-measures:

  • Patient Satisfaction
  • Readmissions
  • Hospital Acquired Infections
  • Physician / Nurse Satisfaction Score
  • Recovery Days / Rehab Days
  • Percentage Total Recovery
  • Cost of Care

Role of Patient Analytic Profiles
To support the “Improve the Quality and Effectiveness of Patient Care” business initiative, we would want to create an Analytic Profile for each patient (as well as creating analytic profiles for the physicians, nurses, ER and OR).

Analytic Profiles capture the organization’s analytic assets to facilitate the refinement and sharing of those analytic assets across multiple use cases. An Analytic Profile consists of metrics, predictive indicators, segments, scores, and business rules that codify the behaviors, preferences, propensities, inclinations, tendencies, interests, associations and affiliations for the organization’s key business entities.

Patient Analytic Profiles are important because they allow hospitals and care givers to use a more holistic set of measures to determine the quality and effectiveness of patient care. For example, we could create a Patient Analytic Profile that captures key predictive metrics and scores for each patient that measure overall patient health and wellness including Diet Score, Exercise Score , Stress Score and an overall Wellness Score (see Figure 3).

Figure 3: Patient Analytic Profile

See “Analytic Profiles: Key to Data Monetization” for more details on the Analytic Profiles concept.

Summary
Creating one single measure against which to monitor any complicated business initiative (like determining the quality and effectiveness of patient care) is naïve. Baseball, with over a century of statistics experience, knows no single measure can be used to determine the value or effectiveness of a baseball player. And relying upon the public’s opinion as the single measure of effectiveness is greatly flawed.

The public is not always a reliable source of what’s good and what’s not good. Remember the Internet phenomenon movie called “Snakes on a Plane”, a film that is now universal shorthand for “hideously bad”?

‘nuff said.

Sources:

How Patient Satisfaction Scores Affect Physicians and Care

Why Rating Your Doctor Is Bad for Your Health

The post Unintended Consequences of the Wrong Measures appeared first on InFocus Blog | Dell EMC Services.

Read the original blog entry...

More Stories By William Schmarzo

Bill Schmarzo, author of “Big Data: Understanding How Data Powers Big Business” and “Big Data MBA: Driving Business Strategies with Data Science”, is responsible for setting strategy and defining the Big Data service offerings for Hitachi Vantara as CTO, IoT and Analytics.

Previously, as a CTO within Dell EMC’s 2,000+ person consulting organization, he works with organizations to identify where and how to start their big data journeys. He’s written white papers, is an avid blogger and is a frequent speaker on the use of Big Data and data science to power an organization’s key business initiatives. He is a University of San Francisco School of Management (SOM) Executive Fellow where he teaches the “Big Data MBA” course. Bill also just completed a research paper on “Determining The Economic Value of Data”. Onalytica recently ranked Bill as #4 Big Data Influencer worldwide.

Bill has over three decades of experience in data warehousing, BI and analytics. Bill authored the Vision Workshop methodology that links an organization’s strategic business initiatives with their supporting data and analytic requirements. Bill serves on the City of San Jose’s Technology Innovation Board, and on the faculties of The Data Warehouse Institute and Strata.

Previously, Bill was vice president of Analytics at Yahoo where he was responsible for the development of Yahoo’s Advertiser and Website analytics products, including the delivery of “actionable insights” through a holistic user experience. Before that, Bill oversaw the Analytic Applications business unit at Business Objects, including the development, marketing and sales of their industry-defining analytic applications.

Bill holds a Masters Business Administration from University of Iowa and a Bachelor of Science degree in Mathematics, Computer Science and Business Administration from Coe College.

@DevOpsSummit Stories
Adding public cloud resources to an existing application can be a daunting process. The tools that you currently use to manage the software and hardware outside the cloud aren’t always the best tools to efficiently grow into the cloud. All of the major configuration management tools have cloud orchestration plugins that can be leveraged, but there are also cloud-native tools that can dramatically improve the efficiency of managing your application lifecycle. In his session at 18th Cloud Expo, Alex Lovell-Troy, Director of Solutions Engineering at Pythian, presented a roadmap that can be leveraged by any organization to plan, analyze, evaluate, and execute on moving from configuration management tools to cloud orchestration tools. He also addressed the three major cloud vendors as well as some tools that will work with any cloud.
A valuable conference experience generates new contacts, sales leads, potential strategic partners and potential investors; helps gather competitive intelligence and even provides inspiration for new products and services. Conference Guru works with conference organizers to pass great deals to great conferences, helping you discover new conferences and increase your return on investment.
With more than 30 Kubernetes solutions in the marketplace, it's tempting to think Kubernetes and the vendor ecosystem has solved the problem of operationalizing containers at scale or of automatically managing the elasticity of the underlying infrastructure that these solutions need to be truly scalable. Far from it. There are at least six major pain points that companies experience when they try to deploy and run Kubernetes in their complex environments. In this presentation, the speaker will detail these pain points and explain how cloud can address them.
Containers and Kubernetes allow for code portability across on-premise VMs, bare metal, or multiple cloud provider environments. Yet, despite this portability promise, developers may include configuration and application definitions that constrain or even eliminate application portability. In this session we'll describe best practices for "configuration as code" in a Kubernetes environment. We will demonstrate how a properly constructed containerized app can be deployed to both Amazon and Azure using the Kublr platform, and how Kubernetes objects, such as persistent volumes, ingress rules, and services, can be used to abstract from the infrastructure.
SYS-CON Events announced today that Silicon India has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Published in Silicon Valley, Silicon India magazine is the premiere platform for CIOs to discuss their innovative enterprise solutions and allows IT vendors to learn about new solutions that can help grow their business.