KLAS Contact
Contact KLAS
Contact KLAS
2024 BEST IN KLAS
Preferences
Related Series
2024
2022
2020
2019
Related Segments
Healthcare AI CHIME Edition 2019
Actualizing the Potential of Artificial Intelligence
Author
Ryan Pretnik
Author
Lois Krotz
Artificial intelligence (AI) has been a buzzword in healthcare for several years, but how real is it? Are healthcare organizations adopting AI? How are they using it, and what outcomes are they seeing? Based on interviews with 57 trailblazing healthcare organizations, this AI primer provides insights on organizations’ needed AI capabilities, common challenges, and best-practice advice. Across the technology and healthcare industries, definitions of AI vary widely; KLAS’ working definition of AI was created for use in research regarding customer satisfaction with AI technology and was formed based on advice from many leading health systems and solution partners (called “vendors” throughout).
For insights on vendor performance and customer outcomes, see the full KLAS report: “Healthcare AI 2019: Actualizing the Potential of AI.”
INDUSTRY INSIGHTS AND CONTEXT
A KLAS-CHIME Report†
† Research conducted in partnership with CHIME. Participating provider organizations were engaged through CHIME outreach to members (for this report and for the 2019 CHIME HealthCare’s Most Wired survey) and/or KLAS’ traditional, client list–based outreach.
Common Misconceptions about Healthcare AI
In this developing space, even organizations that have successfully achieved outcomes with AI technology experienced potholes along the way, often driven by misconceptions about healthcare AI and its implementation.
Misconception: Building the models is the most time-consuming AI task.
Reality: Don’t underestimate the time and effort it will take to prepare the data needed to test and build the models. Healthcare data is hard to clean and comes from many sources, and your organization may not have the expertise to feed the right variables or features into your models. Vendors and tools can help, but you need to do your own evaluation of the time and effort required to be successful with your models.
Misconception: Once the model is built, it will run itself.
Reality: Organizations must ensure long-term model applicability, accuracy, and performance. Healthcare data is often heterogenous; prebuilt models might work well in some cases, but you may have specific demographic situations to which they won’t apply, generating misleading results. Adopt and closely monitor model management to prevent concept drift, and encourage your vendor to do the same. You may be surprised at how much maintenance is required to keep your models viable over time.
Misconception: There are turnkey AI solutions that can drive outcomes.
Reality: There are plenty of user-friendly products that can help you build models quickly, and some vendors can provide deep data-science and healthcare expertise. But if you want tangible outcomes from the data, you need to consider operational aspects, like how many departments, resources, and facilities across the care continuum need to be involved. Getting buy-in from all disciplines before and after the implementation is critical. Without it, your model could end up as a shiny but useless algorithm.
Misconception: Our organization will jump at the chance to leverage AI tools.
Reality: Remember that culture shifts take time. It can be very challenging for staff (including clinicians) to trust AI-generated recommendations. Get staff buy-in early by demonstrating explainability and applicability and by sharing success stories.
How Healthcare Organizations Can Ensure Success
While technology is important, success with AI is perhaps even more dependent on an organization’s operations and change management. The following best practices come from some of the industry’s most successful AI users.
Embed AI in the workflow:
When creating models, observe clinicians’ workflows and find the appropriate places in which to embed models or insights so that they are located within users’ regular routines and are not disruptive. Promote AI insights to clinicians as extra information to act on, not extra hoops to jump through.
Bring together experts on AI, data science, modeling, analytics, and subject matter:
Promote interdisciplinary collaboration. An AI project cannot be successfully rolled out unless all groups work closely together.
Take ownership for driving change management and operationalizing insights:
Take a social engineering approach to get staff engaged in implementing changes. Report progress and successes to staff to encourage adoption.
How Vendors Can Help Drive Client Success
For healthcare organizations to be successful with their AI solutions, they need vendors that do much more than deliver a high-quality, technologically capable product. The best practices below were reported by vendors’ most successful AI customers.
Deliver comprehensive services for AI platform:
Through AI support services, some vendors offer resources like client success managers, dedicated data scientists, and field engineers to ensure models are built and deployed successfully and in a timely fashion. Customers benefit when vendors have healthcare experts on staff acting as these resources. Clients appreciate when vendors can evaluate an organization’s current AI state and provide support accordingly.
Provide strong customer training:
Effective training may come through a formal training program, tailored on-site training, a certification program, training material, and/or continuing access for questions and ongoing learning. Customers are most satisfied when their vendor trains the organization’s analysts to give them the data science expertise needed to build, deploy, and maintain their own models.
Be a humble, active partner:
Healthcare AI is still a very young market, and all vendor companies are experiencing growing pains and learning as they go. Clients need vendors who are transparent about their journey and acknowledge their need for customer partners in development. In this partnership, vendors learn best when they are responsive to constructive feedback and then correct course.
Types of AI Vendors
Measured in This Report
Purpose-Built AI Vendors:
Vendors primarily focused on analytics and AI. Offer and support dedicated, standalone product(s) designed specifically for AI. These solutions often include some level of prebuilt models, content, and uses cases specific to healthcare.
Analytics Platform Vendors with AI Infrastructure:
Analytics-focused vendors with AI infrastructure and/or platforms, typically used as a foundation to enable a do-it-yourself approach to AI (i.e., customers build their own models or use cases). These vendors’ technology is often used as the embedded AI foundation for other vendor products that are industry specific.
Not Measured in This Report
EHR Vendors with AI Capabilities:
EHR vendors who have developed and/or embedded AI models and platforms into their offerings. Mostly early in this process.
HIT Application Vendors with AI Capabilities:
Vendors who provide healthcare IT (HIT) applications that have AI capabilities but are not meant to be standalone AI applications. These vendors offer some level of AI in one or more products, typically embedded within a specific application—for example, a radiology system supported or enhanced by AI but not commercially sold as an AI product. Wide variation in what these vendors’ AI capabilities look like.
AI Adoption—From CHIME’s 2019 HealthCare’s Most Wired Report
As part of CHIME’s recent Most Wired survey, 483 provider organizations described their progress in adopting various types of AI solutions.
Validated Use Cases
The 57 organizations interviewed for this research report 37 distinct use cases across 11 categories within clinical, financial, and operational areas. While it is exciting to see AI being adopted across a wide variety of use cases, it is still too early to say whether these use cases can be scaled across broader customer bases.
Writer
Amanda Wind
Designer
Jess Wallace-Simpson
Project Manager
Robert Ellis
This material is copyrighted. Any organization gaining unauthorized access to this report will be liable to compensate KLAS for the full retail price. Please see the KLAS DATA USE POLICY for information regarding use of this report. © 2024 KLAS Research, LLC. All Rights Reserved. NOTE: Performance scores may change significantly when including newly interviewed provider organizations, especially when added to a smaller sample size like in emerging markets with a small number of live clients. The findings presented are not meant to be conclusive data for an entire client base.