A new market survey from Carta Healthcare reveals that hospital leaders are overwhelmingly rejecting fully autonomous AI in favor of “hybrid intelligence” models that pair technology with clinical expertise.

With 62.5% of respondents citing data misinterpretation as a critical risk of “black box” systems, the industry is cementing a preference for AI that augments rather than replaces human decision-making.

"The workforce challenge isn’t going away, but the focus is shifting. Health systems will invest in retention strategies, flexible staffing models, and technology that reduces burnout. The organizations that balance efficiency with workforce well-being will be best positioned to thrive."

A Carta Healthcare survey found 75% of health systems rely on human validation to ensure AI outputs are clinically relevant and trustworthy. This is largely because nearly 63% identified misinterpretation of data as the top risk of operating without human oversight.

Findings from the November 2025 AI in Hospitals & Health Systems market survey reveal that healthcare leaders want AI to augment clinicians, not replace them. Every major finding supports that “hybrid intelligence” is the superior and preferred model because it combines technology with human and clinical expertise.

The survey, conducted by Reaction Data, asked health system leaders about their perceptions of AI model types, adoption barriers, and the role of human oversight in clinical workflows. Respondents consistently indicated that autonomous, “black box” AI is risky and insufficient for high-stakes clinical environments, while AI paired with expert human validation is viewed as safer, more accurate, and more effective.

A new market survey from Carta Healthcare reveals that hospital leaders are overwhelmingly rejecting fully autonomous AI in favor of “hybrid intelligence” models that pair technology with clinical expertise.

Carta Healthcare, a provider of AI-powered clinical data abstraction solutions, announced a strategic partnership with Fivos, a provider of data solutions for medical research organizations and device manufacturers, as well as the clinical data registry provider for the Society for Vascular Surgery’s Vascular Quality Initiative (SVS VQI®).