Filtered by tag: AI Remove Filter

Dialog with AI Expert: What AI can and cannot do

Artificial intelligence (AI) has developed rapidly, significantly transforming industries, augmenting human capabilities, streamlining operations, and enabling new opportunities. Contemporary AI models excel at automating complex workflows, processing large quantities of data, and facilitating informed decision-making across various sectors. Nonetheless, AI continues to encounter challenges in advanced reasoning and emotional intelligence. To examine AI's strengths and limitations in greater detail, we interviewed Madhu Reddiboina, Founder & CEO of RediMinds, Inc.  This article presents part 1 of that discussion.

Q: How do AI systems struggle with reasoning, abstraction, or common sense?
A: Today’s models (including GPT 5.0 released in August 2025) are brilliant pattern matchers, not grounded thinkers. They reason well inside their training distribution, but struggle with multi-step cause-and-effect situations or edge cases or unstated assumptions. In IRO work, that means an LLM can summarize records fast, but it still needs a reviewer to validate medical nuance and apply policy intent.
 
Q: Can AI truly understand or just simulate understanding?
A: Today it simulates understanding extremely well especially the frontier models when you see deep research in play. For operations, that’s fine—as long as we measure calibration, require citations, and give humans the final say. We must ensure humans remain accountable for values and judgment.
 
Q: What are the limitations of AI in replicating human creativity or emotional intelligence?
A: AI can remix patterns at scale, but it doesn’t feel, care, or build trust in a way that human interaction does. In the IRO world, empathy with providers and patients matters—explaining rationale respectfully in my view is still a human function.
 
Q: Most impressive things AI can do today that weren’t possible five years ago?
A: Reliable long-document parsing, multi-modal intake (PDFs, images, speech), strong coding co-pilots, and agentic workflows that chain tools together. For IROs: auto-triage cases, extract structured facts from messy records, align to policy, and draft rationale with citations—minutes, not hours. In the past work that an assistant or a para legal did can be done comfortably by an AI Agent.
 
Q: Examples of AI outperforming humans in specific tasks?
A: Reading 1,000 pages without fatigue, finding contradictions across files, detecting duplicate/linked claims, normalizing codes, and recalling policy language instantly. But know that humans still outperform on judgment, exceptions, and communication.
 
Q: Which industries are seeing the most transformative impact right now?
A: Software development, customer support, legal ops/contracts, marketing, finance/risk, and healthcare administration. Anywhere there’s heavy text, rules, and repetitive activities are being transformed by AI agents right now.

Q: Surprising or lesser-known applications?
A: Live policy Q&A with verifiable citations; automated prior-auth checklists; credentialing and quality checks; privacy-preserving data linking for outcomes studies etc. are some examples to start.
 
Q: How is AI augmenting human decision-making rather than replacing it?
A: There are several examples of this, Co-pilots like cursor, windsurf are augmenting the engineers to build systems in a fraction of time. Tools like Notebook LM can augment humans to grasp complex concepts fast. All frontier models at the moment are primarily in the business of augmenting humans by answering questions in a meaningful way. In the world of review services, they can pre-summarize records, highlight missing evidence, propose options with pros/cons, and surface the exact policy lines. The human reviewer confirms, amends, and signs—speed + consistency without losing accountability.
 
Q: What capabilities do you expect AI to gain in the next 5-10 years?
A: We can expect:
  • More reliable reasoning with fewer hallucinations
  • Much longer context windows
  • Continuous learning from approved, real-world data
  • On-device, PHI-secure AI systems
  • Real-time evidence validation and decision support
AI will increasingly handle most administrative workflows end-to-end, with humans supervising exceptions and ensuring accountability.

Q: Any breakthroughs on the horizon that could expand what AI can do?
A: Hyperscale data centers powering the AI boom are already facing energy constraints — a challenge likely to spark major innovation in sustainable energy production. Parallel advances in quantum computing could dramatically accelerate AI reasoning and optimization. On the software side, multi-agent orchestration and secure data enclaves will mature, expanding AI’s role in regulated industries like healthcare while improving trust and compliance.
 

In summary, while artificial intelligence has made remarkable strides in automating complex tasks, parsing vast amounts of data, and augmenting human decision-making, it remains fundamentally limited in areas requiring deep reasoning, creativity, and emotional intelligence. AI excels at pattern recognition and efficiency, transforming industries such as healthcare, legal operations, and customer support. However, true understanding, empathy, and nuanced judgment continue to be uniquely human strengths. As AI evolves, its role will increasingly be to empower humans—handling routine workflows and surfacing insights—while people retain accountability for values, exceptions, and trust. The future promises even greater reliability, longer context windows, and secure, real-time decision support, but the partnership between human expertise and AI will remain essential for responsible and impactful progress.

Read More

Dialog with AI Expert: Assessing the risk and benefits of AI technologies

This document presents part 2 of a dialogue between the NAIRO AI Committee and an AI expert, Madhu Reddiboina, Founder & CEO of RediMinds, Inc .  Artificial intelligence (AI) technologies are rapidly transforming industries, offering unprecedented opportunities alongside complex risks. This expert discussion by the NAIRO AI Committee examines the complex challenges involved in implementing AI, including ongoing problems like model hallucinations, lack of real-world experience, and concerns about bias and over-reliance in important fields such as healthcare.  The discussion highlights best practices for integrating AI with human judgment, balancing accuracy, speed, and cost, and emphasizes the importance of robust governance and continuous oversight.

Q: Why do AI models still hallucinate or generate incorrect information?
A
: Their fundamental feature is to predict “likely” next word, not verified truth. Without grounding to a trusted source like a policy database, clinical guideline, claim files etc., they can confidently make things up. We can control the hallucinations with retrieval (always cite), tool use (calculators, policy checkers), confidence thresholds, and a hard prompt to NOT guess or else :).
 
Q: How does the lack of real-world experience affect AI's decision-making capabilities?
A
: Clearly AI Models do not have lived experience, so they miss context that humans take for granted such as tradeoffs, edge-case ethics, operational constraints etc. In utilization review or IDR, that shows up as brittle decisions when documentation is messy. We fix it with domain ontologies, scenario training, and ALWAYS keep a human in the loop.
 
Q: How can AI systems unintentionally reinforce bias or discrimination?
A:
AI learns from history that is documented and digitized; if history is biased, outputs can be too. Proxies like zip code, benefit type, or provider specialty can encode disparities. We could mitigate some of it via subgroup audits, fairness metrics, bias bounties, and governance that allows humans to override and report harms.
 
Q: What are the risks of over-reliance on AI in critical sectors like healthcare?
A: Over reliance on AI can lead to Automation bias, silent failure, and data drift. In critical workflows, that can delay care or misapply policies. One way to mitigate this is to establish tiered risk controls, clear fallbacks to humans, full audit trails, and continuous monitoring.
 
Q: Best practices for designing AI that works well with humans
A: The approach depends on the process being designed. I start with a process flow or decision map that clearly defines who decides what, and when. Next, identify which parts can be handled effectively by AI given the available data, and which require uniquely human judgment. Then, design an end-to-end workflow that integrates both capabilities. Treat it as an iterative cycle — build, execute, learn, and rebuild — continuously refining how humans and AI complement each other. 
 
Q: Trade-offs between accuracy, speed, and cost in deployment
A: There’s an additional dimension to consider — scale. Speed, accuracy, and scale each influence deployment cost differently. The right balance depends on the primary business outcome you’re optimizing for. If accuracy is paramount, technical and operational choices will differ from when speed or scalability is the goal. Each dimension carries trade-offs in infrastructure, human oversight, and model complexity. Above all, never fully automate high-risk or high-impact decisions.
 
Q: What role will AI play in solving global challenges like healthcare? 
A: AI’s role is to reduce friction, accelerate evidence-based decisions, and expand equitable access to quality care. In the IRO and IDR domains, it enables faster, fairer, and more consistent reviews — freeing clinicians to focus on clinical judgment and human connection. The end result: improved efficiency, transparency, and trust across the healthcare ecosystem. 
 

In summary, responsible use of AI in healthcare requires balancing innovation with strong oversight. With clear governance, transparency, and ongoing human input, organizations can leverage AI to improve clinical decisions, enhance efficiency, and promote fairness in clinical reviews while mitigating risks. As AI continues to evolve, its success will depend not only on technical advancements, but also on a steadfast commitment to ethical collaboration—ensuring that AI augments, rather than replaces, clinical judgment and supports equitable outcomes for patients and providers alike.  



Read More

Recognizing AI applications in daily life

In 1995, Bill Gates appeared on The Late Show with David Letterman to explain this strange new thing called …. THE INTERNET.

Most people did not understand.  Letterman joked, “Why would I want to read baseball scores on a computer when I have the radio?”

Read More

Incorporating Artificial Intelligence (AI) in the Utilization Review (UR) Process

AI is increasingly being adopted into UR to streamline review processes, improve efficiency, and potentially reduce costs. AI tools and agents can automate tasks, analyze patterns, perform deep research, and provide decision support, but they may also introduce potential risks like over-reliance and algorithmic bias. NAIRO has observed a dramatic increase in states creating bills around the use of AI in UR. We have noticed that states have taken a wide-ranging approach to regulating AI into their respective UR regulations, but all agree that some form of human oversight is needed. For example, these bills are currently in process:

  • Illinois House Bill (HB) 35 (2025) proposes to create the Artificial Intelligence Systems Use in Health Insurance Act, which provides the Department of Insurance with regulatory oversight of health insurance coverage including oversight of the use of AI systems or predictive models to make or support adverse consumer outcomes.
  • Maryland HB 820 (2025) Requires that certain carriers, pharmacy benefits managers, and private review agents ensure that AI, algorithm, or other software tools are used in a certain manner when used for conducting UR.
  • New York Assembly Bill 8556 (2025-2026) prescribes requirements and safeguards for the use of an AI, algorithm, or other software tool for the purpose of UR for health and accident insurance.
  • Rhode Island Senate Bill (SB) 13 (2025-2026) - Use of Artificial Intelligence by Health Insurers, which promotes transparency and accountability in the use of AI by health insurers to manage coverage and claims.
  • Tennessee SB 1261 (2025-2026) Insurance Agents and Policies, which imposes requirements for health insurance issuers using AI, algorithms, or other software for UR or utilization management functions.

NAIRO believes there are important benefits in incorporating AI in UR, including increased efficiency and speed. For example, AI can automate routine tasks like data extraction, prior authorization requests, and initial case reviews, freeing up human reviewers for more complex cases. It can also enhance accuracy and consistency. Foundation AI models such as Google’s Gemini 2.5, Open AI’s GPT 4.5 and others now have the context and reasoning capabilities. They can analyze large datasets and identify hidden patterns that could easily be missed by humans, leading to more accurate and consistent decisions. It would result in improved decision support by providing evidence-based recommendations and highlighting relevant clinical information to facilitate human reviewers in making informed decisions.

Read More
1 Comments

Introduction to AI

Imagine a world where technology and Artificial Intelligence (AI) are seamlessly integrated into our daily lives, revolutionizing our experiences in unprecedented ways. Entrepreneur Steve Brown, upon being diagnosed with a rare form of cancer, took charge of his own care team and developed an AI-powered platform aimed at enhancing medical care. This initiative turned his personal challenge into a movement for improved healthcare solutions. One of the agents—an AI oncologist named "Dr. Haddad"—identified previously overlooked patterns, resulting in not only improved insight into his condition but also the establishment of a new pathway for care that holds potential to impact numerous lives.

What began as Brown's mission for survival has evolved into a broader initiative focused on providing individuals with rare and challenging-to-diagnose conditions the opportunity for answers, healing, and hope. His platform, CureWise.com, is already creating a waitlist of patients and clinicians who envision a future enhanced by technology and driven by empathy.

Read More