What Your AI Cannot Do
Series 01: The Body's New Partner
Ruth Vasquez is 81, a retired social worker from San Antonio, and she has used a personal health AI for fourteen months. She considers herself an informed and appreciative user. She has authorized her pharmacy records, connected her wearable, linked her blood pressure monitor, and entered her supplements by hand because she read the article about the supplement gap and took it seriously. Her health AI holds a more complete picture of her body than any single physician in her care team.
We meet her at 3:14 AM on a Thursday, in the passenger seat of her own car, which her neighbor Consuelo is driving to the emergency room. Ruth’s AI flagged a sustained elevated heart rate 45 minutes ago that has not resolved. She called Consuelo. The AI was right to flag it. In the ER waiting room, Ruth has time to think about what her AI did for her tonight, and about what it could not do: it could not drive the car. It could not tell her whether she was dying. It could not hold her hand while she waited for someone to come through the door and call her name.
What This Series Has Shown#
Seven articles. Seven transformations that are real and available in varying degrees today. A medication management AI that holds the complete pharmacological picture no single physician can see, because no single physician prescribes all the drugs. A baseline tracking system that learns the individual and detects deviations that population norms would miss. A cross-system correlation engine that connects dots across specialist silos that were never designed to communicate. A pre-visit preparation tool that returns the clinical appointment to what physician training exists to do. A fall prediction system that operates on risk convergence rather than event response. A physician-side transformation that works only when both sides of the clinical encounter change. And a framework for understanding whether continuous monitoring serves you or manages you, which depends on who you are more than on what the technology does.
Each of these is real. Each has limits this series has named. The synthesis asks what those limits add up to when you hold them all in one view.
The Clinical Limits#
Ruth’s AI flagged the elevated heart rate. The ER physician, Dr. Medina, examines her. He palpates her abdomen and finds tenderness that no wearable flagged, because no wristband sensor measures abdominal tenderness. He checks capillary refill in her fingernails, a two-second assessment that tells him something about her perfusion that her blood oxygen monitor did not capture. He watches her breathe and counts a respiratory rate that the device on her wrist was not designed to measure with the accuracy his clinical judgment requires.
These are not failures of the AI. They are the permanent territory of physical medicine. The physician who touches the patient’s body, who watches the patient walk, who hears the quality of the patient’s voice when she says she feels fine, has access to information that no sensor array can replicate. The experienced clinician’s pattern recognition operates on inputs that are tactile, visual, olfactory, and interpersonal in ways that defy digitization. The AI in Ruth’s phone is a powerful complement to the physician in the room. It is not a replacement, and it will not become one. The body’s complexity exceeds the sensor’s reach, and the gap between what the sensor captures and what the physician perceives is irreducible in the clinical sense that matters most: when something is wrong and the usual measurements do not show it.
The System Limits#
Ruth’s AI did not fix the system she arrived at the ER inside. The wait was two hours and forty minutes. The ER was staffed for a city that has grown by 120,000 people in the last decade without adding a hospital. The follow-up appointment her discharge instructions recommended requires a cardiologist with a six-week waiting list. The imaging study Dr. Medina ordered will cost $1,400 if Ruth’s Medicare supplement does not cover it, and she will not know whether it does until the bill arrives.
A personal health AI that prepares a better pre-visit summary does not add cardiologists to San Antonio. A fall prediction system that flags high-risk days does not reopen the rural hospital that closed. A medication management tool that catches drug interactions does not reduce the cost of the drugs it is tracking. The AI operates inside a healthcare system whose structural problems, documented across four series on Blue Gray Matters, remain structural. The tool is a better instrument inside a broken system. The system’s brokenness is not the tool’s problem to solve, and presenting the tool as though it could solve it is a form of dishonesty this publication does not practice.
The Integration Problem#
Ruth authorized six data sources. Her pharmacy records, her wearable, her blood pressure monitor, her CPAP compliance data, her glucose monitor, and her manual supplement entries. Six streams feeding one platform. This is more integration than most consumers achieve. It is also less than the full picture.
Her ophthalmologist’s records are not connected. Her dental records are not connected. Her previous physician, who retired two years ago, maintained a paper chart that was scanned into a system her current health AI cannot access. The imaging study from 2019 that showed an incidental finding on her left kidney exists in a radiology archive that no consumer platform can reach.
Seven data streams that do not talk to each other are worse than a notebook in one specific way: the AI that synthesizes incomplete data synthesizes an incomplete picture with the authority of a complete one. Ruth’s health AI does not know what it does not know. It cannot flag the missing ophthalmology data because it does not know the ophthalmology data exists. The completeness that makes the tool powerful is also the assumption that makes it dangerous when the completeness is an illusion. The integration problem is not solved by buying more devices. It is solved by data standards, interoperability mandates, and time.
The Privacy Problem#
Ruth’s fourteen months of physiological data constitute the most detailed record of her body that has ever existed in consumer-accessible form. Her resting heart rate during sleep, her walking speed, her medication refill patterns, her blood pressure response to stress, her CPAP compliance on the nights she could not tolerate the mask. This is a physiological biography, and it lives on a server owned by a company whose business model Ruth did not evaluate before she accepted the terms of service.
Insurance companies have a documented interest in health data that could inform underwriting decisions. Law enforcement can subpoena health records under circumstances that vary by state and change by year. Data breaches in health technology are not hypothetical; they are annual events, and the data exposed is more intimate than financial records. The person most thoroughly monitored is the person most thoroughly documented, and the documentation exists independently of her consent to any specific use of it once the breach occurs.
Using a personal health AI requires understanding what you are giving up to use it. The trade is real and worth making for many people. It is not a trade that should be made in ignorance.
The Equity Problem#
The best-monitored seniors in America are already the best-served. They have the smartphones, the broadband, the digital literacy, the family support, and the $15 to $30 per month for a comprehensive platform subscription. They are the patients who arrived at medical appointments with organized medication lists before the AI existed, because they had the education and resources to prepare.
A personal health AI that costs money widens the gap between people who can afford their healthcare infrastructure and people who cannot. The free tools available today, pharmacy apps with basic interaction checking, MyChart medication lists, GoodRx tracking, provide partial coverage. The full integration picture, the one that caught Ruth’s drug interaction and flagged her elevated heart rate, carries a price that a retired social worker on a fixed income in San Antonio weighs against groceries, prescriptions, and the electric bill.
The equity argument is not that the technology should be free. It is that the gap between partial and full coverage corresponds, with uncomfortable precision, to the gap between the people this technology could help most and the people it currently reaches.
What It Actually Is#
Here is what a personal health AI is, assessed honestly after seven articles and one 3 AM drive.
It is the first entity in your healthcare life that holds a more complete picture of your body than any single physician, any single pharmacy, any single specialist. It uses that picture to keep you safer, more informed, and more in control of decisions that are yours to make. It catches medication interactions that fragmented prescribing misses. It detects deviations from your personal baseline before symptoms make them obvious. It correlates data across specialist silos that were not designed to share. It prepares you for clinical encounters in a way that returns the appointment to its purpose. It predicts risk convergence in time to act rather than react.
It does not fix the healthcare system. It does not replace the physician. It does not protect your privacy automatically. It does not work fully for people who cannot afford it. It cannot drive you to the hospital at 3 AM. It cannot tell you whether the chest pain is cardiac or muscular. It cannot hold your hand in the waiting room.
Still Worth It, Honestly Assessed#
Ruth’s AI was right about the elevated heart rate. Dr. Medina found a cardiac arrhythmia that responded to treatment. The 3 AM drive ended in a diagnosis, a treatment plan, and a follow-up appointment six weeks from now that Ruth will prepare for with the same AI that brought her to the ER tonight.
Was it worth it? Ruth thinks so. The arrhythmia was caught at 3:14 AM on a Thursday because her AI was monitoring while she slept. Without it, she would have noticed the symptoms when they became severe enough to wake her, which might have been that night or might have been next week, in a form that might have been treatable or might not have been.
This is the most honest sentence this series can offer: a personal health AI is the best tool available inside a system that is still broken in the ways Blue Gray Matters documented. Both remain true. The tool is real. The brokenness is real. The tool does not fix the brokenness, and the brokenness does not diminish the tool. Knowing the difference is the beginning of using it well, and using it well is the only version of this technology that is worth the money, the data, and the 3 AM drives it will sometimes require.
How this article connects to others in Blue Mirror.
Sources cited in this article.
- Kantor, Elizabeth D., et al. "Trends in Prescription Drug Use Among Adults in the United States From 1999-2012." JAMA, vol. 314, no. 17, 2015, pp. 1818-1831.
- Mishra, Tejaswini, et al. "Pre-Symptomatic Detection of COVID-19 from Smartwatch Data." Nature Biomedical Engineering, vol. 4, 2020, pp. 1208-1220.
- Mandl, Kenneth D., and Isaac S. Kohane. "A 21st-Century Health IT System: Creating a Real-World Information Economy." New England Journal of Medicine, vol. 386, no. 21, 2022, pp. 2027-2029.
- Varghese, Dona, and Preeti Patel. "Polypharmacy." StatPearls, StatPearls Publishing, 2024.
- Sinsky, Christine, et al. "Allocation of Physician Time in Ambulatory Practice." Annals of Internal Medicine, vol. 165, no. 11, 2016, pp. 753-760.
- Bergen, Gwen, et al. "Falls and Fall Injuries Among Adults Aged 65 and Older." Morbidity and Mortality Weekly Report, vol. 65, no. 37, 2016, pp. 993-998.
