Building Health Tech for the People: A New Approach to Ethical AI in Healthcare

What if we could redesign healthcare technology from the ground up to prioritize justice, community voices, and human-centered care? This vision is becoming reality through both groundbreaking research initiatives and innovative educational platforms that are putting these principles into practice. A new study from the University of Massachusetts Amherst reveals how we can build healthcare AI that truly serves people, while platforms like CarePathIQ are demonstrating how these principles can transform healthcare education and clinical practice.

The research, led by nursing faculty Rachel Walker, Jess Dillard-Wright, and computer science researcher Ravi Karkar, presents a framework called “Health Tech for the People” (HT4P) that challenges the traditional approach to AI development in healthcare. Rather than accepting the current system where AI tools often perpetuate existing inequalities, this initiative is building a new foundation based on principles of health justice, design justice, and data feminism—principles that are already being implemented by forward-thinking educational platforms working to democratize intelligent, patient-centered care pathways.

The Problem with Current Healthcare AI

The current landscape of healthcare AI is fraught with ethical challenges. From racist algorithms that deny Black patients access to care resources to AI chatbots that spread medical misinformation, the rush to implement AI in healthcare has often outpaced considerations of equity and justice. The researchers point to recent examples like Grok, an AI chatbot that has made dangerous medical claims, including stating that secondhand smoke exposure isn’t real and spreading false information about COVID-19 vaccines.

But the problems run deeper than individual AI failures. The researchers highlight how current AI development often relies on invisible, undervalued labor—from the nurses who maintain these systems to the communities whose data is extracted without proper consent or compensation. This creates what they call “technological care work” that is essential but largely unrecognized and uncompensated.

A New Framework for Ethical Healthcare Technology

HT4P’s approach is grounded in three key principles that challenge traditional tech development:

Health Justice: Rather than treating health inequities as inevitable, HT4P works to redistribute power and resources so that communities most impacted by healthcare technologies gain control over their design, deployment, and maintenance. This means centering the voices of those who will actually use and be affected by these technologies.

Design Justice: Built on Black feminist thought, this principle ensures that communities most impacted by designs are centered in design decision-making, and that all people are recognized as having unique expertise to bring to the design process. It’s about moving beyond the traditional “expert” model to truly collaborative creation.

Data Feminism: This approach calls for examining power dynamics in data collection and use, making invisible labor visible, and challenging the assumption that technology is neutral. It demands that we ask critical questions about who benefits from data collection and who bears the costs.

Two Priority Areas: Reproductive Health and Aging

HT4P focuses on two critical areas where the stakes for ethical AI are particularly high:

Reproductive Health: In the post-Roe landscape, the collection and storage of health data has become increasingly dangerous. HT4P works with communities to develop technologies that give people control over their own reproductive health data, particularly for those disproportionately impacted by state surveillance. This includes working with programs like New Beginnings, which supports pregnant and postpartum people in recovery, to create technologies that support rather than surveil.

Aging and Dementia Care: Older adults, particularly those at intersections of multiple forms of oppression, have been disproportionately harmed by surveillance AI and algorithmic bias. HT4P collaborates with local councils on aging, assisted living centers, and memory cafes to ensure that technologies for older adults are designed with their actual needs and preferences at the center, not just technological capabilities.

Building a Different Kind of Tech Community

One of HT4P’s most innovative approaches is their fellowship program, which trains graduate students across disciplines in tech ethics and accountable design. Rather than focusing solely on technical skills, fellows learn to ask critical questions about power, consent, and community impact. They use tools like a “consentful tech” framework that evaluates whether technologies truly have freely-given, reversible, informed, enthusiastic, and specific consent from the communities they serve.

The initiative also challenges traditional academic metrics of success. Instead of focusing on patents or minimum viable products, HT4P values the time-intensive work of building relationships, practicing reflexivity about power and positionality, and creating spaces for diverse voices to be heard. They use collaborative platforms like Padlet to capture poly-vocal conversations that don’t require distillation to a single “right” answer.

CarePathIQ: Putting Principles into Practice

The principles outlined by HT4P aren’t just theoretical—they’re being put into practice by innovative educational platforms like CarePathIQ, a free platform dedicated to democratizing intelligent patient-centered and equitable care pathways in healthcare education and practice. CarePathIQ’s mission directly embodies the HT4P framework by providing interdisciplinary healthcare providers with comprehensive training and innovative tools to design AI-powered pathways that prioritize patient needs, reduce health disparities, and ensure that healthcare technology serves communities rather than extracting from them.

CarePathIQ’s educational approach to intelligent care pathways represents a practical application of the health justice principles that HT4P advocates for. Rather than creating one-size-fits-all solutions that perpetuate existing inequities, CarePathIQ teaches healthcare providers how to develop personalized care pathways that adapt to individual patient needs, circumstances, and preferences. This patient-centered educational approach ensures that the most vulnerable populations—those who have historically been underserved by traditional healthcare systems—receive the attention and resources they need.

The platform’s focus on democratizing access to intelligent care pathway education aligns perfectly with HT4P’s emphasis on redistributing power in healthcare technology. By making advanced AI-driven care planning training accessible to healthcare providers across different settings and resource levels, CarePathIQ is helping to level the playing field and ensure that quality, personalized care education isn’t limited to well-resourced institutions. The platform’s comprehensive training includes tools that automate documentation, integrate real-time decision support, and implement the latest evidence-based practices into everyday clinical workflows, ultimately enabling clinicians to spend more time at the bedside and strengthen the human connection essential for optimal patient outcomes.

Looking Forward: A Radical Imagination for Healthcare Technology

HT4P represents more than just a research initiative. It’s an experiment in shifting power over AI design decision-making and changing mindsets about who gets to be a “tech worker” and what constitutes ethical AI for health and care. The researchers acknowledge that this work is challenging, particularly in academic environments that often prioritize quantifiable outcomes over relationship-building and community engagement.

But they argue that this approach is essential for creating healthcare technologies that truly serve people rather than extract from them. By centering communities, making invisible labor visible, and building technologies based on principles of justice rather than profit, HT4P is creating a model for how healthcare AI could work differently.

The initiative has already created practical tools, like their Fellow Project Preparation Checklist, which they’ve made available under a Creative Commons license so other healthcare settings can adapt and use them. They’re also developing Human-Centered Strategy Tools to help researchers who lack expertise in these dimensions to shift from technology-focused to community-led approaches.

Educational platforms like CarePathIQ are demonstrating that these principles can be successfully implemented in real-world healthcare education and practice. Their work shows that it’s possible to create AI-powered educational tools that enhance rather than replace human care, that adapt to patient needs rather than forcing patients to adapt to technology, and that work to reduce rather than perpetuate health inequities.

As healthcare continues to integrate AI technologies at a rapid pace, initiatives like HT4P and educational platforms like CarePathIQ offer a crucial alternative vision. One where technology serves justice rather than perpetuating inequality, where communities have power over the tools that affect their lives, and where the invisible care work that makes these systems function is recognized and valued. This isn’t just about making AI “better”. It’s about reimagining what healthcare technology education could be when it’s truly designed for the people it’s meant to serve.