AI & ML Complete 2025
NeuroVoice
Multimodal ML for neurological screening
The problem
Neurodegenerative and neurological conditions are often screened late, using instruments that don't scale to the population level a public-health agency needs.
The approach
As founding AI developer, built a production multimodal ML platform that analyzes speech and language for neurological biomarkers, trained on 3,000+ hours of clinical and public-health audio, and deployed it into state-level screening pipelines.
NeuroVoice is a multimodal machine learning platform for neurological screening from speech and language, built during my time as founding AI developer at Rice University. It’s since moved from research prototype to a production system piloted by state health agencies.
the problem
Conditions like Parkinson’s, ALS, and cognitive decline show up in speech - articulation, rhythm, prosody, word-finding - often before they’re caught by standard clinical screening. But cognitive screening tools that rely on in-person administration don’t scale to a state health agency trying to screen tens of thousands of people a year.
what I built
As the founding AI developer, I built the ML core of the platform: models that take raw speech and language input and output neurological risk signals, plus the pipelines to train and validate them at scale.
class NeuroVoiceModel(nn.Module):
def __init__(self):
# Pretrained speech encoder for rich acoustic representations
self.encoder = WhisperEncoder.from_pretrained("base")
# Multimodal head combining acoustic + linguistic features
self.classifier = nn.Sequential(
nn.Linear(512, 256),
nn.ReLU(),
nn.Dropout(0.3),
nn.Linear(256, num_conditions)
)
training data and validation
The models were trained on 3,000+ hours (12TB+) of clinical and public-health audio - a scale that matters, because neurological speech biomarkers are subtle and demographically variable. Against baseline cognitive screening methods, the platform achieved a 25–30% accuracy improvement.
deployment
The platform is now piloted with state health agencies across 8 US states, supporting roughly 50,000+ screenings per year. That production deployment, plus the traction from the pilots, helped the effort raise $150K+ in seed funding.
what I learned
Building for a health-agency pilot is a different discipline than building for a benchmark. Every model decision had to be explainable to a non-ML stakeholder, and the data pipeline had to handle real-world audio - background noise, accents, recording quality - not curated clinical recordings.
What I took away
- Speech contains surprisingly rich biomarkers for neurological conditions, but only if you train on enough clinically-representative audio.
- Getting a model from notebook to production pilot requires as much engineering as modeling - data pipelines, latency, and clinician trust all matter.
- Working with health-agency partners means the model has to justify itself against an existing baseline, not just beat a benchmark.
0 comments
Loading…