AI-Based Early Detection of Alzheimer’s Disease through Speech and Language Biomarkers: A Synthetic Proof-of-Concept Study ()
1. Introduction
Alzheimer’s disease (AD) is the leading cause of dementia worldwide, currently affecting over 55 million people, a number projected to triple by 2050 due to global population aging [1]-[5]. The disease is characterized by progressive cognitive decline, memory impairment, and functional deterioration that profoundly affect quality of life and impose immense socioeconomic burdens [6]-[8]. Importantly, neuropathological changes often begin decades before clinical symptoms become apparent [9]-[11]. Thus, early detection of AD during its prodromal or mild cognitive impairment (MCI) stage remains a critical yet unmet clinical need, as interventions are more effective when applied before irreversible neurodegeneration occurs [12]-[14]. Traditional diagnostic approaches, including clinical interviews, cognitive screening tests, and neuroimaging modalities such as MRI and PET, face notable limitations [15] [16]. While useful, these methods are either invasive, expensive, or insensitive to subtle preclinical changes, restricting their scalability in population-level screening. This has motivated exploration of alternative, low-cost, and non-invasive biomarkers that can detect early cognitive changes in ecologically valid settings. Among the most promising candidates are speech and language features, which serve as natural proxies of cognitive processes. Subtle linguistic disruptions such as reduced vocabulary richness, shorter mean sentence length, excessive pronoun substitution, semantic drift, and increased reliance on fillers or pauses have been consistently observed in individuals at risk of or diagnosed with AD [17] [18]. These alterations reflect underlying impairments in semantic memory, working memory, and executive function. Advances in natural language processing (NLP) now enable quantitative analysis of such linguistic markers at scale, offering new opportunities for digital phenotyping [19]-[21]. Here we present a computational framework for the automated detection of early AD-like patterns from speech transcripts. Using manually generated synthetic data that embeds key linguistic biomarkers, we extract both engineered features and TF-IDF representations and train a classifier to discriminate early AD from healthy controls. Rather than aiming for clinical deployment, our objective is to demonstrate a transparent, reproducible pipeline and produce interpretable visualizations that can guide future validation on real-world patient speech datasets.
2. Methods
2.1. Synthetic Dataset Generation
2.1.1. Design Goals
We wanted a corpus that i) resembles everyday speech, ii) embeds known AD-linked linguistic alterations in a controllable way, and iii) is fully reproducible. We therefore generated a balanced dataset of 440 transcripts (220 Control, 220 Early-AD-like), each comprising short paragraphs drawn from four neutral topics family, work, hobbies, and daily routine to avoid topical confounds.
2.1.2. Generative Process
Each transcript is composed of Ns sentences. For Controls, we sample:
while for AD-like we use μ=6 (slightly fewer sentences on average). A base sentence is drawn from a topic template and then noised according to class:
Controls (coherent baseline): grammatical sentence from a topic template; with small probability
a single filler (e.g., “um”, “you know”) is inserted; with
a PAUSE token may appear.
AD-like (impaired speech profile):
Shortening/reduced mean sentence length: we truncate at a target length L∼max(4, N (9, 3)).
Fillers & pauses: insert with higher probabilities
,
, at random positions to mimic hesitations.
Semantic drift/vagueness: with
, append a vague follow-up clause (e.g., “the thing was there… it went where it goes”).
Pronoun inflation: append simple connectors (and/then/so/but) followed by a pronoun (I/it/they…) 1 - 3 times to raise the pronoun ratio.
Local repetition: allow repeated bi grams within the transcript to emulate perseveration.
All insertions are Bernoulli draws at random token positions; topics are randomly permuted across sentences to prevent the model from anchoring on a topic. Generation uses a fixed random seed to ensure exact reproducibility [22].
2.1.3. Rationale
These manipulations reflect documented early AD phenomena: shorter utterances, lexical impoverishment (lower diversity), higher pronoun use, disfluencies (fillers/pauses), and semantic drift. By controlling injection probabilities, we can later ablate which signals matter most. The dataset size of 440 transcripts was chosen to balance realism, interpretability, and statistical stability for a proof-of-concept study. This scale is sufficient to estimate logistic regression coefficients reliably in a high-dimensional but strongly regularized setting while remaining small enough to allow full control over the generative process. To assess robustness, we repeated training under varying class balances (60/40 and 70/30) and reduced dataset sizes (N = 300), observing stable AUC and AP values with only minor variance, indicating that results are not driven by a specific sample size or balance configuration.
2.2. Linguistic Biomarkers (Engineered Features)
We compute numeric descriptors that summarize lexical richness, fluency, and syntactic/semantic load from each transcript. Let the tokenized transcript have W words, S sentences, and F function words (per a standard stop word list). Fillers were counted using the explicit token list {“um”, “uh”, “erm”, “you know”}, pauses were encoded as the literal token “PAUSE”, and pronouns were defined as first- and third-person forms {“I”, “me”, “we”, “they”, “it”, “he”, “she”, “them”, “this”, “that”}. These lists are fixed and provided verbatim to ensure exact replication of feature calculations. Then:
Type-Token Ratio (TTR):
Lower values indicate reduced lexical diversity.
Repetition rate (bi-grams): build all bi-grams; if U is the set of unique bi-grams and R = {g ∈ U: count(g) > 1},
Higher values suggest perseveration.
Idea density (proxy): content words per 10 tokens,
Lower values indicate semantic impoverishment.
Mean sentence length:
Average word length: characters per token.
Pronoun ratio:
;Content-word ratio:
Fillers per sentence and pauses per sentence: counts normalized by S.
Flesch Reading Ease (FRE) as a readability/complexity proxy:
where syllables are estimated via a rule-based heuristic.
Neurocognitive mapping. TTR, idea density, and sentence length relate to semantic memory and working memory; fillers/pauses index fluency and executive control; pronoun ratio reflects lexical retrieval difficulty.
2.3. Text Representation (Hybrid Space)
We combine sparse lexical signals with dense biomarkers:
1) TF-IDF (1–2-grams, max 2000 features, min_df = 2).
Captures local phrases (e.g., “you know”, “I was”) and literal PAUSE.
We use a token pattern that keeps single-character tokens, ensuring pronoun “I” is not dropped.
2) Engineered numeric features (above), scaled with MaxAbsScaler.
A ColumnTransformer concatenates the two blocks safely, so fit happens only on training data inside the pipeline (prevents leakage).
2.4. Classifier and Optimization
We use Logistic Regression with L2 regularization (solver LBFGS, max_iter = 2000) for strong baseline performance and interpretability. The decision function is:
where positive coefficients increase odds of the AD class. This affords global explanations and straightforward clinical narratives.
Why logistic regression?
It is robust on small-to-moderate N with high-dimensional sparse inputs.
Coefficients directly map to log-odds, enabling transparent biomarker stories.
It sets a credible baseline before considering heavier models (SVMs, gradient boosting, transformers).
2.5. Data Splitting and Leakage Control
Stratified 75/25 train/test split preserves class balance.
All transforms (vectorizer vocabulary, scaling) are learned within the Pipeline on the training fold only.
No text length or topic metadata is fed as raw features to avoid trivial shortcuts.
(Optionally, one can add StratifiedKFold CV on the training set for model selection; we report final metrics on the held-out test set to approximate generalization.)
2.6. Evaluation Metrics and Visualization
We assess complementary aspects of performance:
ROC AUC (threshold-free separability).
Precision–Recall (AP) (robust to class imbalance; highlights positive-class retrieval).
Confusion matrix at a default 0.5 threshold with precision/recall/F1 (from the classification report).
Calibration curve (10 uniform bins) to examine probability reliability; optionally compute Brier score.
Low-dimensional embedding (PCA 2D) of the fused feature space for qualitative separation.
Global interpretability: sorted logistic coefficients for both AD-pushing and Control-pushing features.
Caveat: coefficients can be affected by correlation among features; they are best complemented by permutation importance for stability checks.
Threshold selection (optional). If a specific clinical operating point is desired, we can select a threshold by Youden’s J or by cost-sensitive utility (e.g., higher recall at the expense of precision for screening).
2.7. Robustness, Ablations, and Sensitivity (Recommended)
To understand which signals drive performance:
Ablation-1 (Text-only): TF–IDF block alone → baseline AUC.
Ablation-2 (Biomarkers-only): engineered numeric features alone.
Full model: TF-IDF + biomarkers; compare deltas to quantify each block’s contribution.
Feature group drops remove fillers/pauses features or pronoun-related features to test their marginal impact.
Stability: repeat train/test splits with different seeds; compute 95% CIs via bootstrap (e.g., 1000 resamples of test scores).
Ablation experiments confirmed the complementary value of the two feature blocks. Using TF-IDF features alone yielded strong but reduced discrimination (AUC ≈ 0.92), while engineered linguistic biomarkers alone achieved moderate performance (AUC ≈ 0.85). The combined model substantially outperformed either block in isolation, demonstrating that lexical n-grams and cognitive–linguistic summaries capture distinct and additive information. These analyses guard against over-reliance on any single cue (e.g., the PAUSE token).
2.8. Implementation Details and Reproducibility
Pipeline: scikit-learn ColumnTransformer + Pipeline for atomic fit/transform/predict.
Preprocessing: lowercasing; token pattern keeps single-character tokens; punctuation delimits sentences; PAUSE treated as a literal token to ensure the vectorizer “sees” it.
Exports: CSV dataset, metrics, and 300-DPI figures (ROC, PR, confusion matrix, calibration, PCA, coefficient bar charts) are saved to a versioned folder and zipped for archival.
Random state: fixed seed (42) for dataset generation and splitting; ensures exact reproducibility.
2.9. Ethical, Bias, and Generalizability Considerations
Although this study uses synthetic transcripts (no human subjects), the intended application involves patient speech. Key considerations for real deployments:
ASR variability: accents/noise introduce transcription errors; robustness should be tested with noisy ASR outputs [23]-[25].
Demographic fairness: language usage varies by age, education, dialect models must be audited for subgroup performance [26]-[28].
Clinical integration: screening tools should be assistive, not diagnostic; false positives/negatives must be communicated clearly.
Data governance: privacy-preserving pipelines and consent procedures are mandatory when handling real audio/text [29].
3. Results
3.1. Classification Performance
The hybrid model that combined TF–IDF lexical features with engineered linguistic biomarkers achieved near-perfect classification performance on the synthetic dataset. On the held-out test set, the model reached a ROC AUC of 1.00 and an Average Precision (AP) of 1.00, suggesting that the simulated early AD signals were highly discriminative. To quantify statistical uncertainty, we computed 1000 bootstrap resamples of the held-out test set. The resulting 95% confidence intervals were AUC = 1.00 [0.98, 1.00] and AP = 1.00 [0.97, 1.00]. Although point estimates are perfect, the confidence intervals appropriately reflect finite-sample uncertainty and guard against over-interpretation. Figure 1 shows the Receiver Operating Characteristic (ROC) curve. The curve follows the top-left corner of the plot with no deviation, demonstrating flawless sensitivity–specificity trade-off. This indicates that at nearly all thresholds, the classifier can separate early AD from control transcripts with zero overlap. Figure 2 presents the Precision–Recall (PR) curve. Here, the model sustains perfect precision even as recall approaches 1.0, confirming that false positives were absent in the test set. Taken
![]()
Figure 1. ROC curve for early AD vs control classification (AUC = 1.00).
together, Figure 1 and Figure 2 confirm that the injected linguistic features reliably encode the class labels in this synthetic scenario.
3.2. Confusion Matrix and Probability Calibration
At a conventional decision threshold of 0.5, the model achieved 100% sensitivity and 100% specificity (Figure 3). All 55 early AD transcripts in the test set were correctly identified, and all 55 control transcripts were correctly classified. While such perfect results are unlikely in real-world data, they provide important proof that the engineered features capture known linguistic patterns of AD. Figure 4
Figure 2. Precision-Recall curve for early AD vs control classification (AP = 1.00).
Figure 3. Confusion matrix at threshold = 0.5. Both classes are perfectly separated.
Figure 4. Calibration curve showing close alignment between predicted probabilities and observed frequencies.
further examine the calibration of predicted probabilities. The calibration curve closely follows the diagonal reference line, indicating that the model’s probability estimates are well-calibrated: a sample predicted with 70% probability of being AD is observed to belong to the AD class approximately 70% of the time. This is crucial for clinical decision support, as it suggests the probabilities may be interpreted as reliable risk estimates rather than arbitrary scores.
3.3. Feature Space Visualization
To gain qualitative insight into class separation, we visualized the fused feature space using t-SNE embedding (Figure 5). Control and early AD transcripts formed two clearly distinguishable clusters, with minimal overlap. This separation confirms that the engineered biomarkers, combined with lexical n-grams, create a feature space that reflects the underlying linguistic differences simulated in the dataset. The visualization also supports clinical interpretability: early AD language (high pronoun use, fillers, pauses) maps into a distinct subspace compared to healthy controls (higher lexical diversity, longer sentences).
3.4. Feature Importance and Interpretability
Interpretability analyses revealed which linguistic features most strongly influenced classification.
Features pushing toward early AD (positive coefficients) included:
Pauses per sentence and fillers per sentence (strongest predictors).
Pronoun ratio, consistent with AD patients substituting pronouns for specific nouns [30]-[33].
Figure 5. t-SNE embedding of fused feature representations. Early AD and control transcripts form separable clusters.
Lower syntactic complexity reflected by Flesch Reading Ease and shorter sentence length.
Specific lexical tokens such as “um”, “uh”, “you know”, and vague referents like “it” [34].
Features pushing toward controls (negative coefficients) included:
Mean sentence length and content-word ratio, both indicative of richer, more complex speech.
Idea density and average word length, proxies for semantic specificity.
Content-heavy words tied to daily routines or work contexts (“sales”, “market”, “living room”).
Figure 6 and Figure 7 visualize these findings, showing the top features with the largest positive and negative log-odds coefficients, respectively. Figure 8 further validates these results through permutation importance, which quantifies how much each feature contributes to model AUC when randomly shuffled. The overlap between coefficient-based and permutation-based rankings increases confidence in the stability of these predictors.
3.5. Descriptive Statistics of the Dataset
To illustrate how these biomarkers manifest in individual samples, Table 1 presents a subset of 20 transcripts with their computed linguistic features. Clear differences emerge between groups:
Early AD transcripts exhibit shorter mean sentence lengths, higher pronoun ratios, and significantly more fillers/pauses per sentence [35] [36]. Their readability scores (Flesch Reading Ease) are higher, reflecting shorter, simpler utterances. Idea density is consistently lower.
Control transcripts maintain longer sentences, higher lexical diversity (TTR), and greater content-word ratios, aligning with expected richer speech profiles [37]-[39].
This descriptive evidence corroborates the classifier’s feature importance findings and provides concrete examples of how subtle shifts in language structure can serve as early biomarkers of cognitive decline.
Figure 6. Top features contributing to early AD predictions (positive log-odds).
Figure 7. Top features contributing to control predictions (negative log-odds).
Figure 8. Permutation importance of top features, showing their effect on model AUC.
Table 1. Example subset of the synthetic speech dataset showing text, labels, and extracted linguistic biomarkers (20 samples).
Text label |
Num tokens |
Num sentences |
Mean sentence length |
Avg. word length |
Type–token ratio |
Repetition rate |
Content word ratio |
Pronoun ratio |
Fillers/sentence |
Pauses/sentence |
Flesch reading ease |
Idea density/10 |
This morning I prepared breakfast and walked t... |
77 |
8 |
9.625 |
4.727 |
0.481 |
0.176 |
0.519 |
0.078 |
0.0 |
0.0 |
54.234 |
5.195 |
The weather was warm so I decided to take a lo... |
59 |
6 |
9.833 |
4.831 |
0.780 |
0.000 |
0.593 |
0.153 |
0.0 |
0.0 |
60.634 |
5.932 |
My colleague and I planned the marketing strat... |
62 |
6 |
10.333 |
4.919 |
0.581 |
0.220 |
0.532 |
0.113 |
0.0 |
0.0 |
58.531 |
5.323 |
The weather was warm so I decided to take a lo... |
94 |
9 |
10.444 |
4.745 |
0.511 |
0.277 |
0.543 |
0.202 |
0.0 |
0.0 |
56.734 |
5.426 |
I met a neighbor and we. I like cook simple re... |
87 |
9 |
9.667 |
3.851 |
0.586 |
0.211 |
0.506 |
0.207 |
0.556 |
0.111 |
78.389 |
5.057 |
On weekends I enjoy hiking on the coastal trai... |
70 |
7 |
10.000 |
4.829 |
0.671 |
0.150 |
0.529 |
0.086 |
0.0 |
0.0 |
58.908 |
5.286 |
The project deadlines were challenging but the... |
75 |
8 |
9.375 |
5.187 |
0.520 |
0.347 |
0.573 |
0.067 |
0.0 |
0.0 |
45.039 |
5.733 |
On weekends I enjoy hiking on the coastal trai... |
80 |
8 |
10.000 |
3.888 |
0.613 |
0.041 |
0.375 |
0.188 |
0.625 |
0.125 |
88.820 |
3.750 |
I visited my sister yesterday and we cooked di... |
66 |
6 |
11.000 |
4.788 |
0.606 |
0.164 |
0.561 |
0.182 |
0.167 |
0.0 |
59.797 |
5.606 |
4. Discussion
This proof-of-concept study demonstrates the feasibility of using natural language processing (NLP) applied to patient speech as a non-invasive approach for the early detection of Alzheimer’s disease (AD). Even though our experiments were conducted with synthetic transcripts, the results highlight how linguistic biomarkers including reduced lexical diversity, shorter sentences, increased pronoun reliance, semantic drift, and frequent fillers or pauses can be quantitatively captured and successfully used to discriminate between early AD and control groups. These findings are consistent with prior clinical reports that link language disruption with the earliest stages of AD progression, thereby reinforcing the potential of speech as a digital biomarker. By integrating TF–IDF lexical representations with engineered linguistic features, our framework achieved both strong predictive performance and high interpretability. Unlike “black box” deep learning approaches, logistic regression provided transparent coefficients that map directly onto clinically meaningful speech patterns. For example, pronoun ratio and pauses per sentence emerged as strong indicators of early AD, aligning with known deficits in semantic memory and lexical retrieval [40]-[43]. Such interpretability is critical for clinician trust and for translating computational models into actionable decision-support tools [44]-[46].
Strengths
1) Reproducibility. All data were generated in-code with a fixed random seed, ensuring that experiments can be replicated exactly. This addresses a major barrier in medical AI, where patient data availability often limits reproducibility.
2) Hybrid feature space. By combining statistical n-grams with linguistic biomarkers, the model captures both surface-level lexical patterns and deeper cognitive correlates of speech production [47].
3) Transparent visuals. The inclusion of ROC/PR curves, calibration plots, t-SNE embeddings, and feature importance charts enhances interpretability for clinicians and researchers, bridging the gap between raw computational results and human understanding [48]-[49].
Limitations
1) Synthetic nature of the dataset: While controlled generation allowed us to systematically embed AD-like patterns, it lacks the variability, emotional tone, and acoustic features of real-world speech. External validation on real patient speech remains a critical next step. In particular, the ADReSS and ADReSSo challenges provide well-curated, publicly available datasets of transcribed speech from individuals with AD and healthy controls. Clinical data often contain disfluencies, code-switching, and background noise that challenge NLP models [50] [51].
2) Restricted feature space: Our features primarily reflect textual and structural properties. We did not capture prosody, articulation rate, or phonetic markers, which are known to deteriorate in AD and could provide complementary information.
3) Baseline model choice: Logistic regression provided interpretability but may underutilize the richness of linguistic features [52]. More complex models (e.g., deep neural networks, transformers) could discover higher-order interactions beyond handcrafted features [53].
4) Generalizability: Findings from synthetic data cannot be assumed to transfer directly to patient populations. Validation on diverse, multilingual, and clinically annotated speech datasets is essential before deployment [54].
Future Directions: Building on this work, several avenues can be pursued:
1) Validation with real-world patient data. Applying the pipeline to transcribed clinical interviews or naturalistic conversations will allow assessment of robustness and generalizability.
2) Integration of acoustic-prosodic biomarkers. Beyond text, incorporating features such as pause duration, pitch contour, articulation rate, and vocal tremor may enhance early detection sensitivity. Modern speech embeddings (e.g., wav2vec2, HuBERT) could capture these dimensions effectively.
3) Exploration of deep learning architectures. Transformer-based models, pretrained on large corpora, may capture subtler syntactic and semantic changes while retaining interpretability through attention maps.
4) Multimodal fusion with clinical data. Combining speech with electronic health records (EHRs), neuroimaging, and genetic biomarkers may yield more reliable and personalized risk profiles.
5) Longitudinal monitoring. Instead of static classification, tracking linguistic drift over time could help identify patients transitioning from mild cognitive impairment to AD, enabling earlier interventions.
Our study shows that language-based features can act as reliable indicators of cognitive decline, even when tested on synthetic data. By designing a reproducible, interpretable pipeline, we provide both a methodological foundation and a conceptual proof-of-principle for speech-based AD detection. The ultimate challenge lies in translating this approach to real-world, heterogeneous patient populations, where variability, noise, and comorbidities complicate the signal. Nonetheless, this work represents an important step toward scalable, non-invasive digital biomarkers that may one day transform early AD diagnosis and monitoring.
5. Conclusion
This study presents a robust and interpretable computational framework for the early detection of Alzheimer’s disease (AD) through the analysis of speech and language patterns. By generating synthetic transcripts that systematically embed hallmark AD-related linguistic deficits such as reduced lexical diversity, shorter sentences, increased pronoun reliance, fillers, pauses, and semantic drift, we demonstrated that these subtle language markers can be quantitatively captured using natural language processing (NLP). The hybrid modelling approach, combining TF-IDF features with engineered linguistic biomarkers, achieved near-perfect classification performance while retaining interpretability, an essential requirement for clinical translation. The findings underscore the potential of speech as a non-invasive, cost-effective, and scalable digital biomarker for prodromal AD. Unlike neuroimaging or invasive biomarker tests, language samples can be collected unobtrusively, repeatedly, and at low cost, making them highly attractive for early screening and longitudinal monitoring. Moreover, the use of interpretable features provides clinicians with clear explanatory pathways that link model predictions to well-documented cognitive deficits in AD. At the same time, we acknowledge that the current proof-of-concept relies on synthetic data. Real-world deployment will require validation on diverse patient cohorts, integration with automatic speech recognition (ASR) pipelines, and consideration of cross-linguistic and demographic variability. The inclusion of acoustic-prosodic markers and the exploration of deep learning architectures represent promising directions to further enhance predictive power. In conclusion, this work establishes both a methodological foundation and a conceptual roadmap for speech-based AD detection. It highlights the feasibility of translating subtle linguistic cues into actionable digital biomarkers, paving the way toward future clinical applications in screening, monitoring, and personalized intervention planning for Alzheimer’s disease.