Public Health · Infectious Disease · 3 h ago
Pretrained models show promise for infectious disease forecasting across six countries
A retrospective benchmark evaluated four time series foundation models using 289 disease–country series covering more than 70 infectious diseases. These models recorded the lowest forecasting errors in 30 of 36 settings, but the descriptive rankings do not establish statistical superiority or performance across epidemic cycles.
- Benchmark included 289 disease–country series across six national surveillance systems.
- Foundation models ranked lowest for error in 30 of 36 settings.
- Descriptive rankings do not establish statistical superiority.
- Single-year evaluations limit conclusions about longer-term forecasting reliability.
A retrospective study in BMC Public Health compared pretrained time series foundation models with disease-specific neural forecasting approaches for infectious disease surveillance. Researchers assembled 289 disease–country series comprising 106,234 weekly or monthly observations from China, Singapore, Japan, South Korea, Ireland and the United States. Four foundation models—TimesFM, Moirai, Chronos and TimeMoE—were tested without task-specific training against five neural network baselines across short-, medium- and long-term forecasting horizons.
A foundation-model variant achieved the lowest observed error in 30 of 36 country–horizon–metric settings (83.3%), assessed using mean absolute error and root mean squared error. At the one-step-ahead horizon, foundation-model variants ranked first in every country on both metrics. Larger models did not consistently produce smaller errors, and prediction-interval performance varied by country and horizon. An exploratory analysis suggested potential gains from jointly forecasting co-circulating respiratory pathogens.
These findings support further evaluation of pretrained models for surveillance pipelines, including smaller variants suitable for modest hardware. However, the rankings were descriptive rather than evidence of statistical superiority, and comparator models used fixed default configurations. Each series had only one held-out evaluation year, limiting conclusions about reliability across years, epidemic cycles or changing surveillance conditions. The study received support from the Natural Science Foundation of Chongqing; the authors declared no competing interests.
Is this summary clinically accurate?
Help fellow clinicians: your rating sends inaccurate summaries straight to our editors.
Sign in to rate this summary →Source
BMC Public Health: Benchmarking time series foundation models for multi-country infectious disease forecasting: a retrospective evaluation across over 70 diseases ↗This is an automated AI-condensed summary that has not yet been reviewed by an editor. Always consult the full item at the original source.
