Calibrated Early Warning of Simulated Bioprocess Transitions: Comparing Scalar, Sequential, and Delay-Embedding Features
Downloads
Abstract
Early warning of bioprocess instability is an episode-level decision problem: a detector must signal before a transition while limiting nuisance alarms during stable operation. This simulation study compares classical scalar indicators, a sequential detector, logistic-score fusion, and a delay-embedding graph descriptor in two mechanistically distinct settings—a delayed chemostat approaching an oscillatory transition and a harvesting model approaching a fold. For each setting, 20 nominal-noise trajectories were divided into 12 training and eight test realizations, and five additional trajectories with doubled process noise were reserved for frozen-parameter stress testing. Biomass was evaluated in causal 100-sample windows advancing by five samples. Residual variance, lag-one autoregression, return rate, normalized permutation entropy, and an embedding-derived spanning-tree statistic were compared using window-level discrimination and episode-level detection, lead, and false-alarm rate. On the nominal chemostat test set, residual variance and a training-quantile logistic rule each detected 8/8 transitions with a median lead of 56 strides and reported false-alarm rates of 0.84 and 0.96 per 1,000 negative windows, respectively; the multivariate fusion therefore provided no operational gain over variance. In the harvesting model, feature AUCs remained close to 0.5 and qualifying alarms were sparse, so the tested biomass features did not establish reliable anticipation of the fold. Under doubled noise, ranking changed modestly but false alarms rose by two orders of magnitude, exposing a severe threshold-transfer failure. The analysis also distinguishes window ranking from usable warning, formalizes causal timing and persistence semantics, and shows why a maximum-spanning-tree quantity cannot be interpreted as degree-zero Vietoris–Rips persistence without recomputation. The results support a transition-specific and calibration-centered view: simple indicators can be competitive when their mechanism is aligned with the transition, whereas fusion, topology, and high AUC are not substitutes for held-out episode evaluation and noise-robust operating points.
Keywords
Bioprocess monitoring Critical transition Early warning Delayed chemostat Fold bifurcation Alarm calibration Delay embedding Persistent homology Noise robustnessReferences (30)
- [1] Scheffer, M., Bascompte, J., Brock, W. A., Brovkin, V., Carpenter, S. R., Dakos, V., & Sugihara, G. (2009). Early-warning signals for critical transitions. Nature, 461(7260), 53–59. https://doi.org/10.1038/nature08227
- [2] Dakos, V., Scheffer, M., Van Nes, E. H., Brovkin, V., Petoukhov, V., & Held, H. (2008). Slowing down as an early warning signal for abrupt climate change. Proceedings of the National Academy of Sciences, 105(38), 14308–14312. https://doi.org/10.1073/pnas.0802430105
- [3] Kuehn, C. (2011). A mathematical framework for critical transitions: Bifurcations, fast-slow systems and stochastic dynamics. Physica D: Nonlinear Phenomena, 240(12), 1020–1035. https://doi.org/10.1016/j.physd.2011.02.012
- [4] Dakos, V., Carpenter, S. R., Brock, W. A., Ellison, A. M., Guttal, V., & Ives, A. R. (2012). Methods for detecting early warnings of critical transitions in time series illustrated using simulated ecological data. PloS One, 7(7), e41010. https://doi.org/10.1371/journal.pone.0041010
- [5] Boettiger, C., & Hastings, A. (2012). Quantifying limits to detection of early warning for critical transitions. Journal of the Royal Society Interface, 9(75), 2527. https://doi.org/10.1098/rsif.2012.0125
- [6] Jäger, G., & Füllsack, M. (2019). Systematically false positives in early warning signal analysis. PLoS One, 14(2), e0211072. https://doi.org/10.1371/journal.pone.0211072
- [7] Proverbio, D., Skupin, A., & Gonçalves, J. (2023). Systematic analysis and optimization of early warning signals for critical transitions using distribution data. IScience, 26(7). https://doi.org/10.1016/j.isci.2023.107156
- [8] George, S. V, Kachhara, S., & Ambika, G. (2023). Early warning signals for critical transitions in complex systems. Physica Scripta, 98(7), 72002. https://doi.org/10.1088/1402-4896/acde20
- [9] Qin, S. J. (2012). Survey on data-driven industrial process monitoring and diagnosis. Annual Reviews in Control, 36(2), 220–234. https://doi.org/10.1016/j.arcontrol.2012.09.004
- [10] Venkatasubramanian, V., Rengaswamy, R., Kavuri, S. N., & Yin, K. (2003). A review of process fault detection and diagnosis: Part III: Process history based methods. Computers & Chemical Engineering, 27(3), 327–346. https://doi.org/10.1016/S0098-1354(02)00162-X.
- [11] Downs, J. J., & Vogel, E. F. (1993). A plant-wide industrial process control problem. Computers & Chemical Engineering, 17(3), 245–255. https://doi.org/10.1016/0098-1354(93)80018-I
- [12] Mondal, P. P., Galodha, A., Verma, V. K., Singh, V., Show, P. L., Awasthi, M. K., & Jain, R. (2023). Review on machine learning-based bioprocess optimization, monitoring, and control systems. Bioresource Technology, 370, 128523. https://doi.org/10.1016/j.biortech.2022.128523
- [13] Lim, S. J., Son, M., Ki, S. J., Suh, S. I., & Chung, J. (2023). Opportunities and challenges of machine learning in bioprocesses: categorization from different perspectives and future direction. Bioresource Technology, 370, 128518. https://doi.org/10.1016/j.biortech.2022.128518
- [14] Brunner, V., Siegl, M., Geier, D., & Becker, T. (2021). Challenges in the development of soft sensors for bioprocesses: A critical review. Frontiers in Bioengineering and Biotechnology, 9, 722202. https://doi.org/10.3389/fbioe.2021.722202
- [15] Mowbray, M., Savage, T., Wu, C., Song, Z., Cho, B. A., Del Rio Chanona, E. A., & Zhang, D. (2021). Machine learning for biochemical engineering: A review. Biochemical Engineering Journal, 172, 108054. https://doi.org/10.1016/j.bej.2021.108054
- [16] Bandt, C., & Pompe, B. (2002). Permutation entropy: A natural complexity measure for time series. Physical Review Letters, 88(17), 174102. https://doi.org/10.1103/PhysRevLett.88.174102
- [17] Perea, J. A., & Harer, J. (2015). Sliding windows and persistence: An application of topological methods to signal analysis. Foundations of Computational Mathematics, 15(3), 799–838. https://doi.org/10.1007/s10208-014-9206-z
- [18] Perea, J. A., Deckard, A., Haase, S. B., & Harer, J. (2015). SW1PerS: Sliding windows and 1-persistence scoring; discovering periodicity in gene expression time series data. BMC Bioinformatics, 16(1), 257. https://doi.org/10.1186/s12859-015-0645-6
- [19] Edelsbrunner, H., & Harer, J. (2010). Computational topology: An introduction. American Mathematical Soc. https://www.researchgate.net/profile/John-Harer/publication/220692408
- [20] Gidea, M., Goldsmith, D., Katz, Y., Roldan, P., & Shmalo, Y. (2020). Topological recognition of critical transitions in time series of cryptocurrencies. Physica A: Statistical Mechanics and Its Applications, 548, 123843. https://doi.org/10.1016/j.physa.2019.123843
- [21] Ismail, M. S., Noorani, M. S. M., Ismail, M., Razak, F. A., & Alias, M. A. (2022). Early warning signals of financial crises using persistent homology. Physica A: Statistical Mechanics and Its Applications, 586, 126459. https://doi.org/10.1016/j.physa.2021.126459
- [22] Lade, S. J., & Gross, T. (2012). Early warning signals for critical transitions: A generalized modeling approach. PLoS Computational Biology, 8(2), e1002360. https://doi.org/10.1371/journal.pcbi.1002360
- [23] Veraart, A. J., Faassen, E. J., Dakos, V., Van Nes, E. H., Lürling, M., & Scheffer, M. (2012). Recovery rates reflect distance to a tipping point in a living system. Nature, 481(7381), 357–359. https://doi.org/10.1038/nature10723
- [24] Gopalakrishnan, E. A., Sharma, Y., John, T., Dutta, P. S., & Sujith, R. I. (2016). Early warning signals for critical transitions in a thermoacoustic system. Scientific reports, 6(1), 35310. https://doi.org/10.1038/srep35310
- [25] Bury, T. M., Bauch, C. T., & Anand, M. (2020). Detecting and distinguishing tipping points using spectral early warning signals. Journal of the Royal Society Interface, 17(170), 20200482. https://doi.org/10.1098/rsif.2020.0482
- [26] Bury, T. M., Sujith, R. I., Pavithran, I., Scheffer, M., Lenton, T. M., Anand, M., & Bauch, C. T. (2021). Deep learning for early warning signals of tipping points. Proceedings of the National Academy of Sciences, 118(39), e2106140118. https://doi.org/10.1073/pnas.2106140118
- [27] Page, E. S. (1954). Continuous inspection schemes. Biometrika, 41(1/2), 100–115. https://doi.org/10.2307/2333009
- [28] Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., & Duchesnay, É. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12, 2825–2830. https://jmlr.org/papers/volume12/pedregosa11a/pedregosa11a.pdf
- [29] Fawcett, T. (2006). An introduction to ROC analysis. Pattern Recognition Letters, 27(8), 861–874. https://doi.org/10.1016/j.patrec.2005.10.010
- [30] Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B (Methodological), 57(1), 289–300. https://doi.org/10.1111/j.2517-6161.1995.tb02031.x