Informatics and Applications
2026, Volume 20, Issue 3, pp 77-86
SELF-SUPERVISED INCREMENTAL CLASS DISCOVERY VIA PROBABILITY-INFORMED CONTINUAL LEARNING
- A. M. Dostovalova
- A. K. Gorshenin
Abstract
The paper proposes a method for solving the continuous incremental classification problem, which consists in discovering new classes in data streams under the condition of absent labeling for limited time series and tabular data. To generate accurate pseudolabels for new data that complement previously identified patterns, a specialized neural network was developed whose architecture is informed by a deep mixture ofGaussian distributions and which implements learning based on a contrastive loss function. The method was tested on publicly available datasets using various discriminator architectures, including the Transformer. The performance of the proposed method was compared against uninformed networks and machine learning methods for pseudo-labeling.
The informed network demonstrates superior generalization capabilities in detecting new classes within unlabeled data, particularly under conditions of small-scale training datasets. The gain in the harmonic Ff metric, which balances the recognition accuracy for objects of old and new classes, reaches 66.32% (with an average value of 15.28%), while the macroaveraged classification accuracy for the dataset based on the Ff"8 metric increases by 52.86% (with an average value of 11.8%).
[+] References (26)
- Hofmanninger, J., M. Perkonigg, J.A. Brink, et al. 2020. Dynamic memory to alleviate catastrophic forgetting in continuous learning settings. Medical image computing and computer assisted intervention. Eds. A. L. Martel, P. Abolmaesumi, D. Stoyanov, D. Mateus, M. A. Zuluaga, S. K. Zhou, D. Racoceanu, and L. Joskowicz. Lecture notes in computer science. Cham: Springer. 12262:359- 368. doi: 10.1007/978-3-030-59713-9-35.
- Ribeiro, A. G., L. Vilaga, C. Costa, et al. 2025. Automatic visual inspection for industrial application. J. Imaging 11(10):350. 30 p. doi: 10.3390/jimaging11100350.
- Harman, F. 2026. Incremental learning in medical imaging: A comprehensive survey of deep neural network advances and challenges. IEEE Access 14:15812-15840. doi: 10.1109/ACCESS.2026.3659025.
- Wang, L., K. Yang, C. Li, L. Hong, Z. Li, and J. Zhu. 2021. ORDisCo: Effective and efficient usage of incremental unlabeled data for semi-supervised continual learning. IEEE/CVF Conference on Computer Vision and Pattern Recognition Proceedings. IEEE. 5379-5388. doi: 10.1109/CVPR46437.2021.00534.
- Lechat, A., S. Herbin, and F. Jurie. 2021. Pseudo-labeling for class incremental learning. 32ndBritish Machine Vision
Conference Proceedings. British Machine Vision Association. Art. 332. 14 p. doi: 10.5244/C.35.363.
- Wang, Q., K. Xu, D. Feng, et al. 2025. Memory replay with unlabeled data for semi-supervised class-incremental learning via temporal consistency Front. Comput. Sci. - Chi. 19(12):1912370. 4 p. doi: 10.1007/s11704-025- 40828-0.
- Roy, S., M. Liu, Z. Zhong, N. Sebe, and E. Ricci. 2022. Class-incremental novel class discovery. Computer vision. Eds. S. Avidan, G. Brostow, M. Cisse, G. M. Farinella, and T. Hassner. Lecture notes in computer science. Springer. 13693:317-333. doi: 10.1007/978-3-031-19827-4-19.
- An,J., Z.Du, H.Zhang, and D.Wu. 2025. TSPT:Two-step prompt tuning for class-incremental novel class discovery. Knowl.-Based Syst. 319:113603. 10 p. doi: 10.1016/j. knosys.2025.113603.
- Besnard, Q., and N. Ragot. 2024. Continual learning for time series forecasting: A first survey. Engineering Proceedings 68(1):49. 10 p. doi: 10.3390/engproc2024068049.
- Qiao, Z., Q. Pham, Z. Cao, et al. 2024. Class-incremental learning for time series: Benchmark and evaluation. 30th ACMSIGKDD Conference on Knowledge Discovery and Data Mining Proceedings. New York, NY: ACM. 5613-5624. doi: 10.1145/3637528.3671581.
- Viroli, C., and G.J. McLachlan. 2019. Deep Gaussian mixture models. Stat. Comput. 29(1):43-51. doi: 10.1007/s11222-017-9793-z.
- Karniadakis, G. E., I. G. Kevrekidis, L. Lu, P. Perdikaris, S. Wang, and L. Yang. 2021. Physics-informed machine learning. Nature Reviews Physics 3(6):422-440. doi: 10.1038/s42254-021-00314-5.
- Gorshenin, A. K., and V. Yu. Kuzmin. 2020. Analiz konfiguratsiy LSTM-setey dlya postroeniya srednesrochnykh vektornykh prognozov [Analisys of configurations of LSTM networks for medium-term vector forecasting]. Informatika ieeprimeneniya - Inform. Appl. 14(1):10-16. doi: 10.14357/19922264200102. EDN: SZNTXE.
- Gorshenin, A. K., and V. Yu. Kuzmin. 2021. Metod povysheniya tochnosti neyrosetevykh prognozov s ispol'zovaniem smeshannykh veroyatnostnykh modeley i ego realizatsiya v vide tsifrovogo servisa [Method for improving accuracy of neural network forecasts based on probability mixture models and its implementation as a digital service]. Informatika i ee primeneniya - Inform. Appl. 15(3):63-74.doi: 10.14357/19922264210309. EDN: FDRKZX.
- Gorshenin, A. K., and V. Yu. Kuzmin. 2022. Statistical feature construction for forecasting accuracy increase and its applications in neural network based analysis. Mathematics 10(4):589.21 p. doi: 10.3390/math10040589. EDN: PQFGHU.
- Grusho, A. A., N.A. Grusho, M.I. Zabezhailo, V. O. Piskovski, and E. E. Timonina. 2025. Mashinnoe obuchenie i doverie k rezul'tatam klassifikatsii [Machine learning and trust in classification results]. Informatika i ee Primeneniya - Inform. Appl. 19(2):63-68. doi: 10.14357/ 19922264250208. EDN: CXRNNK.
- Gorshenin, A. K., S. A. Gorbunov, and D. Yu. Volkanov. 2023. O klasterizatsii ob"ektov setevoy vychislitel'noy infrastruktury na osnove analiza statisticheskikh anomaliy v trafike [Toward clustering of network computing infrastructure objects based on analisys of statistical anomalies in network traffic]. Informatika i ee primeneniya - Inform. Appl. 17(3):76-87. doi: 10.14357/19922264230311. EDN: XHTMVI.
- Dostovalova, A. M. 2024. Neyrosetevoe kvadroderevo i ego primenenie dlya segmentirovaniya sputnikovykh izobrazheniy [Neural quadtree and its applications for SAR imagery segmentation]. Informatika i ee primeneniya - Inform. Appl. 18(4):77-85. doi: 10.14357/19922264240410. EDN: LCGQQC.
- Grusho, A.A., N.A. Grusho, M.I. Zabezhailo, V. V. Kulchenkov, and E. E. Timonina. 2025. Klassifikatsiya malykh naborov dannykh bol'shoy razmernosti [Classification of small sets of data of large dimension]. Informatika i ee Primeneniya - Inform. Appl. 19(3):67-72. doi: 10.14357/19922264250308. EDN: SUSRRC.
- Hao, J., S. L. Phung, Y. Di, H. T. Le, and A. Bouzerdoum. 2023. Enhanced experience replay for class incremental continual learning. Conference (International) on Digital Image Computing: Techniques and Applications Proceedings. IEEE. 258-264. doi: 10.1109/DICTA60407.2023.00043.
- Chen, T, S. Kornblith, M. Norouzi, and G. Hinton. 2020. A simple framework for contrastive learning of visual representations. Machine learning. Eds. H. Daume and A. Singh. Proceedings of machine learning research ser. PMLR. 149:1597-1607. doi: 10.5555/3524938.3525087.
- Gorshenin, A. K., and A. M. Dostovalova. 2025. Small sample classification and regression for time series and tabular data based on deep Gaussian mixture models. Pattern Recognition Image Analysis 35(2):83-93. doi: 10.1134/S1054661825700014. EDN: AUJMFC.
- Bergstra, J., and Y. Bengio. 2012. Random search for hyper-parameter optimization. J. Mach. Learn. Res. 13(10):281-305.
- Hakim, A., I. Zubak, C. Marx, et al. 2025. Feasibility of using Gramian angular field for preprocessing MR spectroscopy data in AI classification tasks: Differentiating glioblastoma from lymphoma. Eur. J. Radiol. 184:111957. 8p. doi: 10.1016/j.ejrad.2025.111957.
- Toner, W, T. L. Lee, A. Joosen, R. Singh, and M. Asenov. 2025. Performance of zero-shot time series foundation models on cloud data. Cornell University. 12 p. Available at: https://arxiv.org/pdf/2502.12944 (accessed August 10, 2026).
- Tan, M., M.A. Merrill, V. Gupta, T. Althoff, and T. Hartvigsen. 2024. Are language models actually useful for time series forecasting? 38th Annual Conference on Neural Information Processing Systems Proceedings. Curran Associates Inc. 37:60162-60191. doi: 10.5555/3737916. 3739838.
[+] About this article
Title
SELF-SUPERVISED INCREMENTAL CLASS DISCOVERY VIA PROBABILITY-INFORMED CONTINUAL LEARNING
Journal
Informatics and Applications
2026, Volume 20, Issue 3, pp 77-86
Cover Date
2026-30-09
DOI
10.14357/19922264260307
Print ISSN
1992-2264
Publisher
Institute of Informatics Problems, Russian Academy of Sciences
Additional Links
Key words
incremental learning; probability informing; new classes discovery; unlabeled data; deep Gaussian mixture models
Authors
A. M. Dostovalova  and A. K. Gorshenin
Author Affiliations
 Federal Research Center "Computer Science and Control" of the Russian Academy of Sciences, 44-2 Vavilov Str., Moscow 119333, Russian Federation
|