Please use this identifier to cite or link to this item: https://bura.brunel.ac.uk/handle/2438/34198
Title: Addressing Data Scarcity and Class Imbalance Using Active Learning and Synthetic Data Generation: Experimentation on Clinical Datasets
Authors: Bottino, Lorella
Zucco, Chiara
Tucker, Allan
Cannataro, Mario
Keywords: machine learning;active learning;synthetic data generation;data scarcity;class imbalance;uncertainty sampling;data sampling;data labeling
Issue Date: 13-Nov-2026
Publisher: MDPI
Citation: Bottino, L. et al. (2026) 'Addressing Data Scarcity and Class Imbalance Using Active Learning and Synthetic Data Generation: Experimentation on Clinical Datasets', AI, 7(11), pp. 1–31. doi: 10.3390/ai7110485.
Abstract: The rapid advancement of Machine Learning (ML) technologies has revolutionized healthcare, particularly in the domains of disease prediction and diagnosis. Nevertheless, some data-related issues, such as annotated data scarcity, low-quality labels, and class imbalance in the dataset, can compromise the effectiveness of the learning process. This paper first gives an overview of Active Learning (AL), which is a strategy in machine learning that helps models to achieve better performance using fewer labeled examples. It then reviews various strategies for addressing dataset imbalance, in particular focusing on data-level rebalancing approaches. The paper provides a review of existing works on active learning in the presence of class imbalance and on the integration of active learning with synthetic oversampling techniques. The central core of the paper is the implementation of four different strategies for data selection from publicly available clinical datasets: Random, Random + SMOTE, Uncertainty, and Uncertainty + SMOTE. We calculated and plotted balanced accuracy and average precision by iterating over 20 different seed values, using cumulative batches of labeled data, for each combination of dataset and classifier. Moreover we also carried out a statistical test to assess the extent to which the difference between the Random and Uncertainty distributions, and that between the Uncertainty and Uncertainty + SMOTE distributions, was statistically significant. Experiments show that uncertainty-based strategy can improve predictive performance compared with random acquisition, particularly with Random Forest, although the observed benefits vary across datasets, classifiers, performance metrics, and annotation budgets. The additional contribution of SMOTE is also context dependent and does not yield statistically significant improvements over uncertainty-based acquisition alone. For the WBCD dataset, it can be seen that Uncertainty + SMOTE is comparable to, or in some cases below, the uncertainty-only strategy. Metrics such as precision, recall, specificity, F1-score, AUROC and AUPRC are evaluated and provided.
Description: Data Availability Statement: The datasets used in this article are publicly available in the UCI repository and they can be downloaded here: HFCR dataset, available at https://doi.org/10.24432/C5Z89R; WBCD dataset, available at https://doi.org/10.24432/C5DW2B. Moreover, the synthetic datasets used in this article have been generated using Synthetic Minority Over-sampling Technique (SMOTE), implemented through the imbalanced-learn Python library, available at https://imbalanced-learn.org/stable/ (accessed on 5 November 2026). The synthetic dataset presented in this study is available upon request from the corresponding author.
URI: https://bura.brunel.ac.uk/handle/2438/34198
DOI: https://doi.org/10.3390/ai7110485
Appears in Collections:Department of Computer Science Research Papers

Files in This Item:
File Description SizeFormat 
FullText.pdfCopyright © 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.6.61 MBAdobe PDFView/Open


This item is licensed under a Creative Commons License Creative Commons