Exploratory Analysis of Methods, Techniques, and Metrics to Handle Class Imbalance Problem

Abstract

Class imbalance a common challenge in machine learning, often results in skewed predictions and misrepresentative model assessments, highlighting the need for effective countermeasures. Our detailed survey dives into three primary techniques for addressing this issue: data-level interventions, algorithmic modifications, and integrated hybrid solutions. We thoroughly dissect each approach, delineating its merits, drawbacks, and ideal use cases. Data-level methods aim to restructure the dataset for class balance, while algorithmic techniques recalibrate the learning process to better detect the minority class. The hybrid strategies merge the benefits of both for a holistic remedy. The study further emphasizes the importance of precise evaluation metrics, elaborating on both conventional metrics and those tailored for imbalanced scenarios. Our objective is to arm professionals with a deep insight into tackling class imbalance, especially within the big data framework. The insights shared aspire to inspire the creation of resilient, equitable machine learning models adapt at navigating imbalanced data, ensuring enhanced prediction fidelity and consistency. © 2024 Elsevier B.V.. All rights reserved.