Hada, A.S.Sahoo, G.S.Vamsi, C.K.Hegde, A.Bhowmik, B.2026-02-062024COSMIC 2024 - IEEE International Conference on Computing, Semiconductor, Mechatronics, Intelligent Systems and Communications, Proceedings, 2024, Vol., , p. 195-199https://doi.org/10.1109/COSMIC63293.2024.10871408https://idr.nitk.ac.in/handle/123456789/28771The exponential growth of big data presents both immense opportunities and significant challenges. While vast datasets hold the key to unlocking groundbreaking insights, efficiently extracting value requires sophisticated feature selection techniques. Traditional methods often struggle with the sheer volume and complexity of big data. This paper addresses this challenge by proposing a novel hybrid feature selection algorithm by leveraging Apache PySpark's distributed computing power. Combining a robust feature selection technique with a novel weighting scheme, our method outperforms existing hypercuboid and fuzzy Rough Set methods. The hybrid approach achieves superior accuracy of 72.1% with a reduced feature set, demonstrating its effectiveness in identifying salient features for big data analysis. © 2024 IEEE.Apache PySparkBig DataFuzzy Rough SetHybrid Feature SelectionHypercuboid Method