Outlier Detection in Streaming Data Using Deep Learning Models

Abstract

In the realm of the Internet of Things (IoT), devices continuously generate a vast and relentless stream of data, providing a real-time representation of digital landscape. The continuous and high-velocity nature of this streaming data poses significant challenges for real-time analysis. Accurate outlier detection within this data is essential, as such anomalies may indicate critical issues, attacks, or errors. Nevertheless, the dynamic and rapidly evolving characteristics of streaming data render traditional outlier detection methods inadequate. This paper investigates the application of Artificial Neural Networks (ANNs), specifically a Multi-Layer Perceptron (MLP), for outlier detection in streaming IoT data. The selection of the MLP from a range of Deep Neural Networks (DNNs) is based on its optimal balance between computational efficiency and model complexity. The model's efficacy is confirmed through rigorous experimentation, demonstrating strong performance across diverse scenarios and data classes. The MLP achieved an accuracy of 99.4%, underscoring its ability to detect even minor deviations from expected patterns. This high level of accuracy establishes the MLP as a robust tool for outlier detection in dynamic IoT environments. © 2024 IEEE.