Enhancing Movie Recommendation Systems with MapReduce Genetic Algorithms: Addressing Scalability and Accuracy Challenges

Abstract

In the world of big data, the efficacy of movie recommendation systems is crucial for personalizing user experiences in digital entertainment. Traditional methods, including collaborative and content-based filtering, often encounter limitations such as data sparsity, cold start problems, and scalability issues. This paper introduces a novel approach that integrates MapReduce technology with Genetic Algorithms (GAs) to address these chal-lenges. Utilizing the Hadoop framework, our MapReduce Genetic Algorithm (MRGA) efficiently processes extensive datasets by distributing tasks across a cluster of machines. The genetic algorithm component optimizes recommendation accuracy through advanced techniques like selection, crossover, and mutation. Our experimental results, based on the MovieLens 100K dataset, demonstrate that the MRGA approach outperforms traditional collaborative filtering methods in terms of recommendation accuracy and scalability. By leveraging MapReduce's distributed computing power and the GA's optimization capabilities, this research offers a robust solution to improve movie recommendations and handle large-scale data efficiently. © 2024 IEEE.