What makes a video memorable?

Abstract

Humans are exposed to many pictures and videos on a daily basis, but they have this exceptional ability to remember the details, even though many of them look very similar. This Video Memorability (VM) is mainly due to distinguishable and a fine representation of the frames in human mind that people tend to remember. Videos have an abundance data contained in the frames which can be used for feature extraction purposes. Each feature from each frame has to be carefully considered to determine the intrinsic property of the video i.e. memorability. Using Convolutional Neural Network (CNN), we propose a solution to the problem of predicting VM, by estimating its memorability. A model has been developed to predict VM using algorithmically extracted features. Two types of features (i) semantic features (ii) visual features have been considered. The effectiveness of the model has been tested using publicly available image and video data. The results confirm that the CNN model can predict memorability with a acceptable performance. © 2017 IEEE.