GMM based single depth image super-resolution

Abstract

Super-resolution (SR) is a technique to improve the resolution of an image from a sequence of input images or from a single image. As SR is an ill-posed inverse problem, it leads to many suboptimal solutions. Since modern depth cameras suffer from low-spatial resolution and are noisy, we present a Gaussian mixture model (GMM) based method for depth image super-resolution (SR). We train GMM from a set of high-resolution and low-resolution (HR-LR) synthetic training depth images to learn the relation between the HR and the LR patches in the form of covariance matrices. We use expectation-maximization (EM) algorithm to converge to an optimal solution. We show the promising results qualitatively and quantitatively in comparison to other depth image SR methods. © Springer Nature Singapore Pte Ltd. 2018.