GPU-accelerated depth codec for real-time, high-quality light field reconstruction

Research Output

Pre-calculated depth information is essential for efficient light field video rendering, due to the prohibitive cost of depth estimation from color when real-time performance is desired. Standard state-of-the-art video codecs fail to satisfy such performance requirements when the amount of data to be decoded becomes too large. In this paper, we propose a depth image and video codec based on block compression, that exploits typical characteristics of depth streams, drawing inspiration from S3TC texture compression and geometric wavelets. Our codec offers very fast hardware-accelerated decoding that also allows partial extraction for view-dependent decoding. We demonstrate the effectiveness of our codec in a number of multi-view 360-degree video datasets, with quantitative analysis of storage cost, reconstruction quality, and decoding performance.

Type:

Article
Date:

25 July 2018
Publication Status:

Published
Publisher

Association for Computing Machinery (ACM)
DOI:

10.1145/3203193
ISSN:

2577-6193
Library of Congress:

QA76 Computer software
Dewey Decimal Classification:

006.6 Computer graphics
Funders:

Innovate UK

http://researchrepository.napier.ac.uk/output/1413540 Koniaris, B., Kosek, M., Sinclair, D., & Mitchell, K. (2018). GPU-accelerated depth codec for real-time, high-quality light field reconstruction. Proceedings of the ACM on Computer Graphics and Interactive Techniques, 1(1), 1-15. https://doi.org/10.1145/3203193

Citation

Koniaris, B., Kosek, M., Sinclair, D., & Mitchell, K. (2018). GPU-accelerated depth codec for real-time, high-quality light field reconstruction. Proceedings of the ACM on Computer Graphics and Interactive Techniques, 1(1), 1-15. https://doi.org/10.1145/3203193