Latency aware foveated rendering in unreal engine 4
Swafford, N. T., Cosker, D., & Mitchell, K. (2015)
Latency aware foveated rendering in unreal engine 4. In CVMP '15 Proceedings of the 12th European Conference on Visual Media Productionhttps://doi.org/10.1145/2824840.2824863
We contribute a foveated rendering implementation in Unreal Engine 4 (UE4) and a straight-forward metric to allow calculation of rendered foveal region sizes to compensate for...
Augmented creativity: bridging the real and virtual worlds to enhance creative play
Zünd, F., Ryffel, M., Magnenat, S., Marra, A., Nitti, M., Kapadia, M., …Sumner, R. W. (2015)
Augmented creativity: bridging the real and virtual worlds to enhance creative play. In SA '15 SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applicationshttps://doi.org/10.1145/2818427.2818460
Augmented Reality (AR) holds unique and promising potential to bridge between real-world activities and digital experiences, allowing users to engage their imagination and boo...
Deep Precomputed Radiance Transfer for Deformable Objects
Li, Y., Wiedemann, P., & Mitchell, K. (2019)
Deep Precomputed Radiance Transfer for Deformable Objects. Proceedings of the ACM on Computer Graphics and Interactive Techniques, 2(1), 1-16. https://doi.org/10.1145/3320284
We propose, DeepPRT, a deep convolutional neural network to compactly encapsulate the radiance transfer of a freely deformable object for rasterization in real-time.
Enhanced Shadow Retargeting with Light-Source Estimation Using Flat Fresnel Lenses
Casas, L., Fauconneau, M., Kosek, M., Mclister, K., & Mitchell, K. (2019)
Enhanced Shadow Retargeting with Light-Source Estimation Using Flat Fresnel Lenses. Computers, 8(2), https://doi.org/10.3390/computers8020029
Shadow-retargeting maps depict the appearance of real shadows to virtual shadows given corresponding deformation of scene geometry, such that appearance is seamlessly maintain...
L3V: A Layered Video Format for 3D Display
Mitchell, K., Sinclair, D., Kosek, M., & Swaford, N. (2014)
L3V: A Layered Video Format for 3D Display
We present a layered video format for 3D interactive display which adapts and exploits well-developed 2D codecs with layer centric packing for real-time user perspective playb...
Multi-reality games: an experience across the entire reality-virtuality continuum
Casas, L., Ciccone, L., Çimen, G., Wiedemann, P., Fauconneau, M., Sumner, R. W., & Mitchell, K. (2018)
Multi-reality games: an experience across the entire reality-virtuality continuum. In Proceedings of the VRCAI2018https://doi.org/10.1145/3284398.3284411
Interactive play can take very different forms, from playing with physical board games to fully digital video games. In recent years, new video game paradigms were introduced ...
GPU-accelerated depth codec for real-time, high-quality light field reconstruction
Koniaris, B., Kosek, M., Sinclair, D., & Mitchell, K. (2018)
GPU-accelerated depth codec for real-time, high-quality light field reconstruction. Proceedings of the ACM on Computer Graphics and Interactive Techniques, 1(1), 1-15. https://doi.org/10.1145/3203193
Pre-calculated depth information is essential for efficient light field video rendering, due to the prohibitive cost of depth estimation from color when real-time performance ...
Empowerment and embodiment for collaborative mixed reality systems: Empowerment and Embodiment
Pan, Y., Sinclair, D., & Mitchell, K. (2018)
Empowerment and embodiment for collaborative mixed reality systems: Empowerment and Embodiment. Computer Animation and Virtual Worlds, 29(3-4), https://doi.org/10.1002/cav.1838
We present several mixed‐reality‐based remote collaboration settings by using consumer head‐mounted displays. We investigated how two people are able to work together in these...
From Faces to Outdoor Light Probes
Calian, D. A., Lalonde, J., Gotardo, P., Simon, T., Matthews, I., & Mitchell, K. (2018)
From Faces to Outdoor Light Probes. Computer Graphics Forum, 37(2), 51-61. doi:10.1111/cgf.13341
Image‐based lighting has allowed the creation of photo‐realistic computer‐generated content. However, it requires the accurate capture of the illumination conditions, a task n...
Compressed Animated Light Fields with Real-time View-dependent Reconstruction
Koniaris, C., Kosek, M., Sinclair, D., & Mitchell, K. (2019)
Compressed Animated Light Fields with Real-time View-dependent Reconstruction. IEEE Transactions on Visualization and Computer Graphics, 25(4), 1666-1680. https://doi.org/10.1109/tvcg.2018.2818156
We propose an end-to-end solution for presenting movie quality animated graphics to the user while still allowing the sense of presence afforded by free viewpoint head motion....