Research Output
HoloJig: Interactive Spoken Prompt Specified Generative AI Environments
  HoloJig offers an interactive, speech-to-VR, virtual reality experience that generates diverse environments in real-time based on live spoken descriptions. Unlike traditional VR systems that rely on pre-built assets, HoloJig dynamically creates personalized and immersive virtual spaces with depth-based parallax 3D rendering, allowing users to define the characteristics of their immersive environment through verbal prompts. This generative approach opens up new possibilities for interactive experiences, including simulations, training, collaborative workspaces, and entertainment. In addition to speech-to-VR environment generation, a key innovation of HoloJig is its progressive visual transition mechanism, which smoothly dissolves between previously generated and newly requested environments, mitigating the delay caused by neural computations. This feature ensures a seamless and continuous user experience, even as new scenes are being rendered on remote servers.

  • Date:

    21 March 2025

  • Publication Status:

    Early Online

  • Publisher

    Institute of Electrical and Electronics Engineers (IEEE)

  • DOI:

    10.1109/mcg.2025.3553780

  • ISSN:

    0272-1716

  • Funders:

    European Commission

Citation

Casas, L., Hannah, S., & Mitchell, K. (online). HoloJig: Interactive Spoken Prompt Specified Generative AI Environments. IEEE Computer Graphics and Applications, https://doi.org/10.1109/mcg.2025.3553780

Authors

Keywords

Generative AI, Virtual environments, Rendering (computer graphics), Real-time systems, Visualization, Training, Speech to text, Artificial intelligence, Three-dimensional displays, Special issues and sections

Monthly Views:

Available Documents