MyWorld Challenge Call: Exploring Generative AI Tools for VFX
As a Bristol-based VFX studio and partner of the MyWorld initiative, we’re proud to announce that we’ve been selected as one of nine companies to participate in MyWorld's challenge call, ‘Catalysts & Connectors: Tools for the Creative Industries’. The project builds on the creative strengths of the West of England, exploring the future of creative technology innovation by pioneering new ideas, products, and processes.
The 16-week programme will be supported by fellow MyWorld partner Digital Catapult, with the help of NVIDIA. The programme helps companies in the creative industries develop innovative new tools to assist in the creation of exciting experiences.
Generative AI tools for VFX
Our research and contribution to the programme focuses on utilising generative AI tools for VFX asset production, specifically in the creation of maps used in various applications within the field. So far, 2D image generation tools have mainly been employed to create artistic or photographic imagery, we’re keen to explore their potential for VFX asset creation.
In VFX, “maps" are essential for representing different aspects of scenes, objects, or effects — defining surface details, creating 3D geometry, generating procedural effects, and simulating particles.
Our deliverables
To harness the power of generative AI, we’re developing a toolkit of text-to-image processes that can generate maps applicable to diverse VFX applications. We are currently exploring these three areas:
Generative AI for 3D Terrain Generation: Our goal is to create 2D “height maps" using generative AI that can be used to help create 3D landscapes such as alien planets and ancient Earth settings. While other techniques for terrain generation exist, this novel approach offers an alternative workflow and leverages some of the exciting new tools and processes in the field. We are addressing challenges related to generating detailed and realistic landscapes while maintaining control over the process.
Generative AI for Abstract VFX: As a VFX company, we often visualise complex and abstract concepts, such as quantum interactions or the interior of black holes. We employ various tools and techniques to achieve visually captivating results. We are now investigating how generative AI can produce animated sequences that serve as maps to drive sophisticated visual effects, creating a unique and engaging look. Our challenge is to integrate the distinctive AI visual style while adhering to our high standards and avoiding an excessively AI-driven feel.
Generative AI for Parallax Occlusion Maps: Parallax occlusion maps are often used to create the illusion of interior space within 3D modelled buildings, enhancing realism. This means that as we move past the windows of a building our perspective on the interior space changes, just as in real life, but without the need for modelling that interior space. We’re investigating how generative AI can be used to help us create those maps, allowing us to quickly add realistic and unique interiors inside hundreds of windows without sacrificing creative control .
Throughout our research, we prioritise the responsible adoption of generative AI, considering potential legal and ethical implications. We are committed to addressing important questions and sharing our insights and findings as we progress in this programme.
Read more about our work with MyWorld here.
Alternatively, contact us to discuss how we’re working with generative AI tools for VFX.