8th Wall Blog
Using Generative AI to create WebAR content
From DALL·E 2 to D-ID AI, generative AI solutions can help accelerate your WebAR content development with 8th Wall
.png){kind=avatar}
Generative AI is changing the way we create content including WebAR content. AI software tools, such as DALL·E 2, Midjourney, BariumAI and D-ID AI, can be used as part of your creative workflows. Generative AI can be used to quickly generate ideas, texture 3D models and provide a rapid way to create assets that can be used in your WebAR experience. The real magic happens when you combine AI software with AR.
Over the past couple of months, our very own Ian Curtis has been experimenting using AI software as part of 8th Wall WebAR development. Here are a couple of experiments we hope will inspire you to use generative AI in your next WebAR project.
This holographic cyborg project used DALL·E 2 as a tool to help with the development of a real-time web-based augmented reality experience. All of the textures in this WebAR experience were created using DALL·E including the holographic cyborg face. The face was then animated using D-ID AI, an AI technology that brings portrait photos to life. The WebAR content was anchored to a real-world location using Lightship VPS for Web which transforms everyday locations into experiential destinations with unprecedented accuracy and precision. Users accessed and engaged with the entire experience in their smartphone browser.
This parallax-inspired robot WebAR experience used real-time reflections, baked physics simulations and 8th Wall’s Image Target technology to make the robot feel like it was inside the smartphone. Some textures on the 3D models in the scene were AI generated from BariumAI. The robot also used a video material that made use of additive blending for the glow effect. The wallpaper on the smartphone is an image target that, when scanned, comes to life to reveal the robot inside the phone. The robot was then animated to make it look like it can walk out from the smartphone onto a nearby surface.
Finally, this perspective puzzle asks the user to position their camera to provide the right perspective to reveal the image of a flying ship. AI was used to generate the image on the falling blocks which emerge from a portal. All of the textures in this WebAR experience were created from DALL·E. The experience was brought to life using 8th Wall’s World Effects technology along with real-time reflections and baked physics simulations to create a truly immersive browser-based AR experience.
You can try this experience out by visiting this link on your phone.
We can’t wait to see what you create with AI and WebAR!