Stability AI has just rolled out an exciting new AI model called the Stable Virtual Camera. It’s designed to take your 2D images and transform them into immersive 3D videos. This tool taps into virtual camera technology, which you might know from digital filmmaking and 3D animation, to bring a new level of realism and customization to your projects.
According to Stability’s latest blog post, the Stable Virtual Camera can create new perspectives from up to 32 images, letting you pick specific camera angles. Imagine being able to generate dynamic video paths like ‘Spiral,’ ‘Dolly Zoom,’ ‘Move,’ and ‘Pan.’ Right now, it’s available as a research preview, and you can create videos in square, portrait, and landscape formats, offering up to 1,000 frames. However, it’s worth noting that the model might struggle a bit with complex scenes or dynamic textures, such as water, which could lead to flickering artifacts. These issues are more likely when the target viewpoints are quite different from the input images.
The Stable Virtual Camera is accessible for research under a non-commercial license, and you can download it from Hugging Face. Even though Stability AI has faced some financial bumps in the road, known for their Stable Diffusion image generator, they’ve secured new funding with support from big names like Eric Schmidt and Sean Parker. The company has also seen some leadership changes, with a new CEO and the addition of James Cameron to its board. Plus, Stability has teamed up with Arm to develop an AI model for generating audio on devices powered by Arm chips.
