The rise of AI-generated pixels and videos

Feb marked a pivotal moment in the video content industry with the launch of OpenAI's Sora, a forerunner in text-to-video AI tools. Sora not only showcased its capabilities through impressive demos, including a glimpse into futuristic TedTalks.

Hot on its heels, Google unveiled Veo, a video model capable of creating clips up to 60 seconds in length. However, like Sora, Veo remains out of public reach for now.

Last week, the space grew even more competitive with the introduction of two new video generators.

1. Kling, a Chinese counterpart to Sora, entered the scene, albeit with access currently restricted to China.

2. Dream Machine, from Luma AI, which produces 5-second clips from text and/or images. What sets Dream Machine apart is its accessibility—anyone can experiment with creating up to 30 free videos on their website despite anticipated high demand.

The integration of generative AI into Hollywood is transforming traditional production pipelines. These AI tools are enhancing scriptwriting, visual effects, content localisation, sound editing, and much more. For instance, AI's role in de-ageing actors will be showcased in Robert Zemeckis’ upcoming Miramax movie Here, where synthetic media creator Metaphysic will transform Tom Hanks and Robin Wright into younger versions of themselves, using the company’s new Metaphysic Live product, which performs real-time hyperreal face alterations like de-ageing and removes the need to do post-production VFX editing to achieve those effects.

Tech from ElevenLabs and Deepdub are transforming script translations and dubbing, dropping the cost of content localisation. AI-generated animations and storyboards are crucial in pre-visualisation, helping to plan complex scenes more efficiently.

Why this matters: The rapid advancement of AI video generators like Sora, Veo, Kling, and Dream Machine is a gateway to democratising video production, offering tools previously accessible only to professionals with significant resources. This shift drops the cost of producing 4k/8K and 360 degree videos and can potentially unleash a new wave of creativity and innovation across global media, where AI-generated pixels could dominate.

You can already see glimpses of the thrilling potential of these tools by exploring the winners of Runway’s 2nd annual Film Festival.

As AI continues to evolve, its impact on the creative industries promises to be profound, reshaping how we conceive, produce, and consume media. Look to the Monthly Customer Tech Trends newsletter for more updates in this dynamic field.