OpenAI Sora is a revolutionary text-to-video AI model that is a significant advance for artificial intelligence and real-world applications. It is capable of generating up to one-minute-long videos from textual prompts, maintaining exceptional visual quality. Sora utilizes a diffusion model to evolve videos from static noise into coherent visual narratives, setting a new standard in AI technology.
OpenAI also revealed research for video generation models as world simulators. They explore large-scale training of generative models on video data. Specifically, they train text-conditional diffusion models jointly on videos and images of variable durations, resolutions and aspect ratios. They leverage a transformer architecture that operates on spacetime patches of video and image latent codes. The largest model, Sora, is capable of generating a minute of high fidelity video. The results suggest that scaling video generation models is a promising path towards building general purpose simulators of the physical world.
Hyperrealistic Video can be used to generate hyper-useful AI training data. This goes in line with the scaling of training compute by 100 times every year. By 2025, this OpenAI video generation could scale to many hours. By 2026, weeks of video could be generated every hour. The generation of training data could become many multiple of real-time.
This is the “holy shit” moment of AI 🤯
OpenAI just launched Sora, an AI that can create hyperrealistic videos from just text prompts.
It’ll be nearly impossible to tell the difference between AI and real in 2024.
(THREAD 🧵) 1/13 pic.twitter.com/QMlg2j2wXC
— Barsee 🐶 (@heyBarsee) February 16, 2024
3/ The model can create a video from text or turn a photo into a video, making the image’s details move realistically. pic.twitter.com/WBamUG572s
— Barsee 🐶 (@heyBarsee) February 16, 2024
Brian Wang is a Futurist Thought Leader and a popular Science blogger with 1 million readers per month. His blog Nextbigfuture.com is ranked #1 Science News Blog. It covers many disruptive technology and trends including Space, Robotics, Artificial Intelligence, Medicine, Anti-aging Biotechnology, and Nanotechnology.
Known for identifying cutting edge technologies, he is currently a Co-Founder of a startup and fundraiser for high potential early-stage companies. He is the Head of Research for Allocations for deep technology investments and an Angel Investor at Space Angels.
A frequent speaker at corporations, he has been a TEDx speaker, a Singularity University speaker and guest at numerous interviews for radio and podcasts. He is open to public speaking and advising engagements.