Leave Video Editing Behind with NVIDIA’s Revolutionary Text-to-Video AI

NVIDIA text-to-video

ChatGPT and Midjourney are now making news not only in the tech media but also in other areas. This might change soon since the next big AI tech is on the way. NVIDIA has demoed a new tech that might soon elevate your GIFs to new heights.

NVIDIA text-to-video

Use NVIDIA’s Text-To-Video Tech To Create Videos

Not long ago, NVIDIA unleashed an interesting product dubbed VideoLDM. That’s an AI model for text-to-video conversion. By the way, NVIDIA has created this tech by joining hands with Cornell University researchers. In simple terms, this AI model can generate videos with a resolution of up to 2048 x 1280 pixels, a frame rate of 24 frames per second, and a runtime of up to 4.7 seconds based on text.

Gizchina News of the week

The model uses advances in stable diffusion neural networks. The NVIDIA solution has up to 4.1 billion parameters. But only 2.7 billion were trained using video. Though you might think this is a huge number, it is small by today’s AI standards.

Also, the model can capture videos with driving scenes. They can last up to 5 minutes and have a 1024 x 512 pixels resolution. This is because driving sequences are tough to shoot in real life. As a result, when it comes to such moments, this technology can assist film makers. The model can forecast multimodal motion possibilities by creating a large number of possible missions from a single source image.

At the moment, text-to-video techs such as the one introduced by NVIDIA are good to use for creating thumbnails and GIFs. But we know that NVIDIA is growing fast in the AI field. So we guess it won’t take long for NVIDIA to bring more advanced techs for creating longer text-to-video clips.

This study will be presented at the Machine Vision and Pattern Recognition Conference, which will be held in Vancouver from June 18 to 22.

Disclaimer: We may be compensated by some of the companies whose products we talk about, but our articles and reviews are always our honest opinions. For more details, you can check out our editorial guidelines and learn about how we use affiliate links.

Source/VIA :
Previous Apple iOS 17 will revolutionize physical and mental health tracking
Next Court Orders Facebook to Pay $725 Million to All Users for Leaking Their Personal Data, This is How You Can Claim Your Share