Articles worth reading
What Google Pixel 2 Must Do to Compete With Apple iPhone X

What Google Pixel 2 Must Do to Compete With Apple iPhone X

access_time September 30, 2017

What Google Pixel 2 needs to overcome the iPhone X Apple has already presented what will be its best phone

Facebook, Google and Start Ups Oppose Net Neutrality U-Turn

Facebook, Google and Start Ups Oppose Net Neutrality U-Turn

access_time November 25, 2017

How a Repeal Against Net Neutrality Can Affect You? Have you ever wondered what would happen if you were charged

The Latest on VR and Augmented Reality at Google I/O

The Latest on VR and Augmented Reality at Google I/O

access_time May 17, 2017

Augmented reality adds more virtual information to real scenarios and is already applied in fields such as leisure, medicine or


AI Algorithms are Doing Video Generation from Text

AI Algorithms are Doing Video Generation from Text

access_time March 8, 2018 chat_bubble_outline 0 comments remove_red_eye 516 views

AI being used to video generation from text

Artificial Intelligence is getting bigger and bigger with each passing month as more number of areas is being opened to broaden its reach and effectiveness. AI is already powering a number of consumer electronics device ranging from the smartphones, computers to IoT devices. Now we will get the video generation from text with the help of the AI at the core.

Generating new videos consistently with the emerging trends is quite a demanding task for the creators. Therefore scientists had started making use of the artificial intelligence for the video generation from text itself wherein it works towards creating generative video.

With this new found research scientists will be able to type out a simple phrase and artificial intelligence will work towards creating a video of that particular scene by carefully analyzing the text.

AI can do video generation from text

The lead scientist who has made video generation from text possible using the artificial intelligence is from the Duke and Princeton University. Scientists had explained that the task of video creation is directly related to the video prediction ability.

In this research scientist has forwarded this task of the predicting what actions should be the part of the video to the artificial intelligence rather than the human mind.

It should be noted that the visual representation happens to showcase a wide range of the human emotion as well as actions than the still pictures and herein AI has been perfected to identify the correct type of the things from the videos.

Teaching and training the AI

In order to train the artificial in successfully performing video generation from text scientist had used a wider range of easily understandable and defined activities to cut out a video.

The activities in which AI was trained to identify included ‘jogging’, ‘riding a bike’, ‘kite surfing’, ‘playing football’, ‘swimming’ etc.

In the later stages the AI carefully studies the clips and learns to identify the varied human emotion from the exiting videos. AI was able to identify millions of emotion with few weeks of training. Once the dataset has been created by the researchers from their SI training exercise they started the two-step process which allows it to stitch together a generative video based on the text.

In the first step AI works toward creating a wide range of gist of the video which is specifically based on the input text. In this step the gist happens to be an image which lends the background colour and even the object layout is created here.

In the second step which is named “discriminator” specifically allows AI to identify the right set of gists to use for creating the video based on the user text-input. If the text input asks “riding on a bike” then all the gists made in the first step will works towards video generation from text showing a person riding a bike. The resulting image from the gists is good enough to pass as a commendable video for the moment but scientists are actively working towards enhancing its core abilities.

folder_openAssigned tags
content_copyCategorized under

No Comments

comment No comments yet

You can be first to leave a comment

Submit an answer


Your data will be safe!

Your e-mail address will not be published. Also other data will not be shared with third person.