Articles worth reading
Apple Releases watchOS 4.0.1 with fix for Connectivity Bug on Apple Watch Series 3

Apple Releases watchOS 4.0.1 with fix for Connectivity Bug on Apple Watch Series 3

access_time October 9, 2017

Apple bring fix for LTE/Wi-Fi connectivity bug on the latest Apple Watch Series 3 The latest Apple Watch Series 3

LG’s Rollup TV Could be out as Soon as Next Year

LG’s Rollup TV Could be out as Soon as Next Year

access_time January 16, 2018

TV’s Which Can Rollup When Not In Use Will Become the Thing Of Tomorrow This year’s CES has brought some

Are You In A Social Media Online Echo Chamber? How To Take An Objective Look

Are You In A Social Media Online Echo Chamber? How To Take An Objective Look

access_time April 19, 2018

In the New Age of Social Media do we find ourselves in an Online Echo Chamber? The debate begins. Do

Blog

AI Algorithms are Doing Video Generation from Text

AI Algorithms are Doing Video Generation from Text

access_time March 8, 2018 chat_bubble_outline 0 comments remove_red_eye 1770 views

AI being used to video generation from text

Artificial Intelligence is getting bigger and bigger with each passing month as more number of areas is being opened to broaden its reach and effectiveness. AI is already powering a number of consumer electronics device ranging from the smartphones, computers to IoT devices. Now we will get the video generation from text with the help of the AI at the core.

Generating new videos consistently with the emerging trends is quite a demanding task for the creators. Therefore scientists had started making use of the artificial intelligence for the video generation from text itself wherein it works towards creating generative video.

With this new found research scientists will be able to type out a simple phrase and artificial intelligence will work towards creating a video of that particular scene by carefully analyzing the text.

AI can do video generation from text

The lead scientist who has made video generation from text possible using the artificial intelligence is from the Duke and Princeton University. Scientists had explained that the task of video creation is directly related to the video prediction ability.

In this research scientist has forwarded this task of the predicting what actions should be the part of the video to the artificial intelligence rather than the human mind.

It should be noted that the visual representation happens to showcase a wide range of the human emotion as well as actions than the still pictures and herein AI has been perfected to identify the correct type of the things from the videos.

Teaching and training the AI

In order to train the artificial in successfully performing video generation from text scientist had used a wider range of easily understandable and defined activities to cut out a video.

The activities in which AI was trained to identify included ‘jogging’, ‘riding a bike’, ‘kite surfing’, ‘playing football’, ‘swimming’ etc.

In the later stages the AI carefully studies the clips and learns to identify the varied human emotion from the exiting videos. AI was able to identify millions of emotion with few weeks of training. Once the dataset has been created by the researchers from their SI training exercise they started the two-step process which allows it to stitch together a generative video based on the text.

In the first step AI works toward creating a wide range of gist of the video which is specifically based on the input text. In this step the gist happens to be an image which lends the background colour and even the object layout is created here.

In the second step which is named “discriminator” specifically allows AI to identify the right set of gists to use for creating the video based on the user text-input. If the text input asks “riding on a bike” then all the gists made in the first step will works towards video generation from text showing a person riding a bike. The resulting image from the gists is good enough to pass as a commendable video for the moment but scientists are actively working towards enhancing its core abilities.

folder_openAssigned tags
content_copyCategorized under

No Comments

comment No comments yet

You can be first to leave a comment

Submit an answer

info_outline

Your data will be safe!

Your e-mail address will not be published. Also other data will not be shared with third person.

This site uses Akismet to reduce spam. Learn how your comment data is processed.