Articles worth reading
Gyroscope Molecules Form Crystal Both Solid and Full of Motion

Gyroscope Molecules Form Crystal Both Solid and Full of Motion

access_time January 15, 2018

UCLA researchers formed new crystal with both mobile and static features A crystal is formed while the molecules get packed

MIT Engineers Build Smart Power Outlet

MIT Engineers Build Smart Power Outlet

access_time July 1, 2018

A Smart Power Outlet for the Modern Smart Homes from MIT Engineers A number of users face unwanted challenges while

ESight 3 High Tech Glasses are Helping Blind People See

ESight 3 High Tech Glasses are Helping Blind People See

access_time January 8, 2017

Ever wondered how a blind person manages to navigate normal life? Sighted people take every day chores for granted, while

Blog

AI Algorithms are Doing Video Generation from Text

AI Algorithms are Doing Video Generation from Text

access_time March 8, 2018 chat_bubble_outline 0 comments remove_red_eye 1622 views

AI being used to video generation from text

Artificial Intelligence is getting bigger and bigger with each passing month as more number of areas is being opened to broaden its reach and effectiveness. AI is already powering a number of consumer electronics device ranging from the smartphones, computers to IoT devices. Now we will get the video generation from text with the help of the AI at the core.

Generating new videos consistently with the emerging trends is quite a demanding task for the creators. Therefore scientists had started making use of the artificial intelligence for the video generation from text itself wherein it works towards creating generative video.

With this new found research scientists will be able to type out a simple phrase and artificial intelligence will work towards creating a video of that particular scene by carefully analyzing the text.

AI can do video generation from text

The lead scientist who has made video generation from text possible using the artificial intelligence is from the Duke and Princeton University. Scientists had explained that the task of video creation is directly related to the video prediction ability.

In this research scientist has forwarded this task of the predicting what actions should be the part of the video to the artificial intelligence rather than the human mind.

It should be noted that the visual representation happens to showcase a wide range of the human emotion as well as actions than the still pictures and herein AI has been perfected to identify the correct type of the things from the videos.

Teaching and training the AI

In order to train the artificial in successfully performing video generation from text scientist had used a wider range of easily understandable and defined activities to cut out a video.

The activities in which AI was trained to identify included ‘jogging’, ‘riding a bike’, ‘kite surfing’, ‘playing football’, ‘swimming’ etc.

In the later stages the AI carefully studies the clips and learns to identify the varied human emotion from the exiting videos. AI was able to identify millions of emotion with few weeks of training. Once the dataset has been created by the researchers from their SI training exercise they started the two-step process which allows it to stitch together a generative video based on the text.

In the first step AI works toward creating a wide range of gist of the video which is specifically based on the input text. In this step the gist happens to be an image which lends the background colour and even the object layout is created here.

In the second step which is named “discriminator” specifically allows AI to identify the right set of gists to use for creating the video based on the user text-input. If the text input asks “riding on a bike” then all the gists made in the first step will works towards video generation from text showing a person riding a bike. The resulting image from the gists is good enough to pass as a commendable video for the moment but scientists are actively working towards enhancing its core abilities.

folder_openAssigned tags
content_copyCategorized under

No Comments

comment No comments yet

You can be first to leave a comment

Submit an answer

info_outline

Your data will be safe!

Your e-mail address will not be published. Also other data will not be shared with third person.

This site uses Akismet to reduce spam. Learn how your comment data is processed.