Does AI in DaVinci Resolve 20 Replace Editors?

0:00 any mention of AI and video editing is such a touchy subject right now I mean I don't want to be replaced by the machine but the brand new denture resolve 20 beta that's out now you can go download it it's loaded with tons of new AI tools but actually they seem to be taking care of more of the boring timec consuming tasks so that we can be more creative now this video right here is going to explain all of the Denture resolve 20 AI features so that we can decide together what our creative feature holds AI music editor have you ever had a long piece like this that you like but you need it shorter because the video is for 15 seconds or 30 this is a great way to cut it up without you having to go and find the perfect cut points and it's a great starting point so the way it works you select the clip open it in the

0:46 inspector and you'll find this right over here obviously denture res Studio would be the key here music editor and you can either hit adjust with a specific duration or you can hit the live trim button which is going to give you basically like a trimming control to tuck this up you see it's a little bit of a different icon there let's say I want it that long it's going to analyze the clip and it's going to find beats in the music where it's going to transition gently between them and and make a nice New Cut of Music That's the duration that you need and there we go it has trimmed it up it looks like it's placed one cut it's got sort of this zigzaggy line in here another thing you can always do in here is the AI music editor gives you options so we have an option one and option two and option three and option four so you can listen to all those and see which one works really well let's see if we can even hear the cut right

1:32 [Music] here hey not bad [Music] right all right this next one is going to be called AI beat detector for your music now I know you don't always want to be cutting on the beat but sometimes you do and this is going to help you out with snapping enabled so the way it works is real simple you right click on a music track it's the bottom option there it says show music beats and it's going to listen to the music and it's going to make snapping points for you so you just want to make sure you have snapping enabled that's this n button the shortcut or this magnet right here and now if I use my trim tool t for trim I can make sure when I'm going along here I'm snapping to the Beat of the Music so when to make a cut it's happening on a Beat of the

2:18 Music so uh it's just one of those things that's supposed to help you along you know I think this is going to work best with beat driven music I obviously but this can be a great way to easily cut to the beat and then you can change it later and turn snapping off AI intelliscript now this one peaked my curiosity a lot the idea is you pull footage in you give it a script and resolve just cuts it for you now the way that it actually works is still very much in beta I'll tell you that I filmed a really bad um I would just say spoof commercial about the dent resolve editor keyboard I had like seven different scenes here you can listen navigate timelines faster than ever with the multi-functional search stop basically I pulled these in they're subclips I ran

3:03 the transcription engine on it right up here so they all resolve knows what the audio of each of the clips is so once that's done you right click to select the clips and you go to the new AI tools contextual option and you can say create a new timeline using Intellis script so once you choose that you feed it a text file it's just a plain old text file like that click open and just like that almost instantly it has created a timeline that it has dropped a few of my scenes I went from scene 1 to 3 to 6 to 7 and it's probably not the best timing but this is to give me like an initial radio edit speed Precision control Precision at your fingertip harder built for pros Made For Speed speed so I don't know um I think

3:49 it's got a ways to go but I think it's really cool the idea behind resolve knows what the text is so and it knows a script so we could assemble that for you honestly with intelliscript I do want to know down below how do you feel about Dent resolve actually editing a script together for you for that initial pass is it helpful because most of the work is actually not that first pass I don't know AI magic Mask 2 now if you've used magic mask in the past this is just a better faster cleaner version of it and it has some extra cleanup tools so to use it it's on the color page only right now uh this three dot menu over here gives you option to use a legacy one but it's already set up to use a second version just use that it's better trust me right so to make use of it I'm first just going to click on little highlight button here so I can see the results of it after I click make sure you have your

4:34 eye dropper set to the plus icon and this time you just do a single click a single click is all you need you do not do the swipey motion like you did in past versions you know what I'm just going to leave this on faster because you know this is probably a fine selection I'm just going to use this to maybe bump the exposure contrast saturation on him as he jumps in and you can see this thing is just cranking it's doing really really well um but the other thing I want to mention about magic Mask 2 is they give you a little bit of extra cleanup controls on a frame by frame basis so on the fusion page I've shown before you can use mask paint to clean up any of the flickering that happens with you know AI generated masks in the past you can do that here as well so I'll show you how that works I'm going to disable this overlay I'll go up here to my normal highlight mode and you

5:20 can go to this black and white mode and you can see the actual mass that's being generated from here I'll see if there's any frames as I come through here that are you know maybe they have a bit of flicker on the edge or something that that didn't need to ex in fact this was actually done so well that I don't really see any at all maybe let's pretend we didn't want that that shoe or that you know that foot right there to uh to appear you could come over here you've got the uh the paint brushes down here subtract paint stroke it's on a it's on a frame by frame basis and you just come in there and click and then it goes away white reveals black conceals uh Z Zoom to fit and then the other thing I will mention is because I use the the faster mode I have pretty jaggy edges and we can just blur this after

6:07 the mat's been generated with things down here like blur radius and that'll just soften up those edges a little bit and for color correction this is generally more than enough AI audio assistant now this is a way for D Vinci resolve over here to do an automatic AI based professional mix for you in the background now they do suggest you duplicate your timeline first because then you don't have to worry about changing settings if you didn't like it so duplicate your timeline first go to the timeline menu you've got AI tools and here it is AI audio assistant and we get to choose a delivery preset sure we'll choose YouTube and it'll automatically mix the thing it's going to sort things for us and let's take a listen when this is done to how it sounds it's got audio classification dialogue mix music mix geez it went so

6:53 fast let's take a listen so faith is rising up I grabbed Nate and I was like hey I got this idea can you help me flesh it out and of course he like L he just gets on the keys and he's like next thing I know the song is ready but we needed a bridge I don't remember that's where the line came from where we said wow that is not too bad let's listen to what it was just before so this is the original so faith is rising up I grabbed Nate and I was like hey it definitely did a lot to his voice there we'll come back over here this is the mixed One Faith is sure I'm going to see what

7:39 I'm praying for I'm going to see what I'm praying for sometimes uh that means that you got to walk into a room of Believers and not bad this is pretty cool I mean I don't know if I'll use it every time but to be able to just push a button and a few minutes later there's a mix rated to go for YouTube or wherever else need to send it this is going to help a lot of people including myself denture resolve 20 also has AI multicam Smart Switch so if you have a multi- camera podcast for instance you just need to get it cut up really quickly you hit this little multicam Smart Switch button that's now in the window now you need to be in the the make sure in multicam mode to see this click it and you get some different parameters but one thing that I think is

8:24 really interesting about it is that it's not just listening to audio yes you can just say use audio only for fast analysis but it actually looks at the video pixels like if people's mouths are moving to know when it switches so the way you work with it I mean obviously there's a lot of parameters we could change and adjust I haven't had time to do that yet but click analyze it's going to go through this entire 20 minute multicam and cut up the video for us so that we can have a finished video while we go grab our coffee and we're down to the last 8 Seconds of the analysis on the AI multicam Smart Switch they created 200 22 Clips let's take a quick listen to see how well it did on some of these cuts to see if it actually followed the picture like you would want to do if you're editing this manually well animals don't like that feeling of

9:10 slipping and falling you don't want to trigger the fear of falling if you trigger the fear of falling your animal is going to be um going to be upset right and I gave a talk recently at a at a Veterinary conference pretty cool I think this could definitely work oh man this is definitely one of those things I could see saving a lot of time when you constantly have these long conversations and you need to get the video out there AI voice convert uh you may be heard of 11 Labs well the idea here is we could take a recording and convert it into someone else's voice later on it's not entering text and converting it it is taking a recording converting it so it's a two-step process for this to work first you have to train D Vinci resolve on The Voice the way that's done is you record a sample or you feed it a sample so let's take a

9:56 listen Da Vinci resolve 19 features powerful new Da Vinci neuro engine AI tools so that's my wife I recorded her right over the microphone to create an AI or voice model in here you right click on the clip in the bend that you want to use to create the model and then you go to AI tools new AI tools and we have a new Option here called Da Vinci AI voice training as soon as you click this gives you a warning about copyright legal issues obviously never ever ever think about using someone's voice you don't have access to you accept accept it and it takes a while I'm not going to lie this took about an hour to generate a model but once that model of that voice is created I'll show you how you can use it here's an example of what it sounds like with my voice right now navigate timelines faster than ever with

10:42 the multi-functional search dial it's Precision at your fingertips I know don't laugh too hard right now now to convert it all you're going to do is select all the clips down there on the timeline right click obviously the audio clips and then we have this option right here called voice convert after you choose voice convert the Box comes up here you choose the voice model that you built I built one called Ashley that's just her name you hit render and actually you get the choice right here before you do this I want to point out the track of where you want it to go render in place is going to basically like overwrite the audio that's there instead of doing that I might just say I want this to go down to audio 2 for instance so that I can ab compare the two hit render and it's going to actually render out like it's going to create an audio file that didn't exist before using the inflections of voice uh

11:30 and putting right there in the timeline for us this timeline is a little less than 30 seconds and it looks like it's taking about 30 seconds to do the conversion now let's take a listen if I solo just this new track that has her voice that was AI generated speed Precision control the dent resolve editor keyboard takes your editing workflow to the next level navigate timelines faster than ever with a multifunctional search style it's Precision at your fingertips okay again please don't don't laugh but this opens up so many opportunities when you think of like maybe you're recording in a loud environment somewhere outside and you need to do ADR and maybe it's just even ADR with your own voice you could build a model of your own voice and easily swap it out with a much cleaner signal AI animated subtitles that means word

12:17 for word things can pop up on screen we're going to go to the timeline menu like we did before but this time it's inside the AI tools it wasn't here in 19 so if you're looking for it create subtitles for audio which is just list listening to the timeline to create our subtitles initially from just listening to it so as this creates the subtitles then we can easily change it out with a fusion title afterwards so let's take a listen make sure it's correct first our response is not to wait with eager expectation for the day when we get event all right so some text is there it doesn't matter what it is but the idea is you go to the effects panel now under the toolbox we have a whole category for subtitles that are animated that Blackmagic has done for us so you could do something like word highlight you drag word highlight to this track header area of subtitles and now this is going to be

13:02 responsive to the text changes as it goes so and it's editable after the fact so check this out our response is not to wait with eager expectation for the day when we get Avenged like instead our response is to take if I select the track this is a track level effect come over here to the inspector and then with the track selected track over here we can change parameters so in the past I shown how you can limit the the fonts to a certain font list let's do that here so let's say our brand font is going to be archivo condensed or something like that and we want to make it much much larger and we want to reposition it on screen cuz you know we maybe want that up in the center there and who wants yellow I don't want yellow I want white I'll choose that there and our response

13:49 is not to wait with eager expectation for the day when we get Avenged like instead our response is to take a lesson from the parable of the unmerciful servant pretty aming right if you're doing social media content and you're not doing inventure resolve I think you might be doing something wrong AI intellic cut now I think this only works on the fairlite page and I want to show you one of the features it can do and that's to checkerboard out audio sources if you have multiple people that talked into the same microphone they're on the same channel it can split them out so it makes it easier to apply you know different gain levels different eqs to sweeten their voice a little bit here's a audio sample with two people in One mic so in the past you talked a lot about animals uh where does that passion come from so that's my voice um I think just cuz we

14:35 always had pets growing up in my house all right so there's there's my wife's voice so it switches from one voice to the other the way this works is I'm going to use my edit selection tool select the bottom range of it which just selects the whole clip it's an easy way to do that and then right click on the clip and we'll go to the AI tools and choose checker board to new tracks when you click this the idea is the AI in here is going to switch from one person to the other so each track can be uh worked on independently in fact I might change this here because I know I started I'll change the name of the speaker here to Ashley and we'll take a listen I'll hit option X to clear my in andout range and we'll so in the past you talked a lot about animals uh where does that passion come from look at that

15:21 um I think just CU we always had pets growing up in my house from the moment I was was born we had a dog cat look at that let's see what happens when it cuts back up if it caught me so we kept them and then they made more kittens so you've had a lot of cats huh how many cats were in this box just two okay we named them Adam and Eve were they the first cats that were in the we already had one before that that was older okay then we had Adam and Eve it's not too bad right so it it is switching when there's overlap it's you know it's making its best judgment so that is the checkerboard audio feature another really cool tool you can work

16:06 with in fairlite that's AI based is to remove silent areas or basically areas that are below a certain threshold where it just basically deletes the audio now you probably want to have some sort of a background bed of audio when you do this but this could clean up any you know any extra sort of noise in the signal and the way this one works is you select the edit tool we get a range selected again you right click and this one is called called well to remove silence it's the remove silence right there it's not under the AI tools so this is going to give me sort of a threshold of adjustments that I can make and the red areas are basically telling me we it's going to completely non-destructively delete from the timeline so I might want to make it not cut out quite so frequently so I can change the threshold here as well as ADD Fades to the beginning and end of the clips um I

16:52 might just turn these numbers down a little bit differently so we don't cut in quite as much I don't know remove silence so in the past you talked a lot about animals uh where does that passion come from um I think just cuz we always had pets growing up in my house I think that's a much better result AI smooth cut so what smooth cut does is it helps you cover up jump cuts and interviews and yes Smooth Cuts been on these keyboards has been around for a long time but this is a new version of it so I want to show you how this works and how it compares to the old one so this is the jump cut I'm dealing with my timeline Kansas City to the camp there

17:37 well on Sunday afternoon we pretty drawing right and this right underneath it is a rendered out compound clip of using the smooth cut so I did render it out I found it's better to compound clip it and render the transition out but here it is with smooth cut with speed warp City to the camp there well on Sunday afternoon we needed isn't that beautiful that's a great thing so this is what the old one looked like without the speed check box checked in the inspector the camp there well on Sunday after see how it if you look at this part of the frame it just totally morphs and meshes the uh the chair in the background as her head moves the old one was not able to identify her separately from the background apparently so this is the old one to the camp there well on Sunday here is the new one that's been rendered as a compound clip Camp there

18:23 well on Sunday afternoon and then here's the original jump cut to go to Kansas City to the camp there well on Sunday afternoon we I'll tell you the AI super scale has also been improved so if you're working with like 1080p footage and you need it to mesh with like 8K footage a lot of people talk about using topaz you don't necessarily need to do that you just need resolve Studio the AI super scale tab over here in the inspector and change this to something bigger 4X would be like going from 1080 to 8K if you're just going to 4K from 1080 you could use the 2A 2x enhanced as well and all that is better performance is better looking but there's also the AI depth map that got improvements and that's always been a bear and really hard on the computer I found it performs much much better so this is a really monotonous like very blue shot maybe I

19:10 want to introduce some warms into it some some sort of you know later morning Vibes to the foreground I could add another note here with option s drag the depth map effect from the inspector and you'll see it is automatically separated the layers of the foreground to the background so that I can separate them you you know as if it was like real light hitting them you know what I mean so to do this I'm just going to turn off this depth math preview it's already working on this separated Alpha Channel and then a great way to change color temperature on part of it is just the the HDR color wheels have this temperature slider down here in the corner I'll just crank that make it nice and warm and we'll start to see what an output is on that white area remember the white reveals and black and seals

19:56 and you can see I was able to get a a kiss of light of sunlight there on that front of that building and to me this just makes the shot more interesting now I got to ask a favor please down below leave a comment and let me know which of these AI features they put into denture resolve is going to help you and which ones your concern might hurt you and that's going to actually inform me on what I should be teaching on over the next year