0:00 [Music] let's talk about models and especially live merging of models because that is something you can do in com UI to follow my workshop you can download my workflow on open art you see here there's a download button and above that you have a green button that says Lounge workflow where you can actually run my workflow in the cloud for free of course the first thing we need to clarify here is what are models models or also known checkpoints are Community trained models most of the time that can have all kinds of different styles all kinds of different subjects of what they are about you can see here there's a lot of
0:45 different things here for example anime photo realism digital painting 3D like not actual 3D but looking like 3D and some of them might give you beautiful colors beautiful composition others give you the style you desire and maybe you want to use both of them this is where live model merging is coming into play again I built a simple workflow for you we have here two different checkpoints we're loading we have here a model merge and a clip merge we have the positive and a negative prompt a case sampler and then just to make everything look a little bit nicer a second case sampler with a different sample method and then we decoding this into the preview image that I'm going to put over here so we
1:32 can compare that to the different settings of the model merch now let's before we do that scroll in here have a quick look at the K sampler I'm not doing any upscale this time just so to make it faster but still get a nice result in the first Cas sampler we are using UL ancestral with a Shuler of normal and you can see D nois is one CFG scale is seven steps of 30 in this case I have fixed my seat so that I always basically basically would get the same result the only difference is the weight that we are applying in the model merge and also in the clip merge and then you can see the latent is going here into the second case sampler again here we have a fixed seat and we have again 30
2:18 steps CFG scale 7 but in this case we're using the sampler DPM Plus+ 2 msde and then a scheduler of caras with a d noise of 0.5 and as I already said this is going to go into the vae code that I'm using with my vae 840,000 model here that is loading into the vae over here let's also have a look at the prompt the negative prompt we're using here very simple prompt in that case beautiful Japanese woman in a business dress slender standing in a Japanese bar negative prompt ugly deformed embedding bad artist embedding bad hands five all of that very simple as a setup so let's look at our setup here for our check points you can see here we have the
3:04 checkpoint load for our epic realism model and then also the checkpoint load for our ref animated model both of them go into the model merge symbol and also the clip merge simple here you can see we have a ratio in here this is a little bit counterintuitive because when we are at one this is a 100% model 1 and when we are at zero this is 100% model two so if this is a little bit confusing for you you can also cross these wires put the second model into one and then the first model into two so logically it makes maybe a little bit more sense to you on how ter ratio slider is working anyways it's easy to figure out by just doing a test render with this let's set
3:50 this back to one here and then we have the same here for the clip merge simple the clip of course is used for the text prompt and not the K sampler model load and of course both of that is connected over here now as you can see here the model is going here in our reroot and then into both of our K Samplers for loading the model and of course the clip merch is going here with a reroot again into our clip texting code for the positive prompt and the negative prompt so far so easy now let's zoom in here so we have a nice preview and in this case you can see that I'm here at Value one which means for a preview here I'm using
4:35 100% of our epic realism model this is why this looks like an actual photo now let's set this to zero and render it again and now as you can see from the result this is the ref animated model it looks like a digital painting not like a photo anymore let's do this again but now put the clip merge on zero and again you can see we have a different result from that this is looking even more than ref animated because now not only is the model 100% ref animated also the clip is 100% ref animated now you might like this from the composition but say it's cool but I want to have it more photo realistic this is too much digital style so what you want to do here of course is to push
5:22 the ratio up so let's go here a little bit higher let's say we're going to go here with 0.4 on both of these values let's go like this and see what we get from that and as you can see now we have something that is more of a digital painting but also has more photo realism in that maybe that's a little bit too much photo realism for you st in this case you can just reduce the values let's go here with 0.2 so we set both of them down to 0.2 and then let's render this again and now we are again closer to the digital painting style but we have a smidge of photo realism in there too so this can be super useful and the good thing about the life merging is first of all you can
6:08 experiment with this really quickly by just moving the sliders around but also you don't have to fill up your hard drive with the merges of all these models just to test out how the merch is going to look now the only limitation here is of course that you have to load these models into your RAM so this kind of depends on how much RAM you have and how much models you want to merge together because there's also nodes where you can merge even more models together or you can also set these in series so for example the output of this model merge can go into another model merge to merge the merge of these two models with a third model things like that so there's a lot of experimentation in here this is what is so beautiful about comu ey you can build up a
6:55 workflow and a process that is completely unique to the results you want to have so this is actually like an artistic canvas thank you for watching this video and see you soon bye oh you're still here so uh This is the End screen there's other stuff you can watch like this or that really cool and yeah I hope I see you soon uh leave a like if you haven't yet and well um yeah
