Видео

I keep getting this error "Prompt outputs failed validation", any ideas? Tried searching your Discord but no luck.

This is great but I keep getting an error "Prompt outputs failed validation", any ideas??

why in my case the IPA ADV if haven't clip vision itsn't work so when I put CLip Vision the IPA ADV error Error(s) in loading state_dict for Resampler: size mismatch for proj_in.weight: copying a param with shape torch.Size([768, 1280]) from checkpoint, the shape in current model is torch.Size([768, 1664]).

Any clue why I am not able to run cosXL workflow, please???? I keep getting this error all the time: Error occurred when executing SamplerCustomAdvanced: tuple index out of range File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\comfy_extras odes_custom_sampler.py", line 557, in sample samples = guider.sample(noise.generate_noise(latent), latent_image, sampler, sigmas, denoise_mask=noise_mask, callback=callback, disable_pbar=disable_pbar, seed=noise.seed) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\comfy\samplers.py", line 684, in sample output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\comfy\samplers.py", line 663, in inner_sample samples = sampler.sample(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\comfy\samplers.py", line 568, in sample samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options) File "F:\AI\stable-diffusion-webui\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context return func(*args, **kwargs) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\comfy\k_diffusion\sampling.py", line 599, in sample_dpmpp_2m denoised = model(x, sigmas[i] * s_in, **extra_args) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\comfy\samplers.py", line 291, in __call__ out = self.inner_model(x, sigma, model_options=model_options, seed=seed) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\comfy\samplers.py", line 650, in __call__ return self.predict_noise(*args, **kwargs) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\comfy_extras odes_custom_sampler.py", line 469, in predict_noise out = comfy.samplers.calc_cond_batch(self.inner_model, [negative_cond, middle_cond, self.conds.get("positive", None)], x, timestep, model_options) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\comfy\samplers.py", line 226, in calc_cond_batch output = model.apply_model(input_x, timestep_, **c).chunk(batch_chunks) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\comfy\model_base.py", line 113, in apply_model model_output = self.diffusion_model(xc, t, context=context, control=control, transformer_options=transformer_options, **extra_conds).float() File "F:\AI\stable-diffusion-webui\venv\lib\site-packages\torch n\modules\module.py", line 1518, in _wrapped_call_impl return self._call_impl(*args, **kwargs) File "F:\AI\stable-diffusion-webui\venv\lib\site-packages\torch n\modules\module.py", line 1527, in _call_impl return forward_call(*args, **kwargs) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\comfy\ldm\modules\diffusionmodules\openaimodel.py", line 887, in forward h = forward_timestep_embed(module, h, emb, context, transformer_options, output_shape, time_context=time_context, num_video_frames=num_video_frames, image_only_indicator=image_only_indicator) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\comfy\ldm\modules\diffusionmodules\openaimodel.py", line 44, in forward_timestep_embed x = layer(x, context, transformer_options) File "F:\AI\stable-diffusion-webui\venv\lib\site-packages\torch n\modules\module.py", line 1518, in _wrapped_call_impl return self._call_impl(*args, **kwargs) File "F:\AI\stable-diffusion-webui\venv\lib\site-packages\torch n\modules\module.py", line 1527, in _call_impl return forward_call(*args, **kwargs) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\comfy\ldm\modules\attention.py", line 694, in forward x = block(x, context=context[i], transformer_options=transformer_options) File "F:\AI\stable-diffusion-webui\venv\lib\site-packages\torch n\modules\module.py", line 1518, in _wrapped_call_impl return self._call_impl(*args, **kwargs) File "F:\AI\stable-diffusion-webui\venv\lib\site-packages\torch n\modules\module.py", line 1527, in _call_impl return forward_call(*args, **kwargs) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\comfy\ldm\modules\attention.py", line 618, in forward n = attn2_replace_patch[block_attn2](n, context_attn2, value_attn2, extra_options) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\CrossAttentionPatch.py", line 26, in __call__ out = out + callback(out, q, k, v, extra_options, **self.kwargs[i]) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\CrossAttentionPatch.py", line 139, in ipadapter_attention ip_k = torch.cat([(k_cond, k_uncond)[i] for i in cond_or_uncond], dim=0) File "F:\AI\stable-diffusion-webui\extensions\sd-webui-comfyui\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\CrossAttentionPatch.py", line 139, in ip_k = torch.cat([(k_cond, k_uncond)[i] for i in cond_or_uncond], dim=0) Queue size: 0 Extra options * ipadapter_cosxl_edit

This builds on your previous experimental node where you asked for some help from the community. Glad to see they helped you decipher the layers

As always amazing work Matt3o! For those interested in the Crossattention codes this is what they target: 1) General Structure 2) Color Scheme 3) Composition 4) Lighting and Shadow 5) Texture and Detail 6) Style 7) Depth and Perspective 8) Background and Environment 9) Object Features 10) Motion and Dynamics 11) Emotions and Expressions 12) Contextual Consistency

Very good as always Matteo. Can you explain all the index please? I've noticed only 3: 3: Reference image 5: Composition 6: Style

maybe you can do a "pill" on the image negative because its still not super clear how it works.

"We fail to understand what we already have" - cries in GLIGEN conditioning

CosXL-edit does not work if the source image is large (mine is 3840*2160)

Hey Matteo, Just finished your ComfyUI tutorial - seriously impressive stuff! 👍❤ Your breakdown of advanced features with practical examples is super motivating. I'm excited to put these into action and unlock the full potential of ComfyUI. Thanks for sharing your knowledge!

Matteo, thank you for bringing us IPAdapter, which provides a solid ground for us to combat the uncertainty generated by large models. I personally like your explanation of basic theories. Although your course is less than 10 minutes, I have studied it repeatedly for several hours. If you have time to explain in detail the specific functions and applications of the 12 layers of the cross nerve, thank you very much for your efforts, thank you!

IPAdapterApply fail because my only IPAdapterApply node is IPAdaterApply(SEGS) . I tried installing IPAdapter_plus again. Does not work. What am I doing wrong?

Wasn't going to download sd3 but this video definitely changed my mind so I'll give it a try

hi thanks for this great tutorial. im getting error while executing the code is "" ipadapter object has no attributee 'apply_ipadapter" i tried to using sd15 checkpoints as well sdxl. but getting same.

I just have to laugh... I wanted to use some of the ideans from this work flow and started a new flow and started building my flow and almost immediately got stuck on on the pos and neg nodes... took me awhile to figure out that the nodes are called primitiveNode... so i added that but it looked nothing like yours.. tried different things... then I though to just copy paste the node to my new on... nope.. no text area to type.... How did you create those primitiveNode nodes to have string out and multiline text area? BTW I am totally enjoying my self watching and learning from your videos. ;O)

6666

When I Type 3:2.5,6:1 always gives an error: Error occurred when executing IPAdapterMS: not enough values to unpack (expected 2, got 1) File "E:\sd\comfyui\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\sd\comfyui\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\sd\comfyui\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\sd/comfyui/ComfyUI_windows_portable/ComfyUI/custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 763, in apply_ipadapter work_model, face_image = ipadapter_execute(work_model, ipadapter_model, clip_vision, **ipa_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\sd/comfyui/ComfyUI_windows_portable/ComfyUI/custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 253, in ipadapter_execute weight = { int(k): float(v)*weight for k, v in [x.split(":") for x in layer_weights.split(",")] } ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\sd/comfyui/ComfyUI_windows_portable/ComfyUI/custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 253, in weight = { int(k): float(v)*weight for k, v in [x.split(":") for x in layer_weights.split(",")] }

HOLY SHIT, this is powerful!

Great video. Top notch content, as always

this is awesome thank you

I tried this with a few images. I'm getting back a similar image, but not the same ones as the original. What am I doing wrong? Mostly the background is different, while the subject stays more or less the same (some little differences in attire).

🫡👏👏

🤯

This is incredible. I will have towatch it two or three time more to get a real understanding. Thanks for the lesson.

Is there any similar way to apply Lora style to only specific layer? Maybe we can apply negative weight for composition layer (e.g. layer 3) and positive weight for style layer (e.g. layer 6)?

I can't find the style transfer precise on the list. Is it the same as "strong style transfer"?

love love love this, going MAD!!!!

dying to know what the other index blocks are!

Awesome work! Do you have the info on the other 10 control index points?

Damn that's impressive. Could the same logic be applied to a Lora node in the future ?

If anyone could prove that some ai artists should have copyright protection over their image generations, it would be you. Definitely no "Do It" button here. Amazing stuff and thank you for taking the time to grind through all the possibilities and then breaking it down for the rest of us dummies ;-)

Great video, thank you! Where can we find this node?

Nice work! ❤It's awesome to see real progress on the U-net layer. But having too many parameters can make it tough to get started, even for someone like me who's been at it for over a year. It's just too challenging for ordinary people. If we change the filling parameter to four simple options like ABCD, it might be easier to promote. Ordinary people aren't into the process; they're all about the end result.

HI matheo, i use SDXL ckpt model from Cyberrealistic and i have been set ipadapter in all sdxl setting, but it generate like a PIXAR face in real person body, ive been add more prompt to get realistic. any idea to fix my work ?

Collaboration Invitation,may i get your e-mail?

you have so many secrets matteo :D

You called that node based on yourself right? You're truly a mad scientist bringing us the best discoveries! Thank you Mateo

I love the idea of target conditioning various layers and being able to direct the layer with this kind of control in the cross attention. Thank you Matteo for you continued work and expertise. You give us a lot to play with and work with. The implications of the kind of control we can have in image creation and manipulation will last for years. Continued blessing to and appreciation to you good sir. 🙏🏾👍🏾

I will say this again, you are simply amazing Matteo! "Shut Up and Take My Money!"💰

Like your video… I don’t know anything. I don’t have gpu… but I came to know about getsalt ai… Can you make this video… with getsalt ai

Ciao Matteo, non ho trovato il link al workflow e ho copiato seguendo i tuoi passaggi, ma il SamplerCustomAdvandces, nella sezione CosXL Edit, mi dà errore. Ho aggiornato IPadpter e tutti i nodi su ComfyUI e controltato ripetutamente il tuo settaggio in video senza successo. Grazie per i preziosi contributi e forza Firenze! ♥

Hello man, thanks for sharing this amazing improvement on control! Did something change between the style transfer and composition from 2 days ago to this release? I cant seem to reproduce same results :( Or, is there a way to reproduce the exact same layer weights of that previous release within the mad scientist node?

Thanks a thousand Matteo. Your last statement is something I tell time and time again, we only use so little potential in what's already out there. Brilliantly proving that point.

so cool and you are our mad scientist

I have a question: when the weight type is changed to style transfer precise, is the array in the third layer composition negative,By the way, Matteo, your work is as exciting as ever.

Thank you very much for the video!

One more... I don't know if it helps more than a single comment... But you are an artist, watching that video with you setting wrights was watching an artist at work, thank you again!

God of IPAdapter