C31: Fine-Tuning Diffusion Models with LoRAs: A Step-by-Step Guide

LoRAs, or Low-Rank Adaptations, are revolutionizing the way diffusion models generate specific styles and subjects. By modifying the weights of cross-attention layers within a diffusion model, LoRAs allow creators to fine-tune outputs for unique artistic or technical needs. In this article, we’ll explore how LoRAs work, their practical applications, and step-by-step guidance for integrating them … Read more

C27: How to use Remove Latent Mask to perform Inpainting with Generic Diffusion Models in ComfyUI

Introduction In our previous article, Optimize Inpainting Resolution in ComfyUI, we explored techniques to enhance resolution during inpainting workflows using specialized models. Building on that foundation, this article focuses on inpainting with generic diffusion models, offering a versatile approach for scenarios where specialized inpainting models are unavailable or unsuitable. This guide walks you through the process step-by-step, … Read more

C23: Fine-Tuning ControlNet Parameters in ComfyUI

Introduction In our previous article, we explored how ControlNet can be used in ComfyUI workflows to direct image composition using external inputs like line drawings. While this approach allowed us to achieve precise object placement, the results were not always satisfactory due to the default ControlNet parameters. For example, the generated dog followed the contours of a simple … Read more

C19: Modular Sampling with SamplerCustomAdvanced: A Step-by-Step Guide

When working with machine learning workflows, modular sampling can provide a more intuitive and flexible approach to constructing models. In the previous article, I showed you how to set up the Flux model using a standard case sampler node. In this guide, we’ll explore how to set up a modular workflow using the SamplerCustomAdvanced node, focusing on … Read more

C16: Workflow for SDXL Base and Refiner Models – The Complete Guide

Introduction The SDXL model offers powerful capabilities for image generation and refinement, making it a popular choice for creative workflows. In this article, we’ll explore how to set up the full SDXL workflow using both the base model and the refiner model. By leveraging these models effectively, you can produce high-quality images with improved details and artistic … Read more

C11: Mastering Inference Steps and CFG Scale in AI Image Generation

When working with AI-powered image generation tools like ComfyUI, understanding inference steps and CFG (classifier-free guidance) scale is essential for producing high-quality results. In this article, we’ll explore how these parameters affect image generation and how to adjust them to achieve the best outcomes. Understanding Inference Steps Inference steps, also known as sampling steps, define … Read more

C10: Mastering Samplers and Schedulers for Diffusion Models: A Comprehensive Guide

When working with diffusion models, understanding the mechanics of samplers and schedulers is crucial to achieving optimal results. These components influence how noise is removed from the latent space, shaping the quality and characteristics of the final output. This guide delves deeper into how samplers work, explains their importance, and provides actionable steps to select … Read more