ID-LoRA with LTX-2.3 and ComfyUI custom node🎉

Tools 286 points 56 comments 2 months ago

**ID-LoRA** (Identity-Driven In-Context LoRA) jointly generates a subject's appearance and voice in a single model, letting a text prompt, a reference image, and a short audio clip govern both modalities together. Built on top of LTX-2, it is the first method to personalize visual appearance and voice within a single generative pass. Unlike cascaded pipelines that treat audio and video separately, ID-LoRA operates in a unified latent space where a single text prompt can simultaneously dictate the scene's visual content, environmental acoustics, and speaking style -- while preserving the subject's vocal identity and visual likeness. Key features: * 🎵 **Unified audio-video generation** \-- voice and appearance synthesized jointly, not cascaded * 🗣️ **Audio identity transfer** \-- the generated speaker sounds like the reference * 🌍 **Prompt-driven environment control** \-- text prompts govern speaking style, environment sounds, and scene content * 🖼️ **First-frame conditioning** \-- provide an image to control the face and scene * ⚡ **Zero-shot at inference** \-- just load the LoRA weights, no per-speaker fine-tuning needed * 🔬 **Two-stage pipeline** \-- high-quality output with 2x spatial upsampling * LORA LINK- ID-LoRA

More from r/StableDiffusion